Kellie Walsh

Key Skills

Software

Data Annotation Tech

Top Subject Matter

No subject matter listed

Top Data Types

Document

Text

Top Task Types

Evaluation Rating

Fine Tuning

Text Summarization

Freelancer Overview

I have evaluated model responses based on accuracy, instruction following, safety, conciseness, content completeness, and writing style. Long email summarization evaluation is another area I have worked in. This requires reading through email conversations and then evaluating the model responses on whether they provide enough details. Along with those tasks, I have also assisted in assessing audio responses, focusing on the humanness quality of the speech pattern.

Labeling Experience

AI Trainer

Data Annotation TechTextQuestion AnsweringText Summarization

Projects are fast faced, usually completed in about a day. The company has a variety of different projects. The majority are text based, however, audio and image evaluation projects are available also. I have worked on projects dealing with how well model responses follow the system requirements and rubrics. Evaluating model responses on 6 and 7 axis scales are common projects as well.

Projects are fast faced, usually completed in about a day. The company has a variety of different projects. The majority are text based, however, audio and image evaluation projects are available also. I have worked on projects dealing with how well model responses follow the system requirements and rubrics. Evaluating model responses on 6 and 7 axis scales are common projects as well.

2025

Education

Work History