Heather Sullivan

Key Skills

Software

Appen

Labelbox

Top Subject Matter

AI Language Model Evaluation

General AI/ML Data Labeling

Top Data Types

Text

Image

Video

Top Task Types

Classification

Object Detection

Text Generation

Question Answering

Fine-tuning

Transcription

Data Collection

Prompt + Response Writing (SFT)

Freelancer Overview

AI Response Evaluator. Brings 9+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal, Proprietary Tooling, and Appen. Education includes Bachelor of Science, Open University (2018). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

AI Response Evaluator

Text

In this role, I evaluated AI-generated responses in multi-turn conversations using structured rubrics. My focus was on instruction adherence, logical reasoning, factual accuracy, and coherence in the outputs. I provided detailed feedback to improve model performance and identified edge cases or failure patterns. • Applied complex, evolving guidelines with high accuracy • Assessed language model consistency and reliability • Delivered clear, comprehensive evaluations on large data batches • Supported iterative improvements for AI conversational systems

In this role, I evaluated AI-generated responses in multi-turn conversations using structured rubrics. My focus was on instruction adherence, logical reasoning, factual accuracy, and coherence in the outputs. I provided detailed feedback to improve model performance and identified edge cases or failure patterns. • Applied complex, evolving guidelines with high accuracy • Assessed language model consistency and reliability • Delivered clear, comprehensive evaluations on large data batches • Supported iterative improvements for AI conversational systems

2024 - Present

AI Training Contributor

AppenTextClassification

During my time as an AI Training Contributor at Appen, I worked on long-term projects involving annotation and categorization of various datasets. Tasks included labeling and organizing text, audio, and image data to train machine learning models. I maintained high accuracy and adaptability across multiple, frequently updated projects. • Completed large-scale repetitive dataset labeling • Followed evolving guidelines and quality requirements • Contributed to search relevance and AI model performance • Demonstrated reliability over a sustained period

During my time as an AI Training Contributor at Appen, I worked on long-term projects involving annotation and categorization of various datasets. Tasks included labeling and organizing text, audio, and image data to train machine learning models. I maintained high accuracy and adaptability across multiple, frequently updated projects. • Completed large-scale repetitive dataset labeling • Followed evolving guidelines and quality requirements • Contributed to search relevance and AI model performance • Demonstrated reliability over a sustained period

2014 - 2023

Education

Work History