Paige Reece

Key Skills

Software

Img Lab

Appen

iMerit

Top Subject Matter

No subject matter listed

Top Data Types

Image

Text

Top Label Types

RLHF

Evaluation Rating

Freelancer Overview

I am an experienced data annotation and AI training data specialist with over 7 years in reviewing, labeling, and quality assurance for multimodal datasets, including text, audio, and image data. My work spans RLHF evaluation for large language models, NLP, computer vision, and speech recognition projects, supporting Fortune 500 clients and high-compliance sectors such as healthcare and autonomous vehicles. I have led annotation teams, authored guidelines, and maintained 96–99% accuracy across 300,000+ reviews, with expertise in Epic Systems, Cerner, and multilingual data (EN-US, EN-UK, ES, FR, DE). My dual degrees in Artificial Intelligence and Computer Science, along with certifications in data evaluation and EHR platforms, enable me to deliver precise, actionable feedback and drive continuous improvements in data quality and model performance. I am passionate about advancing AI through high-quality, ethical, and privacy-compliant data annotation.

Labeling Experience

Annotation Reviewer - AI Training Data Quality Specialist

Img LabImageRLHF

As an Annotation Reviewer at Outlier AI, I conducted RLHF evaluations for large-scale commercial, domain-specific, and multimodal LLMs. I ranked and reviewed AI outputs for accuracy, safety, helpfulness, and instruction adherence, documenting error patterns and edge cases to inform model improvement. I mentored new reviewers and assessed thousands of AI responses to drive quality and model utility improvements. • Evaluated model responses for hallucinations, bias, toxicity, and guideline adherence • Documented temporal reasoning and other error patterns impacting accuracy • Supported guideline refinement and model retraining through curated feedback • Enhanced team consistency and onboarding efficiency by mentoring junior reviewers

As an Annotation Reviewer at Outlier AI, I conducted RLHF evaluations for large-scale commercial, domain-specific, and multimodal LLMs. I ranked and reviewed AI outputs for accuracy, safety, helpfulness, and instruction adherence, documenting error patterns and edge cases to inform model improvement. I mentored new reviewers and assessed thousands of AI responses to drive quality and model utility improvements. • Evaluated model responses for hallucinations, bias, toxicity, and guideline adherence • Documented temporal reasoning and other error patterns impacting accuracy • Supported guideline refinement and model retraining through curated feedback • Enhanced team consistency and onboarding efficiency by mentoring junior reviewers

2024

Senior Reviewer / Annotator - AI Training Data Specialist

AppenTextEvaluation Rating

As a Senior Reviewer and Annotator at RWS Group, I led quality reviews of annotated datasets for speech recognition, image classification, and NLP projects. I evaluated annotators' work for accuracy and provided feedback to ensure high-quality labels across enterprise AI projects. I authored guidelines and managed calibration sessions to maintain accuracy standards. • Reviewed and validated annotations for speech, image, and NLP tasks • Conducted calibration sessions and monitored accuracy metrics • Authored guidelines, checklists, and feedback documentation • Reduced review time and error rates by streamlining processes

As a Senior Reviewer and Annotator at RWS Group, I led quality reviews of annotated datasets for speech recognition, image classification, and NLP projects. I evaluated annotators' work for accuracy and provided feedback to ensure high-quality labels across enterprise AI projects. I authored guidelines and managed calibration sessions to maintain accuracy standards. • Reviewed and validated annotations for speech, image, and NLP tasks • Conducted calibration sessions and monitored accuracy metrics • Authored guidelines, checklists, and feedback documentation • Reduced review time and error rates by streamlining processes

2021

Senior Annotation Reviewer - AI Data Quality Specialist

ImeritTextEvaluation Rating

As a Senior Annotation Reviewer at iMerit Technology, I investigated diverse datasets for clients in NLP, speech recognition, and computer vision domains. I provided RLHF evaluations for LLMs, identified safety violations, and engineered training modules to improve annotation accuracy and onboarding speed. I maintained a high QA score across global AI projects and validated large volumes of annotations. • Managed safety and compliance of annotations across domains • Engineered training and feedback systems for annotators • Conducted RLHF evaluations on multilingual datasets • Supported Fortune 500 client projects with high compliance demands

As a Senior Annotation Reviewer at iMerit Technology, I investigated diverse datasets for clients in NLP, speech recognition, and computer vision domains. I provided RLHF evaluations for LLMs, identified safety violations, and engineered training modules to improve annotation accuracy and onboarding speed. I maintained a high QA score across global AI projects and validated large volumes of annotations. • Managed safety and compliance of annotations across domains • Engineered training and feedback systems for annotators • Conducted RLHF evaluations on multilingual datasets • Supported Fortune 500 client projects with high compliance demands

2019

Annotation Reviewer - AI Data Quality Specialist

AppenTextEvaluation Rating

As an Annotation Reviewer at Appen Limited, I reviewed text, image, and audio annotations for various AI models including voice assistants, search, and translation. I trained new annotators, contributed to guideline revisions, and helped increase labeling accuracy and clarity across projects. I managed high annotation volumes while maintaining stringent accuracy standards. • Reviewed high volumes of text, image, and audio annotations • Provided feedback and mentored new staff on best practices • Assisted in reducing onboarding time and increasing accuracy for new annotators • Enhanced guidelines to reduce confusion and error rates

As an Annotation Reviewer at Appen Limited, I reviewed text, image, and audio annotations for various AI models including voice assistants, search, and translation. I trained new annotators, contributed to guideline revisions, and helped increase labeling accuracy and clarity across projects. I managed high annotation volumes while maintaining stringent accuracy standards. • Reviewed high volumes of text, image, and audio annotations • Provided feedback and mentored new staff on best practices • Assisted in reducing onboarding time and increasing accuracy for new annotators • Enhanced guidelines to reduce confusion and error rates

2018 - 2022

Education

Work History