For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
S

Samantha Shepardson

AI Training Specialist (Freelance) | LLM Evaluator | QA & Rubric Development

USA flagBoca Raton, Usa
$30.00/hrExpertOtherData Annotation TechRemotasks

Key Skills

Software

Other
Data Annotation TechData Annotation Tech
RemotasksRemotasks

Top Subject Matter

Large Language Model Evaluation and AI Training
Writing / Editing / Proofreading
Customer Service / Hospitality

Top Data Types

TextText
ImageImage
DocumentDocument

Top Task Types

Text Generation
Classification
Object Detection
Question Answering
Text Summarization
Fine Tuning
Transcription
Evaluation Rating
Data Collection
Prompt Response Writing SFT

Freelancer Overview

I have over 4 years of experience in AI training and data annotation, with a strong focus on advanced evaluation tasks including rubric development, instruction-following analysis, and long-form content review. My work involves evaluating AI-generated responses for accuracy, reasoning, tone, and adherence to detailed guidelines, often across complex, multi-step tasks. I regularly complete high-complexity projects that require sustained analytical focus (4–8+ hours per deliverable), and I have experience refining evaluation rubrics, identifying reasoning errors and hallucinations, and improving overall model performance through structured feedback. I am particularly skilled in judgment-based evaluation, consistency across evolving guidelines, and quality assurance for AI outputs.

ExpertEnglishSpanish

Labeling Experience

AI Training & Data Annotation Specialist (Freelance)

OtherText
I evaluated and annotated AI-generated text responses for accuracy, reasoning, tone, and adherence to instructions. I ranked and compared multiple large language model outputs using detailed rubrics and evolving frameworks. I performed structured data annotation, categorization, and quality scoring across diverse project types for AI applications. • Identified hallucinations and inconsistencies in model reasoning. • Developed and refined evaluation rubrics and quality standards. • Edited and improved long-form deliverables to align with strict evaluation metrics. • Provided structured feedback to enhance model performance and consistency.

I evaluated and annotated AI-generated text responses for accuracy, reasoning, tone, and adherence to instructions. I ranked and compared multiple large language model outputs using detailed rubrics and evolving frameworks. I performed structured data annotation, categorization, and quality scoring across diverse project types for AI applications. • Identified hallucinations and inconsistencies in model reasoning. • Developed and refined evaluation rubrics and quality standards. • Edited and improved long-form deliverables to align with strict evaluation metrics. • Provided structured feedback to enhance model performance and consistency.

2021 - Present

Education

F

Florida International University

Bachelor of Arts, Psychology

Bachelor of Arts
2010 - 2014

Work History

T

The Boca Raton

Restaurant Manager

Boca Raton
2023 - Present
V

Various

Administrative & Operations Support

N/A
Not specified