For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
C
Courtney Holmes

Courtney Holmes

Data Annotation Tech / Independent Data Consultant

USA flagLa Mesa, Usa
$55.00/hrEntry LevelData Annotation Tech

Key Skills

Software

Data Annotation TechData Annotation Tech

Top Subject Matter

Large Language Models (LLMs)
Creative Writing
Logical Reasoning

Top Data Types

TextText
DocumentDocument

Top Task Types

RLHFRLHF

Freelancer Overview

Data Annotation Tech / Independent Data Consultant. Brings 15+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Data Annotation Tech. Education includes Master of Library Science, San Jose State University (2021) and Master of Science in School Psychology, National University (2013). AI-training focus includes data types such as Text and labeling workflows including RLHF.

Entry LevelEnglish

Labeling Experience

Data Annotation Tech

Data Annotation Tech / Independent Data Consultant

Data Annotation TechTextRLHF
Contributed to the development of Large Language Models (LLMs) by performing advanced RLHF and adversarial prompting. Evaluated complex model outputs for accuracy, logic, and stylistic adherence. Authored high-quality reference data to train models in creative writing, logical reasoning, and STEM-based problem-solving. • Created and rated AI generated outputs for factual correctness. • Wrote prompt-response pairs for AI supervised fine-tuning. • Engaged in adversarial evaluation of AI output robustness. • Provided domain expertise in areas such as educational psychology and creative writing. • Reviewed other worker's contributions on multiple project families to make sure they met Golden Standard submission quality • Tested personalization components of LLM's and ranked them according to rubric instructions

Contributed to the development of Large Language Models (LLMs) by performing advanced RLHF and adversarial prompting. Evaluated complex model outputs for accuracy, logic, and stylistic adherence. Authored high-quality reference data to train models in creative writing, logical reasoning, and STEM-based problem-solving. • Created and rated AI generated outputs for factual correctness. • Wrote prompt-response pairs for AI supervised fine-tuning. • Engaged in adversarial evaluation of AI output robustness. • Provided domain expertise in areas such as educational psychology and creative writing. • Reviewed other worker's contributions on multiple project families to make sure they met Golden Standard submission quality • Tested personalization components of LLM's and ranked them according to rubric instructions

2025 - Present

Education

S

San Jose State University

Master of Library Science, Library Science

Master of Library Science
2020 - 2021
N

National University

Master of Science in School Psychology, School Psychology

Master of Science in School Psychology
2011 - 2013

Work History

S

San Diego Unified School District

School Psychologist

San Diego
2019 - 2021
V

Valley Center Pauma Unified School District

School Psychologist

Valley Center
2018 - 2018