Theresa Simeon

Key Skills

Software

Appen

Mindrift

Scale AI

Top Subject Matter

No subject matter listed

Top Data Types

Audio

Document

Image

Text

Video

Top Label Types

Data Collection

Emotion Recognition

Evaluation Rating

Fine Tuning

Object Detection

Text Generation

Text Summarization

Transcription

Freelancer Overview

I am an experienced data annotation and AI training data specialist with a strong background in reviewing and evaluating video, multimedia, and AI-generated content. My roles at Scale AI, Appen, and Mindrift have equipped me with expertise in visual data assessment, structured guideline application, and quality assurance for large-scale datasets. I excel at providing actionable feedback to improve AI model accuracy and consistently meet productivity targets in remote, high-volume environments. Proficient in tools like Google Sheets and digital content platforms, I am highly detail-oriented and skilled at maintaining data integrity, clarity, and relevance. My education in English and Communication, combined with certifications in Python programming and data analytics, further strengthens my ability to ensure high-quality data preparation for AI and machine learning projects.

Labeling Experience

AI Trainer /LLM QualityRater (Contract)

MindriftTextEvaluation Rating

Serving as an AI Trainer/LLM Quality Rater for the OpenAI Vendor Program, I evaluated and annotated AI-generated responses for compliance and accuracy. I consistently applied structured evaluation frameworks to various text-based tasks in asynchronous workflows. The position required high attention to detail amidst evolving guidelines for model training. • Conducted policy compliance, tone, and accuracy checks on diverse AI outputs. • Maintained high evaluation volume with adherence to set accuracy standards. • Used prompt-based tasks for supervised preference modeling. • Delivered structured annotations in support of alignment objectives.

Serving as an AI Trainer/LLM Quality Rater for the OpenAI Vendor Program, I evaluated and annotated AI-generated responses for compliance and accuracy. I consistently applied structured evaluation frameworks to various text-based tasks in asynchronous workflows. The position required high attention to detail amidst evolving guidelines for model training. • Conducted policy compliance, tone, and accuracy checks on diverse AI outputs. • Maintained high evaluation volume with adherence to set accuracy standards. • Used prompt-based tasks for supervised preference modeling. • Delivered structured annotations in support of alignment objectives.

2024

Data Annotator Expert (Contract)

AppenTextEvaluation Rating

As a Data Annotator Expert at Mindrift, I evaluated and ranked LLM responses for various parameters including reasoning, factual accuracy, and safety. My work involved prompt analysis and comparison of AI-generated responses to support supervised fine-tuning. I played a key role in identifying errors and bias, which improved overall model performance. • Assessed alignment, linguistic quality, and instruction adherence of conversational AI outputs. • Utilized detailed rubrics to score and provide feedback on AI responses. • Applied flags for logical inconsistencies, hallucinations, and guideline breaches. • Supported QA acceptance rates and model alignment processes.

As a Data Annotator Expert at Mindrift, I evaluated and ranked LLM responses for various parameters including reasoning, factual accuracy, and safety. My work involved prompt analysis and comparison of AI-generated responses to support supervised fine-tuning. I played a key role in identifying errors and bias, which improved overall model performance. • Assessed alignment, linguistic quality, and instruction adherence of conversational AI outputs. • Utilized detailed rubrics to score and provide feedback on AI responses. • Applied flags for logical inconsistencies, hallucinations, and guideline breaches. • Supported QA acceptance rates and model alignment processes.

2024 - 2025

AI Content Evaluator (Freelance)

Scale AITextEvaluation Rating

In my role as AI Content Evaluator at Outlier AI, I performed fine-grained linguistic and semantic analysis of model outputs. Responsibilities included highlighting grammar errors, detecting weak reasoning, and identifying ambiguous or mismatched context. I ensured output quality by rapidly adapting to new tasks and rubric changes. • Delivered high-volume evaluation of AI-generated text outputs. • Applied evolving task instructions with consistency and attention to detail. • Flagged contextual mismatches and linguistic inaccuracies. • Supported model improvement initiatives through structured feedback.

In my role as AI Content Evaluator at Outlier AI, I performed fine-grained linguistic and semantic analysis of model outputs. Responsibilities included highlighting grammar errors, detecting weak reasoning, and identifying ambiguous or mismatched context. I ensured output quality by rapidly adapting to new tasks and rubric changes. • Delivered high-volume evaluation of AI-generated text outputs. • Applied evolving task instructions with consistency and attention to detail. • Flagged contextual mismatches and linguistic inaccuracies. • Supported model improvement initiatives through structured feedback.

2023 - 2025

Education

Work History