Precious Agi

Key Skills

Software

Appen

Telus

Other

Top Subject Matter

LLM Evaluation and RLHF Data Creation

Audio Data Annotation and AI Speech Support

LLM Annotation and QA Leadership

Top Data Types

Text

Audio

Video

Document

Top Task Types

Classification

Freelancer Overview

Senior AI Trainer / LLM Specialist. Brings 12+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Appen, Telus, and Other. Education includes Master of Science, Virginia State University and Bachelor of Science, Virginia State University. AI-training focus includes data types such as Text and Audio and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

Senior AI Trainer / LLM Specialist

AppenText

As a Senior AI Trainer across multiple vendors, I evaluated and ranked large language model (LLM) outputs for reasoning, accuracy, clarity, and instruction-following. I created structured datasets and examples for RLHF-style and model improvement workflows. I designed prompts, rubrics, and evaluation criteria to enhance AI response quality. • Worked across text, audio, video, and localization-based data annotation tasks • Reviewed outputs for hallucinations, safety issues, bias, and quality failures • Adapted to diverse project guidelines on remote AI annotation platforms • Supported Cohere, AI21, Amazon, and Meta-related annotation initiatives

As a Senior AI Trainer across multiple vendors, I evaluated and ranked large language model (LLM) outputs for reasoning, accuracy, clarity, and instruction-following. I created structured datasets and examples for RLHF-style and model improvement workflows. I designed prompts, rubrics, and evaluation criteria to enhance AI response quality. • Worked across text, audio, video, and localization-based data annotation tasks • Reviewed outputs for hallucinations, safety issues, bias, and quality failures • Adapted to diverse project guidelines on remote AI annotation platforms • Supported Cohere, AI21, Amazon, and Meta-related annotation initiatives

2023 - Present

AI Trainer / Data Annotation Lead

OtherText

While working with Sigma AI, Spark AI, and Kriss.ai, I performed data annotation, advanced AI contribution, and led annotation projects. My primary focus was on LLM text evaluation, response ranking, and QA of labeled datasets. I coordinated quality review processes and communicated with distributed teams in annotation workflows. • Implemented quality assurance and error checking for annotation tasks • Led Kriss.ai's data annotation team, overseeing project milestones • Collaborated on open-source and vendor-led LLM advancements • Provided annotation leadership in both English and multilingual contexts

While working with Sigma AI, Spark AI, and Kriss.ai, I performed data annotation, advanced AI contribution, and led annotation projects. My primary focus was on LLM text evaluation, response ranking, and QA of labeled datasets. I coordinated quality review processes and communicated with distributed teams in annotation workflows. • Implemented quality assurance and error checking for annotation tasks • Led Kriss.ai's data annotation team, overseeing project milestones • Collaborated on open-source and vendor-led LLM advancements • Provided annotation leadership in both English and multilingual contexts

2024 - 2024

Audio Data Annotation Contributor

TelusAudioClassification

At TELUS Digital, I contributed to audio data annotation projects focused on maximizing AI understanding of spoken content. I accurately classified and labeled diverse speech data according to project guidelines. I adhered strictly to annotation quality and consistency standards throughout my engagement. • Utilized project-specific annotation protocols for audio labeling • Ensured multilingual and dialectal consistency in audio data • Followed guideline updates and feedback for continuous improvement • Supported Amazon-related initiatives via Argos Multilingual

At TELUS Digital, I contributed to audio data annotation projects focused on maximizing AI understanding of spoken content. I accurately classified and labeled diverse speech data according to project guidelines. I adhered strictly to annotation quality and consistency standards throughout my engagement. • Utilized project-specific annotation protocols for audio labeling • Ensured multilingual and dialectal consistency in audio data • Followed guideline updates and feedback for continuous improvement • Supported Amazon-related initiatives via Argos Multilingual

2024 - 2024

Education

Work History