Price Layota

Key Skills

Software

CVAT

Labelbox

Scale AI

Top Subject Matter

No subject matter listed

Top Data Types

Image

Text

Video

Top Label Types

Question Answering

Text Generation

RLHF

Evaluation Rating

Freelancer Overview

I am an experienced AI trainer and data annotation specialist with a strong background in evaluating large language models and preparing high-quality training datasets. My work spans text, image, audio, and video annotation, including tasks such as sentiment analysis, intent tagging, named entity recognition, and content moderation for AI safety. I have a proven track record of maintaining 97%+ quality accuracy in model evaluation and dataset labeling, and I am proficient with tools like Labelbox, CVAT, Label Studio, and Prodigy. My experience includes reinforcement learning from human feedback (RLHF), dataset quality auditing, and developing evaluation frameworks for LLMs. With a B.S. in Computer Science focused on machine learning and NLP, I bring both technical expertise and hands-on experience to every project, ensuring reliable and accurate AI training data.

Labeling Experience

Senior LLM Evaluation & RLHF Data Labeling Project

Scale AITextQuestion AnsweringText Generation

Worked as a Senior AI Trainer & Model Evaluator supporting large language model (LLM) fine-tuning and alignment initiatives. Evaluated AI-generated responses for reasoning quality, factual accuracy, hallucination detection, and safety compliance. Performed comparative ranking of multiple model outputs as part of Reinforcement Learning from Human Feedback (RLHF) workflows. Applied strict annotation rubrics to ensure consistent scoring across large batches of text data. Identified recurring model weaknesses, documented error trends, and flagged policy-sensitive outputs. Maintained a 97%+ average quality score while adhering to detailed evaluation guidelines and QA standards. Contributed directly to improving dataset reliability and enhancing model alignment and performance.

Worked as a Senior AI Trainer & Model Evaluator supporting large language model (LLM) fine-tuning and alignment initiatives. Evaluated AI-generated responses for reasoning quality, factual accuracy, hallucination detection, and safety compliance. Performed comparative ranking of multiple model outputs as part of Reinforcement Learning from Human Feedback (RLHF) workflows. Applied strict annotation rubrics to ensure consistent scoring across large batches of text data. Identified recurring model weaknesses, documented error trends, and flagged policy-sensitive outputs. Maintained a 97%+ average quality score while adhering to detailed evaluation guidelines and QA standards. Contributed directly to improving dataset reliability and enhancing model alignment and performance.

2024

Education

Work History