Ayush Gupta

Key Skills

Software

Labelbox

Data Annotation Tech

Micro1

Mercor

Scale AI

Internal/Proprietary Tooling

Top Subject Matter

AI model output evaluation

audio transcription

text content

Top Data Types

Text

Image

Document

Top Task Types

Prompt Response Writing SFT

Evaluation Rating

Question Answering

Classification

Transcription

Red Teaming

Computer Programming Coding

Freelancer Overview

I am a detail oriented AI training and data labeling specialist with hands-on experience of 2 years in evaluating, annotating, and validating datasets across text and user generated content. I have worked extensively on tasks such as response ranking, sentiment classification, metadata tagging, and transcription verification, ensuring high accuracy and strict adherence to annotation guidelines. My experience includes identifying edge cases, maintaining dataset consistency, and performing quality assurance checks to improve overall model performance. I am highly proficient in handling repetitive, detail-heavy tasks while maintaining precision and efficiency under defined standards. Beyond annotation, I bring strong expertise in prompt engineering and AI evaluation. I have designed highly detailed prompts for complex tasks, covering every aspect of input structure, expected outputs, and edge case handling to improve model responses. Additionally, I have conducted comparative analysis between different AI models, evaluating outputs based on accuracy, relevance, coherence, and safety. My background also includes moderating large scale communities and classifying content for compliance, along with analytical experience from Web3 and data-driven projects. This combination of technical understanding, structured thinking, and deep attention to detail allows me to contribute effectively to AI training pipelines, dataset refinement, and model optimization workflows.

Labeling Experience

AI Training & Data Annotation Specialist (Freelance - Outlier)

LabelboxTextEvaluation Rating

As an AI Training and Data Annotation Specialist (Freelance - Outlier), I evaluated and labeled AI model outputs and performed data validation and quality assurance. I designed detailed prompts and defined task specifications, reviewed AI-generated vocal content, and verified transcriptions. I regularly solved and generated complex evaluation rubrics for text and audio data labeling tasks. • Labeled AI model outputs and refined responses for model improvement. • Performed rigorous QA checks and ensured dataset integrity. • Reviewed audio transcriptions and provided corrections/annotations. • Designed rubrics and prompt guidelines for diverse labeling tasks.

As an AI Training and Data Annotation Specialist (Freelance - Outlier), I evaluated and labeled AI model outputs and performed data validation and quality assurance. I designed detailed prompts and defined task specifications, reviewed AI-generated vocal content, and verified transcriptions. I regularly solved and generated complex evaluation rubrics for text and audio data labeling tasks. • Labeled AI model outputs and refined responses for model improvement. • Performed rigorous QA checks and ensured dataset integrity. • Reviewed audio transcriptions and provided corrections/annotations. • Designed rubrics and prompt guidelines for diverse labeling tasks.

2024 - Present

Education

Work History