Karan Pandya

Key Skills

Software

Mercor

Data Annotation Tech

Other

Top Subject Matter

Large Language Model Training

AI Training and Evaluation

Rubric Compliance

Top Data Types

Text

Image

Top Task Types

Prompt + Response Writing (SFT)

Classification

Freelancer Overview

Generalist Data Evaluator. Brings 2+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Mercor, Data Annotation Tech, and Other. Education includes Bachelor of Arts, Vassar College (2024). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Prompt + Response Writing (SFT).

Labeling Experience

Generalist Data Evaluator

MercorText

As a Generalist Data Evaluator at Mercor, I adhered to strict data creation guidelines to generate content suitable for LLM training. I initially created data and was promoted to a reviewer position due to impressive data quality. I supported writers in refining their data to ensure compliance with project standards. • Ensured compliance with rigorous LLM data requirements. • Promoted based on consistent data quality and review performance. • Provided one-on-one support to junior writers for improvement. • Enhanced overall quality and consistency of LLM training data.

As a Generalist Data Evaluator at Mercor, I adhered to strict data creation guidelines to generate content suitable for LLM training. I initially created data and was promoted to a reviewer position due to impressive data quality. I supported writers in refining their data to ensure compliance with project standards. • Ensured compliance with rigorous LLM data requirements. • Promoted based on consistent data quality and review performance. • Provided one-on-one support to junior writers for improvement. • Enhanced overall quality and consistency of LLM training data.

2025 - 2026

Data Annotator

Data Annotation TechTextPrompt Response Writing SFT

As a Data Annotator for Data Annotation Tech, I designed and evaluated prompts critical for classification, reasoning, and generation tasks in LLM training. I labeled and validated datasets spanning text, images, and code to enhance model accuracy. I contributed to annotation guideline development and quality assurance processes. • Crafted, evaluated, and refined prompts for diverse AI tasks. • Labeled multimodal data to support robust model development. • Participated in quality assurance and guideline creation. • Enhanced data labeling practices for project deliverables.

As a Data Annotator for Data Annotation Tech, I designed and evaluated prompts critical for classification, reasoning, and generation tasks in LLM training. I labeled and validated datasets spanning text, images, and code to enhance model accuracy. I contributed to annotation guideline development and quality assurance processes. • Crafted, evaluated, and refined prompts for diverse AI tasks. • Labeled multimodal data to support robust model development. • Participated in quality assurance and guideline creation. • Enhanced data labeling practices for project deliverables.

2024 - 2025

Education

Work History