Key Skills

Software

Other

Toloka

Top Subject Matter

Language Model Alignment

AI Safety

Software Engineering

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Classification

Object Detection

Prompt + Response Writing (SFT)

Freelancer Overview

AI Data Annotation Specialist. Brings 3+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Other and Toloka. AI-training focus includes data types such as Text and Image and labeling workflows including RLHF, Classification, and Object Detection.

Labeling Experience

AI Data Annotation Specialist

OtherTextRLHF

As an AI Data Annotation Specialist, I performed expert-level RLHF data annotation for frontier language models. I created and evaluated high-quality prompts, response comparisons, and detailed critiques to guide model alignment. I collaborated with leads to refine annotation guidelines and improve team calibration for ambiguous annotation cases. • Conducted red-teaming and adversarial evaluation to identify and document model weaknesses. • Wrote and reviewed SFT training examples across domains such as software engineering and legal reasoning. • Evaluated RAG pipeline outputs for factual grounding and relevance, providing structured feedback. • Enhanced inter-annotator agreement and annotation workflow quality for safety and alignment research.

As an AI Data Annotation Specialist, I performed expert-level RLHF data annotation for frontier language models. I created and evaluated high-quality prompts, response comparisons, and detailed critiques to guide model alignment. I collaborated with leads to refine annotation guidelines and improve team calibration for ambiguous annotation cases. • Conducted red-teaming and adversarial evaluation to identify and document model weaknesses. • Wrote and reviewed SFT training examples across domains such as software engineering and legal reasoning. • Evaluated RAG pipeline outputs for factual grounding and relevance, providing structured feedback. • Enhanced inter-annotator agreement and annotation workflow quality for safety and alignment research.

2025 - 2025

Data Annotation Lead (Contract)

TolokaTextClassification

As a Data Annotation Lead at Toloka, I led a distributed team on multilingual NLP tasks including entity recognition and question answering. I designed annotation guidelines, conducted workflow audits, and specialized in multimodal annotation tasks involving text, image, audio, and video. My leadership focused on maintaining high volume and quality standards across diverse data labeling projects. • Oversaw monthly delivery of 50,000+ labeled data points, consistently surpassing quality targets. • Executed quality audits and provided actionable feedback to improve team performance. • Onboarded and trained new annotators, streamlining the calibration process and reducing ramp-up time. • Worked on labeling image-text pairs, audio transcription, and video segment classification for AI model training.

As a Data Annotation Lead at Toloka, I led a distributed team on multilingual NLP tasks including entity recognition and question answering. I designed annotation guidelines, conducted workflow audits, and specialized in multimodal annotation tasks involving text, image, audio, and video. My leadership focused on maintaining high volume and quality standards across diverse data labeling projects. • Oversaw monthly delivery of 50,000+ labeled data points, consistently surpassing quality targets. • Executed quality audits and provided actionable feedback to improve team performance. • Onboarded and trained new annotators, streamlining the calibration process and reducing ramp-up time. • Worked on labeling image-text pairs, audio transcription, and video segment classification for AI model training.

2024 - 2024

Freelance AI Data Annotator

OtherImageObject Detection

As a Freelance AI Data Annotator, I contributed to computer vision dataset development for medical imaging and autonomous driving. My tasks included object detection, image segmentation, bounding box, and keypoint annotation. I also performed structured data extraction from documents and evaluated visual grounding tasks. • Provided feedback on model-generated UI/UX outputs to improve multimodal AI training. • Participated in calibration sessions and addressed edge cases in annotation guidelines. • Performed document and form data extraction annotation for document intelligence models. • Helped improve accuracy and consistency across a broad pool of annotators.

As a Freelance AI Data Annotator, I contributed to computer vision dataset development for medical imaging and autonomous driving. My tasks included object detection, image segmentation, bounding box, and keypoint annotation. I also performed structured data extraction from documents and evaluated visual grounding tasks. • Provided feedback on model-generated UI/UX outputs to improve multimodal AI training. • Participated in calibration sessions and addressed edge cases in annotation guidelines. • Performed document and form data extraction annotation for document intelligence models. • Helped improve accuracy and consistency across a broad pool of annotators.

2023 - 2024

Prompt Engineer & RLHF Annotator (Contract)

OtherTextPrompt Response Writing SFT

As a Prompt Engineer & RLHF Annotator, I engineered creative and technically rigorous prompts for SFT datasets across instruction following, code generation, summarization, and dialogue tasks. I ranked and compared model responses to generate preference data for RLHF pipelines. I collaborated with ML researchers to design prompts that elicit model failure modes for safety evaluation and authored rationale documents for interpretability research. • Produced annotated datasets for conversational AI, including multi-turn and persona-consistent dialogue. • Authored detailed annotation rationale documents for model interpretability studies. • Collaborated on refining guideline clarity for annotation workflows. • Generated high-quality data for training and evaluating AI conversational systems.

As a Prompt Engineer & RLHF Annotator, I engineered creative and technically rigorous prompts for SFT datasets across instruction following, code generation, summarization, and dialogue tasks. I ranked and compared model responses to generate preference data for RLHF pipelines. I collaborated with ML researchers to design prompts that elicit model failure modes for safety evaluation and authored rationale documents for interpretability research. • Produced annotated datasets for conversational AI, including multi-turn and persona-consistent dialogue. • Authored detailed annotation rationale documents for model interpretability studies. • Collaborated on refining guideline clarity for annotation workflows. • Generated high-quality data for training and evaluating AI conversational systems.

2023 - 2023

Education

Work History