Andrew Watt

Key Skills

Software

Toloka

Appen

Top Subject Matter

Large Language Models

AI Response Evaluation

Search Engine Evaluation

Top Data Types

Text

Document

Top Task Types

RLHF

Freelancer Overview

AI Evaluator. Brings 8+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Toloka and Appen. Education includes Higher National Diploma, North Glasgow College. AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

AI Evaluator

TolokaTextRLHF

As an AI Evaluator at Toloka, I conducted high-volume data labeling and annotation tasks for the training of Large Language Models. My work included executing RLHF assignments, ranking model outputs for truthfulness, safety, and helpfulness. I maintained a consistently high Quality Score, adhering to strict accuracy benchmarks and project-specific guidelines. • Performed semantic analysis and content annotation across diverse topics. • Ensured adherence to rigorous labeling protocols for data quality. • Contributed directly to improvement of AI response accuracy. • Collaborated in remote, autonomous workflow settings.

As an AI Evaluator at Toloka, I conducted high-volume data labeling and annotation tasks for the training of Large Language Models. My work included executing RLHF assignments, ranking model outputs for truthfulness, safety, and helpfulness. I maintained a consistently high Quality Score, adhering to strict accuracy benchmarks and project-specific guidelines. • Performed semantic analysis and content annotation across diverse topics. • Ensured adherence to rigorous labeling protocols for data quality. • Contributed directly to improvement of AI response accuracy. • Collaborated in remote, autonomous workflow settings.

2026 - Present

Search Engine Evaluator

AppenText

As a Search Engine Evaluator at Appen, I evaluated the relevance and quality of search engine results and advertisements. Tasks included annotating complex datasets, performing social media content moderation, and providing feedback for algorithm improvement. I consistently met project deadlines while working independently in a remote environment. • Assessed query-result quality using detailed annotation criteria. • Performed ad relevance and map verification labeling tasks. • Contributed to social media content moderation initiatives. • Delivered evaluations impacting search relevance and user experience.

As a Search Engine Evaluator at Appen, I evaluated the relevance and quality of search engine results and advertisements. Tasks included annotating complex datasets, performing social media content moderation, and providing feedback for algorithm improvement. I consistently met project deadlines while working independently in a remote environment. • Assessed query-result quality using detailed annotation criteria. • Performed ad relevance and map verification labeling tasks. • Contributed to social media content moderation initiatives. • Delivered evaluations impacting search relevance and user experience.

2019 - Present

Education

Work History