Nikhil Raj

Key Skills

Software

Scale AI

Top Subject Matter

Llms Domain Expertise

AI-generated text

code evaluation

Top Data Types

Text

Document

Top Task Types

RLHF

Freelancer Overview

AI Trainer / Data Annotator. Core strengths include Scale AI and Welo Data. Education includes Bachelor's Degree, N/A (2024). AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

AI Data Evaluator

Text

As an AI Data Evaluator at Welo Data, I evaluated Google Maps AI (Ask Maps) personalization using SxS methodology. My core responsibilities included structured reporting, guideline compliance, and maintaining accuracy across task cycles. I ensured high-quality assessment and documentation within strict deadlines and privacy protocols. • Conducted side-by-side response evaluation of AI map recommendations. • Scored map personalization, captured edge cases, and annotated screenshots. • Completed 20-task review cycles within 8 hours maintaining accuracy. • Submitted structured feedback reports and followed data privacy standards.

As an AI Data Evaluator at Welo Data, I evaluated Google Maps AI (Ask Maps) personalization using SxS methodology. My core responsibilities included structured reporting, guideline compliance, and maintaining accuracy across task cycles. I ensured high-quality assessment and documentation within strict deadlines and privacy protocols. • Conducted side-by-side response evaluation of AI map recommendations. • Scored map personalization, captured edge cases, and annotated screenshots. • Completed 20-task review cycles within 8 hours maintaining accuracy. • Submitted structured feedback reports and followed data privacy standards.

2024 - Present

AI Trainer / Data Annotator

Scale AITextRLHF

As an AI Trainer and Data Annotator at Scale AI, I evaluated and ranked AI-generated responses to improve LLM quality and safety. My work involved crafting prompts, conducting side-by-side response comparisons, annotating outputs, and maintaining high inter-annotator agreement across 100+ tasks per week. I focused on tasks spanning general knowledge, reasoning, math, creative writing, and instruction following. • Evaluated LLM responses using RLHF for quality, accuracy, and safety. • Authored and tested prompts for diverse language model tasks. • Performed detailed annotation on output correctness, tone, and harmful content. • Assessed code generation outputs for correctness and best practices.

As an AI Trainer and Data Annotator at Scale AI, I evaluated and ranked AI-generated responses to improve LLM quality and safety. My work involved crafting prompts, conducting side-by-side response comparisons, annotating outputs, and maintaining high inter-annotator agreement across 100+ tasks per week. I focused on tasks spanning general knowledge, reasoning, math, creative writing, and instruction following. • Evaluated LLM responses using RLHF for quality, accuracy, and safety. • Authored and tested prompts for diverse language model tasks. • Performed detailed annotation on output correctness, tone, and harmful content. • Assessed code generation outputs for correctness and best practices.

2024 - Present

Education

Work History