For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
J
Joseph John

Joseph John

Freelance Data Annotation Specialist

India flagChennai, India
Intermediate

Key Skills

Software

No software listed

Top Subject Matter

Natural Language Processing
AI Model Training
LLM Evaluation

Top Data Types

TextText
DocumentDocument

Top Task Types

No task types listed

Freelancer Overview

Freelance Data Annotation Specialist. Brings 5+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal, Proprietary Tooling, and N. Education includes Bachelor of Engineering, St. Joseph's College of Engineering (2020). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Intermediate

Labeling Experience

Freelance Data Annotation Specialist

Text
As a Freelance Data Annotation Specialist at Innodata, I performed high-accuracy annotation and labeling of large-scale datasets used in LLM training and evaluation pipelines. I conducted instruction-following evaluation and pairwise preference ranking of AI-generated outputs, delivering structured human feedback to support RLHF model fine-tuning and alignment workflows. I validated and QA-reviewed annotated data against quality benchmarks and contributed to multiple concurrent projects.• Labeled and classified complex text datasets for natural language processing tasks • Performed preference ranking, safety flagging, and conversational flow labeling • Adapted rapidly to evolving annotation guidelines and rubric changes • Provided QA and feedback on annotated batches to maintain dataset integrity

As a Freelance Data Annotation Specialist at Innodata, I performed high-accuracy annotation and labeling of large-scale datasets used in LLM training and evaluation pipelines. I conducted instruction-following evaluation and pairwise preference ranking of AI-generated outputs, delivering structured human feedback to support RLHF model fine-tuning and alignment workflows. I validated and QA-reviewed annotated data against quality benchmarks and contributed to multiple concurrent projects.• Labeled and classified complex text datasets for natural language processing tasks • Performed preference ranking, safety flagging, and conversational flow labeling • Adapted rapidly to evolving annotation guidelines and rubric changes • Provided QA and feedback on annotated batches to maintain dataset integrity

2025 - Present

Content Associate — AI Data Services (AGI Division)

Text
As a Content Associate — AI Data Services (AGI Division) at Amazon India, I designed, annotated, and evaluated prompt variants for LLM training pipelines using few-shot and zero-shot techniques. I conducted AI safety reviews, human-AI alignment evaluations, and model response scoring across instruction tuning workflows. I contributed to the development of annotation guidelines and collaborated on structured human feedback mechanisms affecting RLHF and SFT data pipelines.• Created, tested, and annotated diverse prompt-response pairs for LLM training • Evaluated and rated AI-generated outputs for safety, tone, factual correctness, and coherence • Developed annotation guidelines to standardize quality and feedback • Worked with engineers and researchers to align annotation flows with product and safety requirements

As a Content Associate — AI Data Services (AGI Division) at Amazon India, I designed, annotated, and evaluated prompt variants for LLM training pipelines using few-shot and zero-shot techniques. I conducted AI safety reviews, human-AI alignment evaluations, and model response scoring across instruction tuning workflows. I contributed to the development of annotation guidelines and collaborated on structured human feedback mechanisms affecting RLHF and SFT data pipelines.• Created, tested, and annotated diverse prompt-response pairs for LLM training • Evaluated and rated AI-generated outputs for safety, tone, factual correctness, and coherence • Developed annotation guidelines to standardize quality and feedback • Worked with engineers and researchers to align annotation flows with product and safety requirements

2024 - 2025

Independent Researcher — LLM Annotation and Evaluation

Text
During a career break focused on independent research and skill development, I upskilled in LLM evaluation methodologies, annotation rubric design, and RLHF best practices. I developed expertise in narrative evaluation and content quality assessment for conversational AI. My primary focus was learning modern annotation strategies and evaluation standards ahead of advanced AI data roles.• Researched and practiced rubric calibration for LLM training • Studied best practices in RLHF and model alignment evaluation • Conducted hands-on annotation exercises for skill enhancement • Enhanced quality review skills for AI content and dialogue outputs

During a career break focused on independent research and skill development, I upskilled in LLM evaluation methodologies, annotation rubric design, and RLHF best practices. I developed expertise in narrative evaluation and content quality assessment for conversational AI. My primary focus was learning modern annotation strategies and evaluation standards ahead of advanced AI data roles.• Researched and practiced rubric calibration for LLM training • Studied best practices in RLHF and model alignment evaluation • Conducted hands-on annotation exercises for skill enhancement • Enhanced quality review skills for AI content and dialogue outputs

2024 - 2024

Education

S

St. Joseph's College of Engineering

Bachelor of Engineering, Computer Science and Engineering

Bachelor of Engineering
2020 - 2020

Work History

M

McKinsey & Company

Business Presentation Specialist

Chennai
2022 - 2024
S

S10 Healthcare Solutions

Content Strategist

Chennai
2022 - 2022