Naveen Singh

Key Skills

Software

Dataloop

Labelbox

Lionbridge

SuperAnnotate

V7 Labs

Top Subject Matter

LLM Outputs

AI Alignment

Content Moderation

Top Data Types

Image

Text

Video

Document

Top Task Types

Bounding Box

Classification

Diagnosis

Translation/Localization

Point/Key Point

RLHF

Prompt + Response Writing (SFT)

Freelancer Overview

AI/LLM Analyst — Senior Annotation Analyst. Brings 5+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Internal, Proprietary Tooling, and Labelbox. Education includes Bachelor of Business Administration, Maharishi Dayanand University and High School Diploma, Central Board of Secondary Education. AI-training focus includes data types such as Text, Image, and Video and labeling workflows including RLHF, Classification, and Prompt + Response Writing (SFT).

Labeling Experience

AI/LLM Analyst — Senior Annotation Analyst

VideoClassification

I was responsible for detailed video annotation and moderation to support computer vision and safety systems. My duties included reviewing and categorizing video segments for model training and content safety compliance. I maintained throughput while ensuring all flagged sensitive content was escalated appropriately. • Performed accurate video labeling to enable AI model development • Escalated CSAM and other policy-violating materials • Authored internal documentation standardizing video annotation procedures • Maintained accuracy rates above 97% in all video moderation projects

I was responsible for detailed video annotation and moderation to support computer vision and safety systems. My duties included reviewing and categorizing video segments for model training and content safety compliance. I maintained throughput while ensuring all flagged sensitive content was escalated appropriately. • Performed accurate video labeling to enable AI model development • Escalated CSAM and other policy-violating materials • Authored internal documentation standardizing video annotation procedures • Maintained accuracy rates above 97% in all video moderation projects

2026 - Present

AI/LLM Analyst — Senior Annotation Analyst

ImageClassification

In this role, I conducted image annotation projects used for training computer vision models and performed manual classification. Compliance with strict annotation guidelines and client requirements was ensured on every batch processed. High attention to detail and consistency was maintained when annotating sensitive and regular datasets. • Managed annotation of diverse image types for AI pipelines • Flagged and escalated sensitive content (violence, adult, spam) • Collaborated with ML engineers to refine workflows and increase IAA • Delivered under strict SLAs while managing concurrent project loads

In this role, I conducted image annotation projects used for training computer vision models and performed manual classification. Compliance with strict annotation guidelines and client requirements was ensured on every batch processed. High attention to detail and consistency was maintained when annotating sensitive and regular datasets. • Managed annotation of diverse image types for AI pipelines • Flagged and escalated sensitive content (violence, adult, spam) • Collaborated with ML engineers to refine workflows and increase IAA • Delivered under strict SLAs while managing concurrent project loads

2026 - Present

AI/LLM Analyst — Senior Annotation Analyst

TextRLHF

As a Senior Annotation Analyst at INNODATA INC, I annotated and evaluated outputs of large language models, using RLHF-aligned methodologies for accuracy and safety enhancement. My work included giving preference rankings and qualitative feedback on model responses and summarizing findings for quality assurance cycles. I was also responsible for drafting and updating annotation guidelines and best practices. • Provided 97%+ accurate annotations in line with strict guidelines across multiple projects • Executed QA checks and flagged systemic errors for process improvement • Authored and maintained SOPs that standardized edge case annotation • Performed LLM output evaluation, feedback, and inter-annotator agreement calibration

As a Senior Annotation Analyst at INNODATA INC, I annotated and evaluated outputs of large language models, using RLHF-aligned methodologies for accuracy and safety enhancement. My work included giving preference rankings and qualitative feedback on model responses and summarizing findings for quality assurance cycles. I was also responsible for drafting and updating annotation guidelines and best practices. • Provided 97%+ accurate annotations in line with strict guidelines across multiple projects • Executed QA checks and flagged systemic errors for process improvement • Authored and maintained SOPs that standardized edge case annotation • Performed LLM output evaluation, feedback, and inter-annotator agreement calibration

2026 - Present

Annotation Analyst

V7 LabsVideoClassification

I played a critical role in annotating and categorizing video assets for ML model development and moderation enforcement. This involved fine-grained labeling and quality checks of video fragments to ensure high dataset fidelity. I regularly handled challenging categories, including high-sensitivity materials, while exceeding accuracy and recall targets. • Organized and annotated large volumes of video data • Performed moderation and policy checks across video content • Systematically documented annotation logic and walkthroughs for best practices • Supported team calibration sessions for improved inter-annotator reliability

I played a critical role in annotating and categorizing video assets for ML model development and moderation enforcement. This involved fine-grained labeling and quality checks of video fragments to ensure high dataset fidelity. I regularly handled challenging categories, including high-sensitivity materials, while exceeding accuracy and recall targets. • Organized and annotated large volumes of video data • Performed moderation and policy checks across video content • Systematically documented annotation logic and walkthroughs for best practices • Supported team calibration sessions for improved inter-annotator reliability

2022 - 2026

Annotation Analyst

LabelboxImageClassification

I carried out large-scale image annotation for training machine learning models used in computer vision applications. Responsibilities included labeling objects, reviewing flagged content, and enforcing policy compliance using specialized annotation tools. Maintaining accuracy and throughput across challenging content types—including sensitive categories—was critical in this role. • Used Labelbox and Darwin V7 to annotate, verify, and QA image datasets • Flagged policy violations and performed sensitive content moderation • Supported IAA calibration and dataset quality maintenance • Contributed to the documentation of best practices and decision trees for the team

I carried out large-scale image annotation for training machine learning models used in computer vision applications. Responsibilities included labeling objects, reviewing flagged content, and enforcing policy compliance using specialized annotation tools. Maintaining accuracy and throughput across challenging content types—including sensitive categories—was critical in this role. • Used Labelbox and Darwin V7 to annotate, verify, and QA image datasets • Flagged policy violations and performed sensitive content moderation • Supported IAA calibration and dataset quality maintenance • Contributed to the documentation of best practices and decision trees for the team

2022 - 2026

Show more

Education

Work History