For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

LoginCreate account
Invite to Job
N

Nikhil Tiwari

AI Data Annotator & Evaluator — Outlier

India flagChittorgarh, India
$25.00/hrIntermediateOther

Key Skills

Software

Other

Top Subject Matter

AI/LLM Evaluation
Vision-Language Model Evaluation
LLM Output Evaluation

Top Data Types

TextText
ImageImage

Top Task Types

RLHF
Classification
Diagnosis

Freelancer Overview

AI Data Annotator & Evaluator — Outlier. Brings 5+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Other. Education includes Bachelor of Technology, Jaipur Engineering College and Research Centre (2022). AI-training focus includes data types such as Text, Image, and Medical and labeling workflows including RLHF, Classification, and Evaluation.

IntermediateEnglish

Labeling Experience

AI Data Annotator & Evaluator — Outlier

OtherImageClassification
I carried out multimodal annotation tasks that focused on image labeling, OCR validation, and alignment of images with text. My responsibilities included quality assurance for annotated images used in vision-language model evaluation. I ensured alignment between images and captions while supporting model performance improvements. • Conducted OCR validation and image-caption alignment as part of vision-language model evaluation. • Ensured high image annotation quality for downstream AI use cases. • Identified ambiguous or challenging edge cases in multimodal datasets. • Maintained inter-annotator consistency through calibration and guideline adherence.

I carried out multimodal annotation tasks that focused on image labeling, OCR validation, and alignment of images with text. My responsibilities included quality assurance for annotated images used in vision-language model evaluation. I ensured alignment between images and captions while supporting model performance improvements. • Conducted OCR validation and image-caption alignment as part of vision-language model evaluation. • Ensured high image annotation quality for downstream AI use cases. • Identified ambiguous or challenging edge cases in multimodal datasets. • Maintained inter-annotator consistency through calibration and guideline adherence.

2024 - Present

AI Data Annotator & Evaluator — Outlier

OtherTextRLHF
I performed large-scale annotation tasks involving text classification, comparative ranking, and structured validation at Outlier. My work covered evaluation of LLM-generated outputs for accuracy, coherence, and adherence to instructions, including justification writing for model training. I maintained high inter-annotator agreement and contributed feedback on edge cases and ambiguous prompts. • Completed 500+ hours of text annotation, ranking, and validation. • Delivered structured, justification-based feedback for model evaluation and RLHF pipelines. • Identified and documented edge cases and model failure for iterative improvement. • Achieved top performer status for accuracy and throughput in annotation sprints.

I performed large-scale annotation tasks involving text classification, comparative ranking, and structured validation at Outlier. My work covered evaluation of LLM-generated outputs for accuracy, coherence, and adherence to instructions, including justification writing for model training. I maintained high inter-annotator agreement and contributed feedback on edge cases and ambiguous prompts. • Completed 500+ hours of text annotation, ranking, and validation. • Delivered structured, justification-based feedback for model evaluation and RLHF pipelines. • Identified and documented edge cases and model failure for iterative improvement. • Achieved top performer status for accuracy and throughput in annotation sprints.

2024 - Present

Amazon Review Sentiment Analysis (Project)

OtherTextClassification
I performed multi-class labeling of Amazon review text samples for training sentiment analysis models. My responsibilities encompassed applying robust annotation strategies and extensive quality validation. I took part in building a clean, ground-truth labeled dataset to support supervised NLP model training. • Carried out feature extraction and text labeling with TF-IDF and embeddings. • Conducted annotation quality assurance and consistency checks. • Supported supervised learning through accurate text classification labels. • Benchmarked various classifiers using the labeled dataset.

I performed multi-class labeling of Amazon review text samples for training sentiment analysis models. My responsibilities encompassed applying robust annotation strategies and extensive quality validation. I took part in building a clean, ground-truth labeled dataset to support supervised NLP model training. • Carried out feature extraction and text labeling with TF-IDF and embeddings. • Conducted annotation quality assurance and consistency checks. • Supported supervised learning through accurate text classification labels. • Benchmarked various classifiers using the labeled dataset.

2023 - 2023

Pneumonia Detection System (Deep Learning) (Project)

OtherDiagnosis
I handled data curation, labeling, and quality control for a binary classification model on chest X-rays, supporting medical deep learning. My responsibilities included balancing class representation and evaluating dataset performance using various metrics. I maintained strict quality standards for labeled medical images. • Ensured high-quality annotation for medical model training datasets. • Implemented class imbalance solutions to boost diagnostic performance. • Conducted validation of labels with precision and recall metrics. • Supported accurate medical diagnosis through careful dataset preparation.

I handled data curation, labeling, and quality control for a binary classification model on chest X-rays, supporting medical deep learning. My responsibilities included balancing class representation and evaluating dataset performance using various metrics. I maintained strict quality standards for labeled medical images. • Ensured high-quality annotation for medical model training datasets. • Implemented class imbalance solutions to boost diagnostic performance. • Conducted validation of labels with precision and recall metrics. • Supported accurate medical diagnosis through careful dataset preparation.

2023 - 2023

Data Annotation & Classification Pipeline (Project)

OtherTextClassification
I developed, quality checked, and exported labeled datasets for ML training through an annotation pipeline. My work involved multi-annotator workflows and use of agreement metrics to measure and enforce label consistency. I also managed data preprocessing and rule-based error detection to improve dataset quality. • Designed and implemented end-to-end pipeline for structured data annotation and export. • Applied Cohen's Kappa for label consistency metrics. • Cleaned and preprocessed large raw data volumes pre-annotation. • Automated detection and correction of label errors using internal rules.

I developed, quality checked, and exported labeled datasets for ML training through an annotation pipeline. My work involved multi-annotator workflows and use of agreement metrics to measure and enforce label consistency. I also managed data preprocessing and rule-based error detection to improve dataset quality. • Designed and implemented end-to-end pipeline for structured data annotation and export. • Applied Cohen's Kappa for label consistency metrics. • Cleaned and preprocessed large raw data volumes pre-annotation. • Automated detection and correction of label errors using internal rules.

2023 - 2023

Education

J

Jaipur Engineering College and Research Centre

Bachelor of Technology, Information Technology

Bachelor of Technology
2022

Work History

O

Outlier (Remote)

AI Data Annotator & Evaluator

Location not specified
2024 - Present
U

Upflairs

Python Programming Trainee

Location not specified
2022 - 2022