Shoaib Wani

Key Skills

Software

CVAT

iMerit

Kili Technology

Labelbox

Prodigy

Scale AI

Top Subject Matter

No subject matter listed

Top Data Types

Computer Code Programming

Image

Text

Video

Top Label Types

Bounding Box

Classification

Computer Programming Coding

Evaluation Rating

Function Calling

Object Detection

Question Answering

RLHF

Text Generation

Tracking

Freelancer Overview

I am an AI and machine learning professional with 7 years of experience specializing in high-precision data annotation, dataset engineering, and LLM evaluation. My background includes hands-on work in data labeling for computer vision and NLP projects, such as developing a pneumonia detection system using ResNet and building multimodal data annotation pipelines with quality assurance workflows. I am skilled in Python, PyTorch, TensorFlow, and various data engineering tools, and have contributed to research on human-centered AI, model alignment, and bias detection. My interdisciplinary approach, combining technical expertise with an understanding of psychology and ethics, enables me to deliver high-quality, reliable training data for advanced AI systems.

Labeling Experience

Computer Vision Annotation Contractor – CVAT Projects

CVATImageBounding Box

Annotated images with bounding boxes and segmentation masks to build datasets for object detection. Supported projects requiring precise computer vision labeling for AI development. Engaged with multiple annotation software platforms to ensure dataset comprehensiveness. • Labeled images for object detection using bounding boxes • Created segmentation masks for improved dataset utility • Worked across various annotation projects with tight deadlines • Collaborated to enhance annotation quality and consistency.

Annotated images with bounding boxes and segmentation masks to build datasets for object detection. Supported projects requiring precise computer vision labeling for AI development. Engaged with multiple annotation software platforms to ensure dataset comprehensiveness. • Labeled images for object detection using bounding boxes • Created segmentation masks for improved dataset utility • Worked across various annotation projects with tight deadlines • Collaborated to enhance annotation quality and consistency.

2023 - 2025

LLM Evaluator – Outlier AI

Scale AITextEvaluation Rating

Evaluated and ranked LLM responses, ensuring high dataset quality and clarity for language model outputs. Authored gold-standard responses, flagged hallucinations and biases, and contributed to feedback cycles in RLHF pipelines. Supported model alignment, improvement initiatives, and prompt-based evaluation of NLP systems. • Consistently monitored output quality for model safety and accuracy • Provided feedback for RLHF (Reinforcement Learning from Human Feedback) pipelines • Rated and ranked model responses using standardized evaluation schema • Created gold responses to establish reference standards.

Evaluated and ranked LLM responses, ensuring high dataset quality and clarity for language model outputs. Authored gold-standard responses, flagged hallucinations and biases, and contributed to feedback cycles in RLHF pipelines. Supported model alignment, improvement initiatives, and prompt-based evaluation of NLP systems. • Consistently monitored output quality for model safety and accuracy • Provided feedback for RLHF (Reinforcement Learning from Human Feedback) pipelines • Rated and ranked model responses using standardized evaluation schema • Created gold responses to establish reference standards.

2023

LLM Evaluation & Dataset QA Analyst – Scale AI

Scale AITextEvaluation Rating

Conducted response grading, prompt writing, and gold-label validation for conversational AI models. Performed detailed JSON scoring, preference ranking, and contributed to NLP evaluation workflows. Ensured dataset quality and supported continuous improvement of conversational agents. • Wrote prompts and gold responses for supervised fine-tuning • Graded and scored conversational outputs with attention to model performance • Ranked preferences between model responses for RLHF pipelines • Validated JSON-based annotations for quality assurance.

Conducted response grading, prompt writing, and gold-label validation for conversational AI models. Performed detailed JSON scoring, preference ranking, and contributed to NLP evaluation workflows. Ensured dataset quality and supported continuous improvement of conversational agents. • Wrote prompts and gold responses for supervised fine-tuning • Graded and scored conversational outputs with attention to model performance • Ranked preferences between model responses for RLHF pipelines • Validated JSON-based annotations for quality assurance.

2023

AI Data Annotation Specialist – iMerit

ImeritTextClassification

Performed high-accuracy text and image annotation to support supervised machine learning systems. Maintained quality assurance standards and labeled edge cases to train robust AI models. Operated within both textual and visual data labeling pipelines for commercial AI deployments. • Conducted annotation using established protocols and guidelines • Contributed to edge-case scenario labeling for improved model generalization • Maintained exceptional QA (quality assurance) scores through detailed review • Provided regular feedback for annotation workflow optimization.

Performed high-accuracy text and image annotation to support supervised machine learning systems. Maintained quality assurance standards and labeled edge cases to train robust AI models. Operated within both textual and visual data labeling pipelines for commercial AI deployments. • Conducted annotation using established protocols and guidelines • Contributed to edge-case scenario labeling for improved model generalization • Maintained exceptional QA (quality assurance) scores through detailed review • Provided regular feedback for annotation workflow optimization.

2023

Education

Work History