For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
Mahesh Kumar

Mahesh Kumar

Project Lead- Operations manager, Data Annotation & AI Evaluation

INDIA flag
Delhi, India
$37.00/hrExpertMercorSuperannotateAws Sagemaker

Key Skills

Software

MercorMercor
SuperAnnotateSuperAnnotate
AWS SageMakerAWS SageMaker

Top Subject Matter

Agentic AI
Data Annotation
Human-in-the-loop for AI

Top Data Types

Computer Code ProgrammingComputer Code Programming
Medical DicomMedical Dicom
TextText
ImageImage
VideoVideo

Top Task Types

Evaluation Rating
Object Detection
Prompt Response Writing SFT
Question Answering
RLHF
Fine Tuning
Data Collection
Text Generation

Freelancer Overview

Project Lead- Operations manager, Data Annotation & AI Evaluation. Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal, Proprietary Tooling, and Turing. Education includes Executive Master of Business Administration, Indian Institute of Technology Patna (2024) and Master of Computer Application, Amity University (2024). AI-training focus includes data types such as Image, Video, and Text and labeling workflows including Fine-tuning, Evaluation, and Rating.

ExpertHindiEnglish

Labeling Experience

SuperAnnotate

Model Breaker- Turing

SuperannotateTextPrompt Response Writing SFTRLHF
Wring prompts, response and response reference

Wring prompts, response and response reference

2025 - Present
Mercor

Saas Software

MercorDocumentPrompt Response Writing SFT
I create prompts, response and how can the response achieved.

I create prompts, response and how can the response achieved.

2025

Project Lead- Operations manager, Data Annotation & AI Evaluation

ImageFine TuningData Collection
Oversaw data annotation, human response evaluation, and AI agentic analysis for large datasets. Responsible for leveraging machine learning to improve model performance using multimedia data. Provided leadership and quality management for annotation and evaluation processes. • Managed multimodal labeling including images, videos, and text at enterprise scale. • Evaluated the quality and accuracy of annotations and provided structured feedback. • Developed and implemented quality assurance protocols for annotation outputs. • Coordinated with technical teams to assess and enhance AI fine-tuning cycles.

Oversaw data annotation, human response evaluation, and AI agentic analysis for large datasets. Responsible for leveraging machine learning to improve model performance using multimedia data. Provided leadership and quality management for annotation and evaluation processes. • Managed multimodal labeling including images, videos, and text at enterprise scale. • Evaluated the quality and accuracy of annotations and provided structured feedback. • Developed and implemented quality assurance protocols for annotation outputs. • Coordinated with technical teams to assess and enhance AI fine-tuning cycles.

2023 - Present
AWS SageMaker

Technical Cloud and Business support Analyst (AI/ML annotation support)

Aws SagemakerTextFine TuningPrompt Response Writing SFT
Performed AI fine tuning and supervised machine learning tasks via Sagemaker, focusing on AWS services. Supported data annotation workflows involving large language models and digital assistants. Contributed to implementing new annotation guidelines and optimizing data pipelines. • Assisted with prompt/response evaluation and generation for AI tuning. • Executed expert review and rating processes for model performance assessment. • Employed business intelligence tools to improve annotation effectiveness. • Ensured annotation quality for diverse business-driven AI applications.

Performed AI fine tuning and supervised machine learning tasks via Sagemaker, focusing on AWS services. Supported data annotation workflows involving large language models and digital assistants. Contributed to implementing new annotation guidelines and optimizing data pipelines. • Assisted with prompt/response evaluation and generation for AI tuning. • Executed expert review and rating processes for model performance assessment. • Employed business intelligence tools to improve annotation effectiveness. • Ensured annotation quality for diverse business-driven AI applications.

2020 - 2024

Education

A

Amity University

Master of Computer Application, Computer Application

Master of Computer Application
2022 - 2024
D

Delhi University

Bachelor of Arts, Economics and Statistics

Bachelor of Arts
2019 - 2022

Work History

Z

Zapier

Technical Support Analyst

Delhi
2025 - Present
T

Turing

Project Lead - Operations Manager

Delhi
2023 - Present