Ummadi Sudhakar

Key Skills

Software

Other

Telus

OneForma

Top Subject Matter

Large Language Models (LLMs)

Creative Storytelling

AI Reasoning

Top Data Types

Text

Audio

Video

Document

Top Task Types

Prompt Response Writing SFT

Audio Recording

Data Collection

Freelancer Overview

LLM Trainer / AI Evaluator | Turing. Brings 15+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Other, Telus, and OneForma. Education includes Master of Business Administration, Sri Krishna Devaraya University (2008) and Bachelor of Commerce, Sri Krishna Devaraya University (2003). AI-training focus includes data types such as Text, Audio, and Video and labeling workflows including Evaluation, Rating, and Prompt + Response Writing (SFT).

Labeling Experience

Quality Analyst – Web & Language Data Reviewer | TELUS International AI Data Solutions

TelusText

Reviewed and annotated web and language datasets for AI training using structured evaluation criteria for linguistic accuracy and content compliance. Performed Side-by-Side evaluations, multi-turn conversational reviews, and PII labeling in prompts and responses. Ensured quality assurance and continuous improvement within a remote annotation workflow. • Conducted SxS model response rankings and ambiguity detection. • Labeled PII data and moderated chatbot interactions. • Maintained regulatory compliance and productivity standards. • Provided annotation process feedback for optimizing accuracy and output.

Reviewed and annotated web and language datasets for AI training using structured evaluation criteria for linguistic accuracy and content compliance. Performed Side-by-Side evaluations, multi-turn conversational reviews, and PII labeling in prompts and responses. Ensured quality assurance and continuous improvement within a remote annotation workflow. • Conducted SxS model response rankings and ambiguity detection. • Labeled PII data and moderated chatbot interactions. • Maintained regulatory compliance and productivity standards. • Provided annotation process feedback for optimizing accuracy and output.

2021 - Present

LLM Trainer / AI Evaluator | Turing

OtherText

Created, annotated, and evaluated prompt tasks to measure LLM performance in storytelling, dialogue, roleplay, and reasoning contexts. Designed instruction-following and adversarial evaluation tasks, ensuring comprehensive coverage and quality. Reviewed LLM outputs for Grounding, factuality, contextual accuracy, and strict adherence to client guidelines. • Developed taxonomy-aligned prompt tasks and detailed evaluation frameworks. • Annotated and validated LLM responses, producing rationales for model performance assessments. • Collaborated with QA teams to refine annotation standards and process consistency. • Classified prompts into structured taxonomies for reproducible AI evaluation.

Created, annotated, and evaluated prompt tasks to measure LLM performance in storytelling, dialogue, roleplay, and reasoning contexts. Designed instruction-following and adversarial evaluation tasks, ensuring comprehensive coverage and quality. Reviewed LLM outputs for Grounding, factuality, contextual accuracy, and strict adherence to client guidelines. • Developed taxonomy-aligned prompt tasks and detailed evaluation frameworks. • Annotated and validated LLM responses, producing rationales for model performance assessments. • Collaborated with QA teams to refine annotation standards and process consistency. • Classified prompts into structured taxonomies for reproducible AI evaluation.

2025 - 2026

AI Video Creator | Hopscotch Ventures Pvt Ltd.

OtherVideoData Collection

Produced AI-generated video content for digital platforms, contributing to dataset enrichment for training and evaluation of video-based AI models. Collaborated with interdisciplinary teams to deliver quality outputs and meet project deadlines. Ensured compliance with video quality and content requirements throughout the production process. • Generated and submitted annotated video assets. • Supported training of AI models for video understanding. • Maintained consistency with project standards and guidelines. • Worked cross-functionally to ensure deliverable quality.

Produced AI-generated video content for digital platforms, contributing to dataset enrichment for training and evaluation of video-based AI models. Collaborated with interdisciplinary teams to deliver quality outputs and meet project deadlines. Ensured compliance with video quality and content requirements throughout the production process. • Generated and submitted annotated video assets. • Supported training of AI models for video understanding. • Maintained consistency with project standards and guidelines. • Worked cross-functionally to ensure deliverable quality.

2025 - 2025

Audio Data Contributor – AI Training Dataset | Tarmack / Thirty Two Lines LLC

OtherAudioAudio Recording

Contributed over 50 hours of multi-turn conversational voice recordings for global AI audio training datasets. Ensured consistent audio clarity, tonal accuracy, and adherence to strict recording quality guidelines. Delivered approved conversational speech samples for analysis and integration into speech training models. • Supplied high-quality voice recordings for AI dataset enrichment. • Maintained strict benchmarking for clarity and usability. • Followed detailed instructions for multi-turn dialogue capture. • Supported global linguistic research through AI audio data collection.

Contributed over 50 hours of multi-turn conversational voice recordings for global AI audio training datasets. Ensured consistent audio clarity, tonal accuracy, and adherence to strict recording quality guidelines. Delivered approved conversational speech samples for analysis and integration into speech training models. • Supplied high-quality voice recordings for AI dataset enrichment. • Maintained strict benchmarking for clarity and usability. • Followed detailed instructions for multi-turn dialogue capture. • Supported global linguistic research through AI audio data collection.

2025 - 2025

Freelance Content Specialist | LXT

OtherTextPrompt Response Writing SFT

Created and validated English content for AI language model training datasets focused on scenario-based articles and guides. Managed research, prompt authoring, source credibility assessment, and proofreading to maintain editorial standards. Supported a freelance content team to ensure workflow quality and consistent deliverables. • Produced SEO-optimized content for LLM platforms. • Authored and reviewed structured prompts and responses. • Led a team providing editorial guidance and proofreading. • Analyzed academic and industry sources for factual accuracy.

Created and validated English content for AI language model training datasets focused on scenario-based articles and guides. Managed research, prompt authoring, source credibility assessment, and proofreading to maintain editorial standards. Supported a freelance content team to ensure workflow quality and consistent deliverables. • Produced SEO-optimized content for LLM platforms. • Authored and reviewed structured prompts and responses. • Led a team providing editorial guidance and proofreading. • Analyzed academic and industry sources for factual accuracy.

2024 - 2024

Show more

Education

Work History