Bhavana Sharma

Key Skills

Software

Internal/Proprietary Tooling

Top Subject Matter

No subject matter listed

Top Data Types

Audio

Image

Text

Video

Top Label Types

Classification

Evaluation Rating

Fine Tuning

Prompt Response Writing SFT

Red Teaming

Freelancer Overview

I am a data analytics and AI operations professional with over 8 years of experience specializing in data labeling, annotation, and quality assurance for large-scale AI training data projects. My background includes designing and managing Power BI dashboards, developing custom DAX measures for key quality metrics like precision, recall, and accuracy, and leading the automation of reporting systems to replace manual workflows. I have hands-on experience as a data annotator, auditor, and AI tutor, where I evaluated model outputs, identified quality trends, and contributed to process improvements across diverse domains. My technical toolkit includes Power BI, Power Query, advanced Excel, and basic SQL, and I am adept at transforming complex datasets into actionable insights. I am passionate about ensuring data quality and integrity, driving continuous improvement, and supporting AI model development with reliable, well-structured training data.

Labeling Experience

AI Tutor (Evaluation, Red Teaming & QA)

Internal Proprietary ToolingTextEvaluation Rating

Conducted rubric-based evaluation of AI model responses for diverse task types. Performed multi-layer quality assurance aligned with evolving model safety guidelines. Contributed to prompt generation and AI red teaming to uncover model vulnerabilities. • Developed supplemental training materials for new AI tutors • Identified instruction ambiguities and created clarifications • Supported onboarding processes for new hires • Applied structured review criteria in daily evaluations

Conducted rubric-based evaluation of AI model responses for diverse task types. Performed multi-layer quality assurance aligned with evolving model safety guidelines. Contributed to prompt generation and AI red teaming to uncover model vulnerabilities. • Developed supplemental training materials for new AI tutors • Identified instruction ambiguities and created clarifications • Supported onboarding processes for new hires • Applied structured review criteria in daily evaluations

2025 - 2025

Program Lead (AI Data Annotation & Evaluation)

AppenTextEvaluation Rating

Oversaw large-scale AI data annotation and evaluation programs to ensure alignment with stringent quality, throughput, and productivity targets. Refined and scaled annotation, review, and quality workflows for concurrent projects. Formulated and executed quality management plans to improve evaluation integrity and data consistency. • Led distributed teams of 30+ contributors and auditors • Analyzed operational and quality data for root-cause analysis • Designed dashboards and client-facing reports • Enhanced project efficiency through resource reallocation

Oversaw large-scale AI data annotation and evaluation programs to ensure alignment with stringent quality, throughput, and productivity targets. Refined and scaled annotation, review, and quality workflows for concurrent projects. Formulated and executed quality management plans to improve evaluation integrity and data consistency. • Led distributed teams of 30+ contributors and auditors • Analyzed operational and quality data for root-cause analysis • Designed dashboards and client-facing reports • Enhanced project efficiency through resource reallocation

2022 - 2025

Senior Auditor (AI Data Annotation QA)

AppenTextEvaluation Rating

Evaluated auditor deliverables to confirm compliance with defined quality standards on annotation projects. Reviewed evaluator feedback for accuracy and adherence to project guidelines. Developed training and assessment materials to drive continuous improvement. • Produced quizzes, documentation, and slide decks • Monitored project quality outcomes for leadership • Assessed and tracked project KPIs • Enhanced overall audit process efficacy

Evaluated auditor deliverables to confirm compliance with defined quality standards on annotation projects. Reviewed evaluator feedback for accuracy and adherence to project guidelines. Developed training and assessment materials to drive continuous improvement. • Produced quizzes, documentation, and slide decks • Monitored project quality outcomes for leadership • Assessed and tracked project KPIs • Enhanced overall audit process efficacy

2022 - 2022

Auditor (Annotation QA)

AppenTextEvaluation Rating

Conducted quality reviews and spot checks on annotator outputs to ensure accuracy and compliance. Provided structured performance feedback based on observed trends and patterns. Escalated recurring risks to ensure high-quality data in annotation projects. • Delivered constructive feedback to annotators • Identified persistent quality issues for escalation • Reviewed work for alignment with client guidelines • Tracked recurring errors for process improvement

Conducted quality reviews and spot checks on annotator outputs to ensure accuracy and compliance. Provided structured performance feedback based on observed trends and patterns. Escalated recurring risks to ensure high-quality data in annotation projects. • Delivered constructive feedback to annotators • Identified persistent quality issues for escalation • Reviewed work for alignment with client guidelines • Tracked recurring errors for process improvement

2021 - 2022

Data Annotator (Content Classification)

AppenTextClassification

Managed personal workflow on annotation projects to maintain high productivity and meet client-defined quality standards. Evaluated credibility of online content, investigated social media claims, and categorized results accordingly. Ensured compliance with detailed client instructions for each labeling task. • Categorized and labeled social media and online content • Adhered strictly to annotation guidelines • Investigated misinformation or disputed claims • Balanced accuracy with productivity expectations

Managed personal workflow on annotation projects to maintain high productivity and meet client-defined quality standards. Evaluated credibility of online content, investigated social media claims, and categorized results accordingly. Ensured compliance with detailed client instructions for each labeling task. • Categorized and labeled social media and online content • Adhered strictly to annotation guidelines • Investigated misinformation or disputed claims • Balanced accuracy with productivity expectations

2019 - 2021

Show more

Education

Work History