For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
Oishwaryaa Chhatui

Oishwaryaa Chhatui

AI Evaluation & Quality Analyst (RLHF | Speech | Multilingual)

INDIA flag
Kolkata, India
$15.00/hrExpertInternal Proprietary Tooling

Key Skills

Software

Internal/Proprietary Tooling

Top Subject Matter

No subject matter listed

Top Data Types

AudioAudio

Top Label Types

Emotion Recognition
RLHF
Evaluation Rating
Prompt Response Writing SFT
Audio Recording

Freelancer Overview

I have 3+ years of experience contributing to AI training data pipelines with a focus on evaluation, quality assurance, and reinforcement learning from human feedback (RLHF) for speech and conversational AI systems. AI evaluation and training data work (RLHF, speech/audio, multilingual) conducted continuously since 2022 across multiple projects. My work includes structured evaluation and scoring of AI-generated text and audio outputs, emotion recognition, response quality assessment, and safety alignment using detailed rubrics and annotation guidelines. I have supported supervised fine-tuning (SFT) and post-training evaluation by reviewing prompt–response pairs, validating annotation accuracy, and identifying systematic failure modes such as hallucinations, misclassification, and contextual drift. I have hands-on experience working with proprietary annotation platforms and spreadsheet-based review workflows to perform high-volume evaluations, secondary reviews, and QC audits. I conduct multilingual assessments (English, Hindi, Bengali) to ensure linguistic and cultural correctness, and regularly flag false positives/negatives to improve model precision and recall. In addition to execution, I provide structured feedback and aggregated insights to refine evaluation criteria and improve consistency across annotators, contributing to more reliable training data and measurable improvements in model performance.

ExpertBengaliHindi

Labeling Experience

AI Evaluation & Quality Analyst (RLHF / Speech / Multilingual)

Internal Proprietary ToolingAudioEmotion RecognitionRLHF
Evaluated AI-generated speech and text outputs as part of RLHF pipelines, including emotion recognition, safety alignment, and response quality. Conducted multilingual (English/Hindi/Bengali) assessments to ensure cultural and contextual accuracy. Audited model outputs to identify failure patterns, reduce false positives/negatives, and improve evaluation consistency. Provided structured feedback and scoring to support continuous model improvement across speech and conversational AI use cases.

Evaluated AI-generated speech and text outputs as part of RLHF pipelines, including emotion recognition, safety alignment, and response quality. Conducted multilingual (English/Hindi/Bengali) assessments to ensure cultural and contextual accuracy. Audited model outputs to identify failure patterns, reduce false positives/negatives, and improve evaluation consistency. Provided structured feedback and scoring to support continuous model improvement across speech and conversational AI use cases.

2022

Education

G

Google

Certification, Digital Marketing and E-commerce

Certification
2023 - 2023
N

National Institute of Open Schooling

High School/GED, Commerce

High School/GED
2014 - 2016

Work History

B

Bambinos Future School

Curriculum & Learning Operations Specialist

Remote
2025 - 2025
U

UNIABROAD

Content & Brand/Operations Specialist

Remote
2024 - 2025