AI Data Annotation & Evaluation for LLM and Search Quality Tasks
Worked on multiple AI training and evaluation projects involving text and audio data. Tasks included evaluating AI-generated responses based on accuracy, relevance, and task completion, rating search results for user intent satisfaction, and performing audio transcription following strict style guides. Responsible for comparing multiple AI responses, identifying factual errors, summarizing content, and tagging quality issues. Followed detailed project guidelines including E-E-A-T principles, needs-met ratings, and consistency rules. Maintained high accuracy and consistency scores during qualifying and production tasks. Handled confidential datasets and adhered to quality assurance processes, including self-review and correction based on feedback.