Data Annotator Quality Analyst
Acted as a critical, high-level reviewer within the AI development lifecycle, ensuring that data labeled for machine learning—particularly Large Language Models (LLMs)—meets strict accuracy, consistency, and safety standards. Quality Assurance & Validation: Reviewing, auditing, and correcting datasets (text, image, video, code) produced by other annotators to ensure compliance with project specifications. Edge Case Resolution: Analyzing ambiguous, difficult, or anomalous data points and making high-level judgment calls based on complex, multi-page, or evolving, guidelines. Evaluation (SxS): Performing side-by-side (SxS) evaluations of AI-generated content to assess quality, relevance, factual accuracy, and safety.