Senior Data Operations Specialist (SME)
As a Senior Data Operations Specialist (SME) at Scale AI/DataAnnotation.tech, I led technical LLM training focused on complex reasoning, safety, and factual accuracy. My work included ranking, rating, and annotating large volumes of AI model outputs, and performing high-level audits for quality assurance. I contributed to drafting project guidelines and developing 'Red Teaming' processes to identify and mitigate risks in AI safety protocols. • Ranked and rated thousands of model outputs for helpfulness and harmlessness. • Led audits and peer reviews to reduce labeling error rates. • Drafted comprehensive labeling and safety evaluation guidelines. • Specialized in multi-step technical verification for LLMs.