Senior AI Content Specialist (LLM & RLHF)
As Senior AI Content Specialist at Global AI Labs, I led annotation and QA for large-scale LLM alignment projects, specializing in RLHF rankings and Chain-of-Thought reasoning. I designed annotation guidelines that significantly improved inter-annotator agreement and successfully reduced model hallucination rates. My work included dataset versioning and mentoring junior annotators for sustained quality across model iterations. • Produced and validated over 100,000 RLHF rankings (Helpfulness, Honesty, Harmlessness). • Implemented semi-automated evaluation pipelines with Python and prompt engineering. • Led red-teaming for a 20,000-prompt safety dataset improving model safety benchmarks. • Standardized onboarding for annotators, cutting ramp-up time in half.