Senior Data Labeling Specialist, QA Lead
Delivered annotations for images, PDFs, and short text with high QA acceptance rates. Focused on RLHF tasks such as prompt writing, pairwise preference ranking, and conversation grading. Built and maintained annotation guidelines to improve inter-annotator agreement. • Conducted safety labeling using policy taxonomies. • Managed 12 contractors with weekly calibration sessions. • Used Label Studio to set up projects with custom templates. • Developed Python utilities for dataset QA and validation.