AI Training & Data Annotation Specialist | RWS — Remote
Produced and validated annotation workflows for large-scale LLM training datasets spanning text, audio, image, and multimodal formats. Applied RLHF evaluation consistently across high-volume datasets to maintain quality and productivity thresholds. Designed and refined evaluation rubrics, annotation schemas, and quality SOPs in annotation workflows. • Provided corrective feedback to iteratively improve function-calling outputs • Identified errors and reasoning gaps in structured agent outputs • Supported model development with thorough evaluation documentation • Quickly adapted to evolving guidelines and task specifications.