AI Data Annotator
As an AI Data Annotator at Outlier, I evaluated LLM outputs for accuracy, instruction-following, and safety compliance, maintaining a top-tier quality score. I conducted side-by-side model comparisons to generate preference data for RLHF pipelines. I reviewed AI-generated code in Dart, C++, and Python, identifying logic errors and hallucinations. • Evaluated and rated LLM responses for accuracy, compliance, and safety. • Participated in RLHF workflows using side-by-side preference ranking methods. • Reviewed and annotated AI-generated computer code in multiple programming languages. • Used Outlier’s internal tooling to ensure data quality and consistency.