Data Annotation Specialist & AI Evaluator
Text
Evaluated AI outputs for helpfulness, accuracy, coherence, and safety using legal analytical skills. Assessed whether AI responses met prompt requirements by applying rule-based judgment from compliance experience. Reviewed outputs for hallucinations, factual errors, harmful or biased content, leveraging legal and ethical knowledge.
• Applied reinforcement learning from human feedback (RLHF) methods to judge quality of AI-generated texts.
• Rated and ranked large language model (LLM) responses with detailed rubrics and guidelines.
• Specialized in legal, regulatory, and oil & gas compliance texts for domain-specific annotation projects.
• Maintained rigorous quality assurance and attention to detail in annotation tasks.
Evaluated AI outputs for helpfulness, accuracy, coherence, and safety using legal analytical skills. Assessed whether AI responses met prompt requirements by applying rule-based judgment from compliance experience. Reviewed outputs for hallucinations, factual errors, harmful or biased content, leveraging legal and ethical knowledge. • Applied reinforcement learning from human feedback (RLHF) methods to judge quality of AI-generated texts. • Rated and ranked large language model (LLM) responses with detailed rubrics and guidelines. • Specialized in legal, regulatory, and oil & gas compliance texts for domain-specific annotation projects. • Maintained rigorous quality assurance and attention to detail in annotation tasks.
2024 - Present