AI Data Annotator & Evaluator (Independent / Professional Development)
Served as an AI Data Annotator & Evaluator with hands-on responsibility for evaluating and comparing pairs of AI-generated chatbot responses using structured criteria. Performed systematic fact-checking of AI outputs across both medical and general knowledge domains to identify factual errors and ensure quality. Designed and authored prompts, created evaluation rubrics, and applied expertise in the medical field to annotate health-related AI outputs. Conducted structured preference labeling following RLHF methodologies. Fact-checked AI-generated content, flagging inaccuracies. Scored responses on coherence, completeness, safety, and relevance using rubrics. Created and assessed prompts and bespoke evaluation rubrics across various domains.