Medical Content Annotator & AI Training Evaluator
As an Assistant Technical Officer at FHI360, I performed medical content annotation, RLHF feedback, LLM output evaluation, and health prompt rating related to AI training. I utilized structured rubrics and detailed guidelines to evaluate AI-generated medical and health responses for accuracy and appropriateness. I applied clinical expertise to fact-check and ensure consistency with clinical standards and multilingual requirements. • Conducted RLHF evaluation of AI-generated medical texts in English, Hausa, and Kanuri. • Performed quality control, identifying errors and edge cases in health domain outputs. • Evaluated LLM responses for protocol adherence, factual correctness, and clinical safety. • Used proprietary and external AI training platforms, including Toloka and Outlier AI.