AI Data Trainer
As an AI Data Trainer at Mercor AI, I evaluated and improved large language model outputs to ensure logic, factual accuracy, and helpfulness. I conducted labeling and quality assurance through prompt engineering, multilingual dialogue annotation, and RLHF methodologies. My work enhanced model performance by identifying errors, biases, and supporting expansion to low-resource East African languages. • Crafted and refined complex prompts for LLM testing and evaluation. • Labeled and reviewed multi-turn dialogues between humans and AI for coherence and precision. • Performed RLHF tasks, ranking AI outputs using custom rubrics to reinforce model behavior. • Conducted linguistic evaluations across English, Oromo, and Kiswahili, documenting hallucinations and biases for reliability.