Senior Domain Expert – Buyers and Purchasing Agents | Occupational Reviewer | Mercor Intelligence
As a Senior Domain Expert and Occupational Reviewer for Mercor Intelligence, I designed and executed AI evaluation and benchmarking tasks within shopping and buyer agent workflows. I created structured prompts, rubrics, and quality assurance checks aimed at performance testing of large language models. My work focused on generating and validating expert-level data to train, test, and differentiate advanced AI systems. • Developed and refined complex evaluation rubrics for occupational workflow scenarios • Authored and rated model outputs, including prompt/response pairs for LLM training data • Performed multi-stage QA, peer review, and validation of annotated AI training samples • Specialized in RLHF and test set creation for model capability and boundary assessment.