Domain Expert, AI Trainer & Prompt Evaluator
As a Domain Expert, AI Trainer, and Prompt Evaluator for Mercor and Handshake AI, I trained large language models (LLMs) across various projects. I created, refined, and evaluated prompts and outputs using deep operational knowledge in management, food service, and hospitality domains. Responsibilities included rubric creation, assessment of AI-generated outputs for quality and accuracy, and scenario generation for operational workflows. • Designed and reviewed prompts for LLM training and SFT tasks. • Used rubric-based evaluation methods to assess practical applicability and alignment with operational realities. • Simulated operational challenges for realistic model improvement. • Provided comprehensive written feedback to enhance AI model performance.