AI Training Scenario Designer
As an AI Training Scenario Designer at Mercor, I created detailed digital scenarios to train and evaluate AI agents in real-world environments. My responsibilities included developing personas, writing instruction-rich tasks, and generating golden responses for the evaluation of AI understanding and behavior. I used specific rubrics and hints to guide agent responses and thoroughly documented all work. • Built and tested scenarios in simulated digital platforms using tools such as Gmail, Slack, Calendar, WhatsApp, and Google Drive. • Wrote challenging prompts to assess and expand AI agent reasoning, prioritization, and filtering skills. • Developed comprehensive rubrics and gold-standard responses for AI performance evaluation and improvement. • Utilized Airtable and Crucible for documentation and workflow management.