Consulting/Finance Expert and AI Model Evaluator (Contractor, Mercor AI)
Provided evaluation and rating of AI model performance within complex business and consulting scenarios. Developed structured evaluation frameworks and rubrics to assess reasoning, accuracy, and consistency in AI outputs. Simulated real-world commercial and financial decision-making contexts for advanced AI models. • Designed business case scenarios to test model reasoning and decision-making • Assessed and rated ambiguous and multi-step problem sets produced by AI models • Identified gaps and recommended improvements to model logic and reliability • Contributed to enhanced decision-making capabilities in AI systems