AI Evaluation Specialist
As an AI Evaluation Specialist at Mercor Intelligence, I evaluated multimodal AI outputs by reviewing rubrics and performing comparative rankings. My work ensured high-quality, consistent annotation performance in preference optimization workflows. I identified actionable patterns and feedback to improve model alignment and quality. • Evaluated outputs across image, audio, and video modalities • Performed rubric review and preference ranking • Maintained high-throughput annotation quality • Supported RLHF and comparative judgment in operational workflows