AI/Data Analyst – AI/LLM Evaluation
Text
As an AI/Data Analyst at CodeClause, I evaluated and reviewed AI-generated data outputs and automated pipeline responses. I identified inconsistencies, assessed response quality, and wrote structured rationales to guide model improvement. My responsibilities included analytical prompt design, critical content evaluation, and dashboard creation. • Conducted quality assessments on AI model outputs to ensure accuracy and consistency. • Reviewed and rated large language model (LLM) responses for relevance and helpfulness. • Developed structured rationales and feedback for improving LLM fine-tuning. • Used internal/proprietary tools and Python-based analytics platforms for detailed evaluation.
As an AI/Data Analyst at CodeClause, I evaluated and reviewed AI-generated data outputs and automated pipeline responses. I identified inconsistencies, assessed response quality, and wrote structured rationales to guide model improvement. My responsibilities included analytical prompt design, critical content evaluation, and dashboard creation. • Conducted quality assessments on AI model outputs to ensure accuracy and consistency. • Reviewed and rated large language model (LLM) responses for relevance and helpfulness. • Developed structured rationales and feedback for improving LLM fine-tuning. • Used internal/proprietary tools and Python-based analytics platforms for detailed evaluation.
2024 - Present