Analyst – AI/LLM Practice
As an Analyst – AI/LLM Practice, I performed advanced LLM evaluation, prompt optimization, and response quality analysis across multiple AI workflows. I worked on RLHF pipelines including SxS evaluation, grounding analysis, and hallucination detection to improve AI system reliability. I analyzed structured and unstructured data outputs and translated findings into actionable feedback for model improvement. • Evaluated LLM outputs using structured frameworks and SQL concepts. • Conducted SxS evaluation and grounding analysis to detect AI hallucinations. • Debugged AI responses through logs, API traces, and logical reasoning. • Collaborated with cross-functional teams to resolve data, model, and system issues.