Data Engineering Analyst (Mid-Level), HST Card Technology
Implemented Generative AI solutions using LLMs and SLMs involving prompt design, output assessment, and iterative refinement tasks. Led LLM output evaluation, including retrieval accuracy checks and structured response quality scoring, similar to RLHF workflows. Developed and validated anomaly detection models through ground truth data labeling and quality assurance processes. • Conducted rigorous model output validation by comparing predictions against labeled data. • Created detailed documentation for workflow guidelines and annotation standards. • Built RAG pipelines requiring relevance and context labeling. • Focused on quality and consistency in AI output assessment.