AI Language Evaluator | ASR Quality Analyst
As an AI Language Evaluator and ASR Quality Analyst, I conducted extensive evaluation of automatic speech recognition models across diverse and code-switched audio datasets. My work involved reviewing over 1,800 long-form audio segments under strict QA production guidelines, focusing on semantic accuracy and error taxonomy. I provided structured, detailed feedback on model performance and risks, ensuring adherence to annotation guidelines and production standards. • Executed large-scale comparative analysis of ASR outputs for Ukrainian-Russian code-switched content. • Applied WER-informed error taxonomy, assessing for omission, hallucination, and normalization errors. • Identified and documented LLM-induced hallucinations and spurious continuations in transcriptions. • Delivered independent, high-throughput QA with minimal supervision.