Banking Text Data Annotation & Quality Review Project
Built on prior knowledge of large-scale text annotation and quality assurance projects to assist in training large language models. Conducted annotation in Prodigy of complex prompts and user queries, as well as AI-generated responses for intent, sentiment, named entities, and response quality in accordance with detailed annotation guidelines. Analyzed ambiguous cases and edge scenarios, documented the reasoning behind them, and provided examples to promote guideline clarity. Performed secondary reviews of teammates' work, identified recurring error patterns, and provided clear feedback to maintain team standards. Engaged in calibration sessions with project managers and QA teams for consistent labeling standards. Assisted in sensitive content classification activities by carefully applying safety policies and escalation procedures.