Data Annotation Specialist & NLP Researcher, Edyah Consulting
Oversaw end-to-end annotation workflows for large-scale causal extraction datasets, including annotation guidelines design and taxonomy creation. Tagged and evaluated model-generated outputs using structured rubrics, assessing accuracy, relation classification, and boundary detection to improve model performance. Conducted error analysis and implemented quality improvements that increased inter-annotator agreement. • Designed annotation workflows and onboarding for multi-label schemas • Applied evaluation rubrics to tag and QA model outputs • Automated data-quality pipelines to enhance QA efficiency • Collaborated with ML engineers for model retraining and dataset refinement