Senior Language Specialist – AI Trainer, Outlier
As a Senior Language Specialist—AI Trainer at Outlier, I designed and executed adversarial prompt scenarios to test advanced model capabilities. My main tasks included annotating training samples with metacognitive reasoning and building error-trace taxonomies for English language model evaluation. My role required me to work closely with cross-functional teams to refine prompt-engineering pipelines and evaluation metrics. • Designed 200+ syntactic and pragmatic adversarial prompt-test cases to expose LLM weaknesses • Annotated 3,500+ English training samples with explicit, context-rich rationales • Created a reproducible taxonomy cataloging 18 English model failure modes • Collaborated on prompt refinement, improving model accuracy and reducing hallucination rates