AI Data Annotator & Evaluator (Freelance/Contract) - Sou AI, Outlier AI, Alignerr
As an AI Data Annotator & Evaluator, I performed detailed text and conversational data labeling for NLP and LLM training initiatives. My work included intent, entity, and sentiment annotation, as well as reviewing and evaluating AI-generated responses for quality and safety. I maintained high accuracy, contributed to guideline improvements, and supported operational excellence in annotation workflows. • Labeled textual data for entities and intents using defined taxonomies • Provided RLHF feedback and quality ratings on AI-generated outputs • Executed quality assurance reviews on peer annotations to ensure consistency • Collaborated with leads to escalate ambiguous examples and improve labeling guidelines