Freelance AI Content Annotator / Evaluator
In this freelance AI content annotator/evaluator position, I evaluated and labeled text data for safety and RLHF purposes. My responsibilities included classifying policy-violating content, drafting prompts, and creating gold-standard responses. I maintained rigorous attention to guidelines, flagged ambiguities, and communicated issues concisely for machine learning teams. • Performed Swahili & English language evaluation and safety classification for AI outputs. • Drafted and reviewed prompts and gold-standard responses for reinforcement learning from human feedback. • Maintained high labeling accuracy while adapting to evolving guidelines. • Communicated results and flagged issues effectively for ML engineering teams.