Freelancer IA (Prolific / Task Builders)
As a freelancer for Prolific / Task Builders, I was responsible for the validation of data and evaluation of language models using reinforcement learning from human feedback (RLHF) methods. My tasks included qualifying model outputs and ensuring response quality for AI training purposes. This work required attention to detail and consistency in assessment of large language models. • Evaluated and rated AI-generated text responses according to complex guidelines. • Contributed feedback for model fine-tuning and safety improvements. • Annotated a variety of text-based prompts and outputs in English and Portuguese. • Frequently utilized internal or proprietary online interfaces to manage and submit tasks.