AI Training & Evaluation Specialist

Project Overview / Instructions

You will need prior experience working on remote AI platforms and demonstrated hands-on ability with AI training, AI evaluation, annotation, ranking, or data labeling tasks. You must be able to complete client qualification and onboarding assessments independently (including assessments where you may have only one attempt). Strong English reading and writing skills are required, along with reliable computer and internet access, excellent attention to detail, and the ability to follow the assessment AI-usage policy without using major generative AI tools to generate assessment answers. After onboarding, you will complete client qualification/assessment tasks and then work on AI training and evaluation assignments tailored to your strengths. Typical work includes evaluating and ranking AI-generated outputs, performing prompt evaluations, running natural language and reasoning assessments, and contributing to text data labeling and quality reviews to improve model performance. The goal is to provide consistent, high-quality human feedback that helps train and refine AI models.