Posted: Jul 28, 2025
AI Agent Assistant Evaluators – LLM Annotation & QA [LA‑L]
Total Budget: $1,250OtherTextPay Per Hour
Overview
Dataset
Labeling Details
Hiring
Budget
Client
Labeling Overview
Applicants should have at least one year of text‑based AI/LLM annotation or evaluation experience, solid English at B2 or higher, and proven skill in web research, fact‑checking, and prompt refinement. Suitable backgrounds include AI Analyst, Chatbot Analyst, AI Trainer, Prompt Engineer, Data Scientist, ML Engineer, or similar roles where they have actively worked with large language models. Final‑year university students and graduates from any discipline are welcome if their résumé clearly lists LLM‑related work. All candidates must be ready to take a six‑question qualification test (pass mark ≥ 5/6), complete ID verification, and join the project Discord workspace. The project focuses on reviewing AI assistant conversations: you will validate factual accuracy, ensure responses align with user intent, flag inconsistencies, and craft improved prompts or feedback to boost model performance. Work is fully remote, task‑based, and self‑paced—ideal for freelancers looking to contribute on their own schedule. Compensation is a fixed $7 per hour across all seniority levels.
Total Budget: $1,250Pay Per HourIntermediate1-3 monthsIndependent Labelers Only
Total Budget
$1,250
Pay per Label
$10/hr
Time Requirement
Less than 20 hrs/week
Duration
1-3 months
Description of dataset
LLM assistant conversations needing quality review
Software
Other
Hiring Type
Independent Labelers Only
Required Location
Argentina, Bolivia, Colombia, Dominican Republic, Ecuador, El Salvador, Guyana, Jamaica, Paraguay, Peru
Workload / Schedule
Flexible schedule, must be available for onboarding immediately
Software
Other
Data Type
TextLabel Types
Question Answering
Subject Matter / Industry
Generative AI/LLM data annotation and QA
Language
English
Job Type
Managed Service by OpenTrain
Share this project
Share link
trainai.co/project