Posted: Jul 28, 2025
AI Agent Assistant Evaluators - LLM Annotation & QA [AS‑L]
Total Budget: $1,250OtherTextPay Per Hour
Overview
Dataset
Labeling Details
Hiring
Budget
Client
Labeling Overview
Applicants should bring at least one year of professional or academic experience in data annotation, strong familiarity with multiple LLMs, and solid English skills at B2 or above. Curiosity, intellectual breadth, and meticulous attention to detail are essential, along with competence in web research, fact‑checking, and prompt crafting. Final‑year university students and graduates from diverse disciplines are welcome if they meet these criteria. All candidates must be ready to complete a short six‑question qualification test, verify their identity, and join the project Discord workspace. The work centers on evaluating and improving AI assistant conversations: you will fact‑check model outputs, verify user intent alignment, flag inaccuracies, and supply clear feedback or refined prompts to enhance LLM performance. Tasks are delivered remotely, can be done on your own schedule, and are compensated at a fixed rate of $8 per hour.
Total Budget: $1,250Pay Per HourIntermediate3-6 monthsIndependent Labelers Only
Total Budget
$1,250
Pay per Label
$10/hr
Time Requirement
20+ hrs/week
Duration
3-6 months
Description of dataset
LLM assistant conversations needing quality review
Software
Other
Hiring Type
Independent Labelers Only
Required Location
Bangladesh, India, Indonesia, Malaysia, Pakistan, Philippines, Sri Lanka, Thailand, Vietnam
Workload / Schedule
Flexible schedule, must be available to complete onboarding immediately
Software
Other
Data Type
TextLabel Types
Question Answering
Subject Matter / Industry
Generative AI data annotation and QA
Language
English
Job Type
Managed Service by OpenTrain
Share this project
Share link
trainai.co/project