Posted: Apr 2, 2026
Gauss HLE Expert Contributor – AI Benchmark Question Writer (Snorkel AI)
OtherComputer Code ProgrammingPay Per Label
Labeling Overview
We are hiring expert contributors for Project Gauss HLE (Humanity's Last Exam) on the Snorkel AI platform. Contributors will create graduate-level and PhD-level question-answer pairs in Coding/Engineering and Computer Science domains to benchmark frontier AI models. ROLE: Expert Contributor (EC) — 3 earning opportunities per project: • Submission: Write original, expert-level multiple-choice or fill-in-the-blank questions with verified answers and solution explanations ($74–$127 per accepted submission depending on domain) • Review: Peer-review other contributors' submissions for accuracy, difficulty, and quality ($16–$27 per completed review) • Adjudication: Final quality review and decision-making on disputed submissions ($16–$27 per adjudication) REQUIREMENTS: • Master's degree or 4+ years of professional experience in Coding/Engineering or Computer Science • Strong technical writing ability in English • No AI tools permitted for question generation • Work is completed on the Snorkel AI Experts Platform (experts.snorkel-ai.com) ACCESS: Contributors will work under the employer's Snorkel AI expert account. Access details provided upon hiring via AnyDesk, account credentials, or linked account. This is a 1099 independent contractor role. Flexible schedule — work at your own pace.
Pay Per LabelIntermediate6+ monthsAgency or Individual
Total Budget
-
Pay per Label
$35.00/label
Time Requirement
20+ hrs/week
Duration
6+ months
Description of dataset
Expert-level graduate and PhD-level question-answer pairs for the Humanity's Last Exam (HLE) AI benchmark dataset, covering 1 academic domain: Coding/Engineering.
Software
Other
Hiring Type
Agency or Individual
Required Location
Global - Any Location
Workload / Schedule
Flexible schedule, self-paced asynchronous work via the Snorkel AI Experts Portal. Contributors are expected to work 20-40 hours per week depending on task availability. Project runs on an ongoing basis with tasks assigned continuously.
Software
Other
Data Type
Computer Code ProgrammingLabel Types
Computer Programming Coding
Evaluation Rating
Question Answering
Subject Matter / Industry
Coding/Engineering, Computer Science, Software Engineering, AI benchmark questions and answers
Activity on this project
Proposals: 8
Invites sent: 0
Unanswered invites: 0
Share this project
Share link
trainai.co/project