We are hiring expert contributors for Project Gauss HLE (Humanity's Last Exam) on the Snorkel AI platform. Contributors will create graduate-level and PhD-level question-answer pairs in Coding/Engineering and Computer Science domains to benchmark frontier AI models. ROLE: Expert Contributor (EC) — 3 earning opportunities per project: • Submission: Write original, expert-level multiple-choice or fill-in-the-blank questions with verified answers and solution explanations ($74–$127 per accepted submission depending on domain) • Review: Peer-review other contributors' submissions for accuracy, difficulty, and quality ($16–$27 per completed review) • Adjudication: Final quality review and decision-making on disputed submissions ($16–$27 per adjudication) REQUIREMENTS: • Master's degree or 4+ years of professional experience in Coding/Engineering or Computer Science • Strong technical writing ability in English • No AI tools permitted for question generation • Work is completed on the Snorkel AI Experts Platform (experts.snorkel-ai.com) ACCESS: Contributors will work under the employer's Snorkel AI expert account. Access details provided upon hiring via AnyDesk, account credentials, or linked account. This is a 1099 independent contractor role. Flexible schedule — work at your own pace.
Total Budget
-
Pay per Label
$35.00/label
Time Requirement
20+ hrs/week
Duration
6+ months
Expert-level graduate and PhD-level question-answer pairs for the Humanity's Last Exam (HLE) AI benchmark dataset, covering 1 academic domain: Coding/Engineering.
Software
Hiring Type
Required Location
Workload / Schedule
Flexible schedule, self-paced asynchronous work via the Snorkel AI Experts Portal. Contributors are expected to work 20-40 hours per week depending on task availability. Project runs on an ongoing basis with tasks assigned continuously.
Software
Data Type
Label Types
Subject Matter / Industry
Proposals: 8
Invites sent: 0
Unanswered invites: 0
Share link