Posted: Apr 2, 2026
Einstein STEM Production - Adjudication, Submission & Review Tasks
OtherTextPay Per Label
Labeling Overview
Labelers will complete three types of tasks for the Einstein STEM Production project, focused on Computer Science and Software Engineering: 1. Submission: Write complete, high-quality solutions to CS/SE problems (algorithms, data structures, system design, coding challenges). 2. Review: Evaluate and critique submitted solutions for correctness, efficiency, and code quality. 3. Adjudication: Compare and rank multiple solutions, selecting the best response based on accuracy, clarity, and engineering best practices. Strong CS/SE background required. Tasks completed on Snorkel AI platform.
Pay Per LabelExpert3-6 monthsAgency or Individual
Total Budget
-
Pay per Label
$80.00/label
Time Requirement
20+ hrs/week
Duration
3-6 months
Description of dataset
STEM problem-solving tasks including computer science questions requiring expert evaluation, submission writing, and adjudication
Software
Other
Hiring Type
Agency or Individual
Required Location
Global - Any Location
Workload / Schedule
Flexible, asynchronous schedule. Work between 20-40 hours per week on CS/SE tasks. No fixed hours required — complete tasks at your own pace within deadlines.
Software
Other
Data Type
TextLabel Types
Computer Programming Coding
Evaluation Rating
Question Answering
Text Generation
Subject Matter / Industry
STEM - Computer Science (AI training dataset)
Activity on this project
Proposals: 10
Invites sent: 0
Unanswered invites: 0
Share this project
Share link
trainai.co/project