Computer Science Expert (Python Required)

Job Name: Computer Science Expert (Python Validation)

Dataset Description (5–8 words): Computer science problem design and evaluation

Data Type (select one): Text

Subject Matter/Industry (5–8 words): Computer science reasoning and AI evaluation

Pre-labeled Data (Yes/No): No

Labeling Software: Other

Label Types (select 1+):

• Evaluation/Rating
• Question Answering
• Text Generation
• Prompt + Response Writing (SFT)
• Computer Programming/Coding
• Red Teaming

---

Labeling Overview

Qualifications / requirements: We’re seeking Computer Science experts with strong written English (C1+) and Python proficiency to validate solutions and evaluate multi-step reasoning. Ideal contributors have a degree in Computer Science (or related field) and at least 2+ years of professional, research, or teaching experience. You should be comfortable assessing correctness, assumptions, constraints, and scoring solution quality using structured criteria.

What you’ll do: You will design rigorous computer science problems aligned with real professional practice and evaluate AI-generated solutions for correctness and logical soundness. You’ll validate calculations or simulations using Python (e.g., NumPy, Pandas, SciPy), improve AI reasoning to better match industry-standard logic, and apply structured scoring criteria to complex multi-step work. You may also collaborate with a global community of advanced experts to maintain scientific integrity and consistent evaluation standards.

---

Required Locations: Global - Any Location

Required English Level: Fluent

---

Other Qualifications & Requirements (for screening)

• Degree in Computer Science or closely related field (or equivalent demonstrated expertise)
• 2+ years of applied, research, or teaching experience in CS or adjacent technical disciplines
• Strong Python proficiency for numerical validation/simulation (NumPy, Pandas, SciPy or equivalents)
• Ability to evaluate solutions for correctness, assumptions, constraints, and edge cases
• Experience with structured evaluation/scoring of multi-step reasoning problems
• Comfortable improving explanations/reasoning to align with industry-standard logic
• Familiarity with at least one additional language/tooling (e.g., MATLAB, R, C/C++, SQL, domain-specific libraries) is a plus
• Professional certifications (e.g., SAS, CAP, or similar) and international/applied project experience are a plus
• Written English at C1+ level (or equivalent): clear technical writing and feedback
• Availability to contribute ~10–20 hours/week during active project phases (project-based; not permanent)