For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
J

Joshua Sure

AI Training & Evaluation – Project Diamond (Handshake AI)

United Kingdom flagLondon, United Kingdom
$30.00/hrExpertData Annotation TechCloudfactoryClickworker

Key Skills

Software

Data Annotation TechData Annotation Tech
CloudFactoryCloudFactory
ClickworkerClickworker
AppenAppen
Label StudioLabel Studio
MercorMercor
Micro1
MindriftMindrift
RemotasksRemotasks
SuperAnnotateSuperAnnotate
TolokaToloka
AWS SageMakerAWS SageMaker
CVATCVAT

Top Subject Matter

Conversational AI/LLM Evaluation
Legal Services & Contract Review
Regulatory Compliance & Risk Analysis

Top Data Types

TextText
DocumentDocument
ImageImage

Top Task Types

Prompt Response Writing SFT
Evaluation Rating
Transcription
RLHF
Question Answering
Computer Programming Coding
Data Collection

Freelancer Overview

AI Training & Evaluation – Project Diamond (Handshake AI). Brings 5+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal and Proprietary Tooling. Education includes Doctor of Philosophy, MIT (2022) and Master of Science, MIT (2022). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

ExpertEnglish

Labeling Experience

AI Training & Evaluation – Project Diamond (Handshake AI)

Text
For Project Diamond (Handshake AI), I annotated and evaluated AI-generated responses for accuracy and guideline adherence. My work involved assessing AI responses to ensure consistency and high-quality outputs within conversational applications. I regularly used evaluation protocols to enhance model reliability and user experience. • Evaluated and rated thousands of AI-generated text responses. • Ensured responses met detailed guidelines on correctness and tone. • Identified systematic issues and provided suggestions for improvement. • Maintained comprehensive records and reported analytics to project leads.

For Project Diamond (Handshake AI), I annotated and evaluated AI-generated responses for accuracy and guideline adherence. My work involved assessing AI responses to ensure consistency and high-quality outputs within conversational applications. I regularly used evaluation protocols to enhance model reliability and user experience. • Evaluated and rated thousands of AI-generated text responses. • Ensured responses met detailed guidelines on correctness and tone. • Identified systematic issues and provided suggestions for improvement. • Maintained comprehensive records and reported analytics to project leads.

2023 - Present

Education

M

MIT

Master of Science, Software Engineering

Master of Science
2020 - 2022
M

MIT

Bachelor of Science, Software Engineering

Bachelor of Science
2016 - 2020

Work History

R

Remote

AI & Software Engineer

London
2023 - Present
R

Remote

Machine Learning Engineer

London
2022 - 2023