For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
J
Julien Desvignes

Julien Desvignes

AI Response Evaluator (RLHF) | LLM Quality & Ranking Specialist

Canada flagN/A, Canada
$28.00/hrIntermediateData Annotation TechLabelboxOneforma

Key Skills

Software

Data Annotation TechData Annotation Tech
LabelboxLabelbox
OneFormaOneForma
MindriftMindrift
RemotasksRemotasks

Top Subject Matter

AI / LLM Content Evaluation
Finance – Trading & Market Analysis
Aviation – Technical Procedures & Safety

Top Data Types

TextText
DocumentDocument
VideoVideo

Top Task Types

RLHFRLHF
Text SummarizationText Summarization
Question AnsweringQuestion Answering
Evaluation/RatingEvaluation/Rating
Data CollectionData Collection
TranscriptionTranscription
Prompt + Response Writing (SFT)Prompt + Response Writing (SFT)
Text GenerationText Generation
ClassificationClassification

Freelancer Overview

AI Response Evaluator / Quality Assessment. Brings 5+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include N and A. Education includes Private Pilot License To Commercial Pilot License Pathway, N/A. AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

IntermediateEnglishFrenchSpanishRussian

Labeling Experience

Data Evaluator

TextEvaluation Rating
Worked as a Data Evaluator focusing on AI model response assessment and ranking (RLHF-based workflows). Reviewed and evaluated large volumes of text outputs for accuracy, logical consistency, instruction adherence, and overall response quality. Conducted side-by-side comparisons of multiple AI-generated responses and provided structured justifications for rankings. Identified hallucinations, factual inaccuracies, and reasoning flaws across general knowledge, finance, and technical domains. Applied detailed annotation guidelines and maintained high consistency across tasks. Demonstrated strong analytical thinking, attention to detail, and efficiency while handling repetitive evaluation tasks at scale. Contributed to improving model performance through high-quality feedback and scoring.

Worked as a Data Evaluator focusing on AI model response assessment and ranking (RLHF-based workflows). Reviewed and evaluated large volumes of text outputs for accuracy, logical consistency, instruction adherence, and overall response quality. Conducted side-by-side comparisons of multiple AI-generated responses and provided structured justifications for rankings. Identified hallucinations, factual inaccuracies, and reasoning flaws across general knowledge, finance, and technical domains. Applied detailed annotation guidelines and maintained high consistency across tasks. Demonstrated strong analytical thinking, attention to detail, and efficiency while handling repetitive evaluation tasks at scale. Contributed to improving model performance through high-quality feedback and scoring.

2024 - Present

AI Response Evaluator / Quality Assessment

Text
Evaluated written responses for clarity, logic, and accuracy in AI-related workflows. Identified inconsistencies and selected the most relevant answers following complex guidelines. Maintained high standards of precision and consistency while working independently. • Assessed large volumes of written responses with attention to detail • Followed structured evaluation procedures in both English and French • Worked consistently on repetitive analytical tasks • Ensured reliable quality across all assigned evaluations

Evaluated written responses for clarity, logic, and accuracy in AI-related workflows. Identified inconsistencies and selected the most relevant answers following complex guidelines. Maintained high standards of precision and consistency while working independently. • Assessed large volumes of written responses with attention to detail • Followed structured evaluation procedures in both English and French • Worked consistently on repetitive analytical tasks • Ensured reliable quality across all assigned evaluations

Not specified

Education

N

N/A

Private Pilot License To Commercial Pilot License Pathway, Pilot Training

Private Pilot License To Commercial Pilot License Pathway
Not specified

Work History

N

N/A

Bartender and Customer Service Representative

N/A
2022 - Present