For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
James Lahoda

James Lahoda

LLM Evaluation and Text Generation Specialist in English

USA flag
Panama City, Usa
$25.00/hrExpertClickworkerRemotasksOther

Key Skills

Software

ClickworkerClickworker
RemotasksRemotasks
Other
Scale AIScale AI

Top Subject Matter

No subject matter listed

Top Data Types

AudioAudio
ImageImage
TextText

Top Label Types

Data Collection
Evaluation Rating
Prompt Response Writing SFT
Red Teaming
RLHF

Freelancer Overview

I have worked on many projects in AI training, including both completing tasks and reviewing others' work for quality being submitted to clients. My experience includes both basic LLM response rating as well as more complex prompt writing, rubric design, and response writing. I've contributed to tasks in voice and music recognition, as well as text and image evaluation and classification.

ExpertEnglish

Labeling Experience

Scale AI

Side By Side Response Evaluation

Scale AITextText GenerationText Summarization
Evaluate 2 LLM responses to the same prompt and rate them individually. Then rate and select which was the better response, and write a justification for my choice.

Evaluate 2 LLM responses to the same prompt and rate them individually. Then rate and select which was the better response, and write a justification for my choice.

2025 - 2025
Scale AI

Rubric writing and evaluation

Scale AITextText GenerationRLHF
Large project creating full data sets for LLMs. Created up to 3 prompts, a core model prompt, categorization prompt as well as user prompt. The prompts had to be complex to cause 2 models to fail. Would then write a rubric based on the 3 prompts. I would then evaluate the 2 models based on the rubric I created to give them scores and select which one did better. I would then write the perfect response based on the rubric.

Large project creating full data sets for LLMs. Created up to 3 prompts, a core model prompt, categorization prompt as well as user prompt. The prompts had to be complex to cause 2 models to fail. Would then write a rubric based on the 3 prompts. I would then evaluate the 2 models based on the rubric I created to give them scores and select which one did better. I would then write the perfect response based on the rubric.

2025 - 2025
Scale AI

Audio Prompt Recording and Transcription

Scale AIAudioAudio RecordingTranscription
Recorded audio prompts for specified categories. The LLM would transcribe what was heard and I would correct the transcription as needed.

Recorded audio prompts for specified categories. The LLM would transcribe what was heard and I would correct the transcription as needed.

2025 - 2025
Scale AI

Music Recognition

Scale AIAudioEvaluation Rating
I was a reviewer/QA on this project. The AI gave suggestions of what instruments and voices were heard, and an agent then corrected it and transcribed it accurately. I verified the information and corrected the work again.

I was a reviewer/QA on this project. The AI gave suggestions of what instruments and voices were heard, and an agent then corrected it and transcribed it accurately. I verified the information and corrected the work again.

2025 - 2025

Education

A

Arm Senior Secondary School

High School Diploma, Highschool

High School Diploma
2002 - 2004

Work History

S

Self-Employed

Independent Contractor

Around Florida
2017 - 2023
C

CSS Corp

Customer Care Representative (Technical Support)

Salt Lake City
2016 - 2017