For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
Benjamin Pawlowski

Benjamin Pawlowski

AI Content Annotator & LLM Evaluator | Mechanical Engineer with Analytical

USA flagSan Ramon, Usa
$20.00/hrExpertAws SagemakerAppenData Annotation Tech

Key Skills

Software

AWS SageMakerAWS SageMaker
AppenAppen
Data Annotation TechData Annotation Tech
Label StudioLabel Studio
ProdigyProdigy
RemotasksRemotasks
Scale AIScale AI
Surge AISurge AI
TelusTelus
Other

Top Subject Matter

No subject matter listed

Top Data Types

AudioAudio
DocumentDocument
TextText

Top Task Types

Entity Ner Classification
Evaluation Rating
Prompt Response Writing SFT
Text Generation
Translation Localization

Freelancer Overview

Analytical and dependable AI Data Annotator and Content Evaluator with 3+ years of experience supporting the training and evaluation of large language models (LLMs). I specialize in text-based annotation, quality assurance, and factual evaluation of AI-generated content. My work focuses on enhancing model accuracy, coherence, and safety through structured prompt-response testing and systematic QA processes. With a Master’s degree in Mechanical Engineering and a strong foundation in data analysis, I bring precision, logic, and problem-solving skills to every annotation task. I’ve worked on diverse projects including text classification, summarization, transcription, and financial data labeling. I excel at applying detailed guidelines consistently across large datasets, identifying quality issues, and providing constructive insights that help refine AI models.

ExpertKoreanEnglish

Labeling Experience

Scale AI

LLM Text Evaluation and Prompt-Response Annotation

Scale AITextQuestion AnsweringText Generation
Worked on evaluation and refinement of AI-generated text for LLM fine-tuning and performance improvement. Tasks included assessing factual accuracy, tone, coherence, and compliance with guidelines. Conducted A/B testing and rated prompt-response pairs for contextual understanding and instruction adherence. Ensured labeling accuracy and consistency through structured QA checks.

Worked on evaluation and refinement of AI-generated text for LLM fine-tuning and performance improvement. Tasks included assessing factual accuracy, tone, coherence, and compliance with guidelines. Conducted A/B testing and rated prompt-response pairs for contextual understanding and instruction adherence. Ensured labeling accuracy and consistency through structured QA checks.

2020 - 2025
Prodigy

Text and Document Annotation for NLP Model Training

ProdigyDocumentEntity Ner ClassificationClassification
Labeled text and document datasets for classification, summarization, and named entity recognition tasks. Maintained strict adherence to annotation guidelines to ensure data consistency and model-ready quality. Collaborated in QA reviews and documentation of labeling standards.

Labeled text and document datasets for classification, summarization, and named entity recognition tasks. Maintained strict adherence to annotation guidelines to ensure data consistency and model-ready quality. Collaborated in QA reviews and documentation of labeling standards.

2019 - 2025

Audio Transcription and Text QA for Speech Recognition Systems

OtherAudioTranslation LocalizationEvaluation Rating
Transcribed and labeled large volumes of English audio data for AI speech model training. Reviewed and corrected machine-generated transcripts for contextual and grammatical accuracy. Ensured precision alignment between text and spoken content, adhering to strict formatting and timestamping requirements.

Transcribed and labeled large volumes of English audio data for AI speech model training. Reviewed and corrected machine-generated transcripts for contextual and grammatical accuracy. Ensured precision alignment between text and spoken content, adhering to strict formatting and timestamping requirements.

2018 - 2025

Education

C

Colorado State University

Master of Science, Mechanical Engineering

Master of Science
2017 - 2019

Work History

S

Self-Employed / Remote

Freelance AI Content Evaluator and Data Annotator

Remote
2018 - Present
F

Freelance

Accounting/Financial Data Assistant

remote
2017 - 2025