For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
A

Ayo Amodu

LLM Evaluator

Nigeria flagLagos, Nigeria
ExpertLabel StudioLabelboxAppen

Key Skills

Software

Label StudioLabel Studio
LabelboxLabelbox
AppenAppen
CVATCVAT
SuperviselySupervisely
LabelImgLabelImg

Top Subject Matter

LLM Evaluation
Machine Learning
Ai/ml Domain Expertise

Top Data Types

TextText
ImageImage
DocumentDocument

Top Task Types

ClassificationClassification

Freelancer Overview

LLM Evaluator. Brings 11+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Label Studio, Google Sheets, and Labelbox. Education includes Bachelor of Science, Obafemi Awolowo University (2015). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Classification.

Expert

Labeling Experience

Label Studio

LLM Evaluator

Label StudioText
As an LLM Evaluator at Populii, I manually assessed model responses for accuracy, coherence, relevance, and safety across various language tasks. I provided preference labels (RLHF) and contributed to evaluation rubrics designed to enhance LLM fine-tuning and reduce hallucinations. My efforts included detailed documentation of biases, unsafe outputs, and feedback for engineering optimization. • Evaluated model response quality for summarization and question answering. • Used LabelStudio and Google Sheets to monitor safety and document outputs. • Developed and iterated evaluation guidelines with Labelbox. • Collaborated with ML engineers to recommend prompt improvements.

As an LLM Evaluator at Populii, I manually assessed model responses for accuracy, coherence, relevance, and safety across various language tasks. I provided preference labels (RLHF) and contributed to evaluation rubrics designed to enhance LLM fine-tuning and reduce hallucinations. My efforts included detailed documentation of biases, unsafe outputs, and feedback for engineering optimization. • Evaluated model response quality for summarization and question answering. • Used LabelStudio and Google Sheets to monitor safety and document outputs. • Developed and iterated evaluation guidelines with Labelbox. • Collaborated with ML engineers to recommend prompt improvements.

2026 - 2026
Appen

Data Annotator | Data Encoder | AI Data Trainer | Search Engine Evaluator

AppenTextClassification
At Appen, I analyzed and annotated large volumes of textual and visual data to train machine learning models. Tasks included metatagging, image and text classification, and comparison of chatbot Q&A for accuracy and safety. I performed 3D cuboid and LiDAR annotation, speech transcription, and actively participated in the improvement of annotation procedures and quality feedback. • Labeled image and text datasets for model training. • Conducted speech transcription and classification of audio data. • Compared chatbot responses for factuality and appropriateness. • Utilized a variety of data annotation tools and software platforms.

At Appen, I analyzed and annotated large volumes of textual and visual data to train machine learning models. Tasks included metatagging, image and text classification, and comparison of chatbot Q&A for accuracy and safety. I performed 3D cuboid and LiDAR annotation, speech transcription, and actively participated in the improvement of annotation procedures and quality feedback. • Labeled image and text datasets for model training. • Conducted speech transcription and classification of audio data. • Compared chatbot responses for factuality and appropriateness. • Utilized a variety of data annotation tools and software platforms.

2019 - 2025

Education

O

Obafemi Awolowo University

Bachelor of Science, Psychology

Bachelor of Science
2010 - 2015

Work History

F

Fiverr

Freelance Writer

Lagos
2016 - Present