For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
A
Amanda Bullis

Amanda Bullis

AI Writer and Evaluator, Contract

USA flagSan Jose, Usa
$27.00/hrExpertImeritRemotasksScale AI

Key Skills

Software

iMeritiMerit
RemotasksRemotasks
Scale AIScale AI

Top Subject Matter

AI model content evaluation
LLM training
Multimodal Reasoning

Top Data Types

TextText
ImageImage
DocumentDocument

Top Task Types

Bounding BoxBounding Box
RLHFRLHF
Fine-tuningFine-tuning
TranscriptionTranscription
Evaluation/RatingEvaluation/Rating
Prompt + Response Writing (SFT)Prompt + Response Writing (SFT)
Entity (NER) ClassificationEntity (NER) Classification
Text GenerationText Generation
Object DetectionObject Detection
Text SummarizationText Summarization

Freelancer Overview

AI Writer and Evaluator with 2+ years of professional experience across Retrieval-Augmented Generation (RAG), Auditing/Peer Evaluation, Reinforcement Learning From Human Feedback (RLHF), Advanced Annotation, etc, with background in UX/UI, Economics, and QA Testing. Education includes Certificate in Advanced Data Analytics, Google (2025), and Master of Research in Economics, University of Exeter (2018). Core strengths include creativity, attention to detail, and devotion to accuracy.

ExpertEnglishFrench

Labeling Experience

AI Writer and Evaluator, Contract

Text
As an AI Writer and Evaluator, I audited retrieval-augmented generation (RAG) outputs for accuracy, quality, and grounding in reference texts. I evaluated team content, provided actionable feedback, revised responses using domain expertise, and crafted complex, image-based prompts to test model reasoning. I contributed to supervised fine-tuning (SFT), rated and ranked outputs per reinforcement learning from human feedback (RLHF), and annotated intricate images with comprehensive descriptions in limited timeframes. • Assessed and refined both text and image AI-generated content. • Composed prompts targeting multimodal and general instruction-following abilities. • Provided feedback for team improvement and SFT processes. • Created high-quality annotations under strict time constraints.

As an AI Writer and Evaluator, I audited retrieval-augmented generation (RAG) outputs for accuracy, quality, and grounding in reference texts. I evaluated team content, provided actionable feedback, revised responses using domain expertise, and crafted complex, image-based prompts to test model reasoning. I contributed to supervised fine-tuning (SFT), rated and ranked outputs per reinforcement learning from human feedback (RLHF), and annotated intricate images with comprehensive descriptions in limited timeframes. • Assessed and refined both text and image AI-generated content. • Composed prompts targeting multimodal and general instruction-following abilities. • Provided feedback for team improvement and SFT processes. • Created high-quality annotations under strict time constraints.

2023 - Present

AI Model Beta Tester, Freelance

Text
As an AI Model Beta Tester, I thoroughly assessed a pre-release AI model focusing on accuracy, usability, and user experience. I delivered detailed feedback, highlighting core challenges and offering constructive recommendations to improve model performance. My work emphasized qualitative assessment and practical testing of advanced AI systems. • Evaluated model functionality in diverse scenarios. • Prioritized usability and user experience in testing. • Delivered comprehensive feedback on observed issues. • Contributed to the refinement cycle before model release.

As an AI Model Beta Tester, I thoroughly assessed a pre-release AI model focusing on accuracy, usability, and user experience. I delivered detailed feedback, highlighting core challenges and offering constructive recommendations to improve model performance. My work emphasized qualitative assessment and practical testing of advanced AI systems. • Evaluated model functionality in diverse scenarios. • Prioritized usability and user experience in testing. • Delivered comprehensive feedback on observed issues. • Contributed to the refinement cycle before model release.

2025 - 2026

Education

G

Google

Certificate in Advanced Data Analytics, Data Analytics

Certificate in Advanced Data Analytics
2025 - 2025
C

CareerFoundry

Certificate in User Interface Design, User Interface Design

Certificate in User Interface Design
2022 - 2022

Work History

O

Outlier

AI Writer and Evaluator

San Jose
2023 - Present
F

Freelance

AI Model Beta Tester

San Jose
2025 - 2026