Felicia Stanley

Key Skills

Software

Appen

Labelbox

Lionbridge

Micro1

OneForma

Remotasks

Scale AI

Other

Internal/Proprietary Tooling

Top Subject Matter

Large Language Models

Multimodal AI

AI Model Evaluation & Prompt Engineering

Top Data Types

Text

Video

Document

Top Task Types

RLHF

Bounding Box

Segmentation

Classification

Object Detection

Text Generation

Question Answering

Text Summarization

Fine Tuning

Transcription

Evaluation Rating

Data Collection

Prompt Response Writing SFT

Freelancer Overview

Pod Leader & Auditor (Mercor AI, Contractor). Brings 6+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Mercor, Outlier AI, and TELUS Digital. Education includes Bachelor of Science, Liberty University (Online) (2020) and Professional Certificate, Coursera (2023). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and RLHF.

Labeling Experience

Pod Leader & Auditor (Mercor AI, Contractor)

MercorText

Led quality review and auditing processes for AI labeling tasks, focusing on both LLM and multimodal model outputs. Reviewed, rated, and corrected outputs generated by contributors and subject matter experts, ensuring alignment with defined guidelines and accuracy standards. Delivered detailed feedback and actionable coaching to enhance overall data labeling quality. • Conducted second-level quality audits before final client delivery. • Collaborated in performance trend analysis to refine and uphold evolving quality benchmarks. • Created educational and training materials to improve process alignment. • Applied expertise to complex OCR and image-based annotation tasks.

Led quality review and auditing processes for AI labeling tasks, focusing on both LLM and multimodal model outputs. Reviewed, rated, and corrected outputs generated by contributors and subject matter experts, ensuring alignment with defined guidelines and accuracy standards. Delivered detailed feedback and actionable coaching to enhance overall data labeling quality. • Conducted second-level quality audits before final client delivery. • Collaborated in performance trend analysis to refine and uphold evolving quality benchmarks. • Created educational and training materials to improve process alignment. • Applied expertise to complex OCR and image-based annotation tasks.

2025 - Present

Contributor—Multimodal AI Training Projects

TextRLHF

Executed prompt engineering, annotation, and reinforcement learning by providing human feedback on AI model outputs for language, vision, and audio tasks. Evaluated and labeled multimodal outputs, identifying errors and guiding model improvements through detailed notes and rationales. Applied strict safety, quality, and performance standards to all labeled content. • Evaluated data accuracy and adherence to detailed prompts. • Labeled errors and created rationales for AI output refinement. • Collaborated with QA and annotation teams for project alignment. • Fostered reliability and performance in multimodal training data.

Executed prompt engineering, annotation, and reinforcement learning by providing human feedback on AI model outputs for language, vision, and audio tasks. Evaluated and labeled multimodal outputs, identifying errors and guiding model improvements through detailed notes and rationales. Applied strict safety, quality, and performance standards to all labeled content. • Evaluated data accuracy and adherence to detailed prompts. • Labeled errors and created rationales for AI output refinement. • Collaborated with QA and annotation teams for project alignment. • Fostered reliability and performance in multimodal training data.

2024 - Present

Alignerr Contractor

AudioData Collection

I followed pre-written prompts that I read aloud with instructed emotion using a high-quality microphone.

I followed pre-written prompts that I read aloud with instructed emotion using a high-quality microphone.

2025 - 2025

Search Quality Rater (TELUS Digital)

TelusTextEvaluation Rating

Reviewed, rated, and provided relevance feedback for search engines and AI-generated text results. Ensured quality of labeled web pages, images, and multimedia for training large AI models. Maintained rigorous performance standards to support high-accuracy search and data labeling initiatives. • Applied detailed safety and relevance criteria to all outputs. • Used proprietary internal tools to perform data labeling tasks. • Documented labeling procedures for ongoing projects. • Collaborated with global QA and research teams to support continuous improvement.

Reviewed, rated, and provided relevance feedback for search engines and AI-generated text results. Ensured quality of labeled web pages, images, and multimedia for training large AI models. Maintained rigorous performance standards to support high-accuracy search and data labeling initiatives. • Applied detailed safety and relevance criteria to all outputs. • Used proprietary internal tools to perform data labeling tasks. • Documented labeling procedures for ongoing projects. • Collaborated with global QA and research teams to support continuous improvement.

2020 - 2025

Education

Work History