Evelyn Albert

Key Skills

Software

Scale AI

Labelbox

Top Subject Matter

Conversational AI

Generative AI

Text Classification

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Freelancer Overview

AI Training Specialist & Data Annotator, DataLoop AI Solutions. Brings 1+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI, Labelbox, and Internal. Education includes National Diploma, Kenule-Beeson Polytechnic and Professional Certificate, Coursera / Google (2023). AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

AI Training Specialist & Data Annotator, DataLoop AI Solutions

Scale AITextRLHF

Oversaw data annotation and evaluation processes for generative AI and NLP applications, focusing on both text and images. Performed RLHF cycles, rating AI responses for accuracy and helpfulness, and conducted red-teaming for bias and policy violations. Developed annotation guides and standard operating procedures, collaborating directly with machine learning engineers to resolve ambiguous cases. • Specialized in evaluating conversational AI in English and Nigerian Pidgin across multiple domains. • Used Scale AI, Labelbox, and internal tools for high-volume data annotation tasks exceeding 120,000 samples monthly. • Produced structured quality reports detailing findings, errors, and policy issues in model outputs. • Led calibration and guideline refinement efforts to reduce inter-annotator disagreement and boost data quality.

Oversaw data annotation and evaluation processes for generative AI and NLP applications, focusing on both text and images. Performed RLHF cycles, rating AI responses for accuracy and helpfulness, and conducted red-teaming for bias and policy violations. Developed annotation guides and standard operating procedures, collaborating directly with machine learning engineers to resolve ambiguous cases. • Specialized in evaluating conversational AI in English and Nigerian Pidgin across multiple domains. • Used Scale AI, Labelbox, and internal tools for high-volume data annotation tasks exceeding 120,000 samples monthly. • Produced structured quality reports detailing findings, errors, and policy issues in model outputs. • Led calibration and guideline refinement efforts to reduce inter-annotator disagreement and boost data quality.

2023 - Present

Data Quality Analyst, TechBridge Africa

Text

Conducted quality assurance reviews of annotated datasets created for NLP and multi-class classification projects. Designed evaluation benchmarks for text summarization and NER models and produced performance summaries shared with clients. Monitored and improved annotation team performance using productivity tracking and agreement metrics. • Utilized Excel-based dashboards to track productivity and label distribution and performed systematic error analysis. • Developed ground-truth evaluation tasks and ensured client SLAs were met on delivery times. • Managed annotation task backlogs using Trello and Asana for streamlined workflow. • Provided actionable feedback to distributed annotators to enhance consistency and accuracy.

Conducted quality assurance reviews of annotated datasets created for NLP and multi-class classification projects. Designed evaluation benchmarks for text summarization and NER models and produced performance summaries shared with clients. Monitored and improved annotation team performance using productivity tracking and agreement metrics. • Utilized Excel-based dashboards to track productivity and label distribution and performed systematic error analysis. • Developed ground-truth evaluation tasks and ensured client SLAs were met on delivery times. • Managed annotation task backlogs using Trello and Asana for streamlined workflow. • Provided actionable feedback to distributed annotators to enhance consistency and accuracy.

2022 - 2022

Education

Work History