Erick Kimeu

Key Skills

Software

Scale AI

Remotasks

Appen

Mercor

Top Subject Matter

Large Language Models

AI Safety

Truthfulness Domain Expertise

Top Data Types

Text

Document

Top Task Types

RLHF

Freelancer Overview

AI Training Initiative (Project Hedgehog). Brings 1+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI, Remotasks, and Appen. Education includes Bachelor of Science, KCA University. AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

AI Training Initiative (Project Hedgehog)

Scale AITextRLHF

As a participant in Project Hedgehog, I contributed to advanced data annotation and AI alignment for large language models. My work involved taxonomy development, complex labeling, and the creation of datasets designed for safety and truthfulness. I ensured model refinement through rigorous evaluation against established benchmarks. • Conducted content moderation and policy compliance checks. • Audited and fact-checked LLM outputs for safety and accuracy. • Developed nuanced annotation taxonomies for AI performance measurement. • Used multiple labeling platforms including Scale AI and Remotasks.

As a participant in Project Hedgehog, I contributed to advanced data annotation and AI alignment for large language models. My work involved taxonomy development, complex labeling, and the creation of datasets designed for safety and truthfulness. I ensured model refinement through rigorous evaluation against established benchmarks. • Conducted content moderation and policy compliance checks. • Audited and fact-checked LLM outputs for safety and accuracy. • Developed nuanced annotation taxonomies for AI performance measurement. • Used multiple labeling platforms including Scale AI and Remotasks.

2025 - Present

AI Content Evaluator

MercorText

At Mercor AI, I served as an AI Content Evaluator with a focus on reinforcing LLM instruction-following through RLHF implementation. I was responsible for providing human feedback, triple-verified output audits, and maintaining high dataset fidelity. My role also included benchmarking LLM performance and auditing outputs for factual accuracy and safety. • Provided structured feedback on LLM responses for quality improvement. • Performed in-depth safety and truthfulness moderation of AI-generated text. • Leveraged multiple annotation platforms to audit, rank, and score model outputs. • Collaborated with cross-functional AI teams to define evaluation standards.

At Mercor AI, I served as an AI Content Evaluator with a focus on reinforcing LLM instruction-following through RLHF implementation. I was responsible for providing human feedback, triple-verified output audits, and maintaining high dataset fidelity. My role also included benchmarking LLM performance and auditing outputs for factual accuracy and safety. • Provided structured feedback on LLM responses for quality improvement. • Performed in-depth safety and truthfulness moderation of AI-generated text. • Leveraged multiple annotation platforms to audit, rank, and score model outputs. • Collaborated with cross-functional AI teams to define evaluation standards.

2025 - 2026

Education

Work History