Frank Kimani

Key Skills

Software

Scale AI

Appen

Sama

Top Subject Matter

LLM evaluation

Rlhf Domain Expertise

Red-teaming Domain Expertise

Top Data Types

Text

Image

Audio

Document

Top Task Types

RLHF

Entity (NER) Classification

Bounding Box

Freelancer Overview

Senior AI Trainer & RLHF Specialist (Scale AI). Brings 4+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI, Appen, and Sama. Education includes Bachelor of Science, Catholic University of Eastern Africa (2017) and Kenya Certificate of Secondary Education, Githumu Boys High School (2016). AI-training focus includes data types such as Text, Image, and Audio and labeling workflows including RLHF, Entity (NER) Classification, and Bounding Box.

Labeling Experience

Senior AI Trainer & RLHF Specialist (Scale AI)

Scale AITextRLHF

As a Senior AI Trainer & RLHF Specialist at Scale AI, I provided expert human feedback to improve large language model (LLM) outputs. My tasks included ranking model responses, red-teaming, and multilingual evaluation for English and Swahili. I also oversaw junior annotators and maintained high inter-annotator agreement scores. • Trained and fine-tuned models using RLHF and RLAIF frameworks • Ranked model responses for factual accuracy, safety, and instruction-following • Probed model weaknesses through red-teaming and adversarial prompts • Contributed to multilingual evaluation pipelines for East African markets

As a Senior AI Trainer & RLHF Specialist at Scale AI, I provided expert human feedback to improve large language model (LLM) outputs. My tasks included ranking model responses, red-teaming, and multilingual evaluation for English and Swahili. I also oversaw junior annotators and maintained high inter-annotator agreement scores. • Trained and fine-tuned models using RLHF and RLAIF frameworks • Ranked model responses for factual accuracy, safety, and instruction-following • Probed model weaknesses through red-teaming and adversarial prompts • Contributed to multilingual evaluation pipelines for East African markets

2024 - Present

AI Data Annotation Lead (Appen)

AppenTextEntity Ner Classification

As AI Data Annotation Lead at Appen, I managed a team annotating large-scale NER and text classification projects. I designed annotation guidelines, QA protocols, and trained new annotators in best practices. I also managed multiple projects using internal platforms. • Led NER, sentiment analysis, and intent detection labeling • Designed and implemented annotation schemas and guidelines • Performed regular QA audits and feedback loops • Trained recruits on annotation practices and tool proficiency

As AI Data Annotation Lead at Appen, I managed a team annotating large-scale NER and text classification projects. I designed annotation guidelines, QA protocols, and trained new annotators in best practices. I also managed multiple projects using internal platforms. • Led NER, sentiment analysis, and intent detection labeling • Designed and implemented annotation schemas and guidelines • Performed regular QA audits and feedback loops • Trained recruits on annotation practices and tool proficiency

2023 - 2023

Data Annotator & Quality Assurance Specialist (Sama/Samasource)

SamaImageBounding Box

At Sama, I annotated multimodal datasets including images, videos, and text for computer vision and NLP pipelines. I reviewed peer annotations for quality assurance and participated in weekly quality reports. I coordinated communication between clients and annotation teams. • Labeled image bounding boxes and video frame segmentation • Conducted QA and escalated annotation inconsistencies • Maintained detailed annotation metrics and logs • Coordinated project communication with international clients

At Sama, I annotated multimodal datasets including images, videos, and text for computer vision and NLP pipelines. I reviewed peer annotations for quality assurance and participated in weekly quality reports. I coordinated communication between clients and annotation teams. • Labeled image bounding boxes and video frame segmentation • Conducted QA and escalated annotation inconsistencies • Maintained detailed annotation metrics and logs • Coordinated project communication with international clients

2022 - 2022

Linguistic Data Evaluator (Defined.ai)

Audio

As a Linguistic Data Evaluator at Defined.ai, I evaluated AI-generated speech transcriptions and chatbot dialogue flows for East African English variants. I annotated intent, slot filling, and entity extraction, flagging bias-prone outputs for fairness improvement. I also developed internal evaluation templates for TTS and ASR quality. • Evaluated linguistic naturalness and semantic accuracy of generated outputs • Labeled intent, slot, and entity in conversational AI datasets • Flagged outputs for ethical and fairness review • Developed templates for TTS and ASR output assessment

As a Linguistic Data Evaluator at Defined.ai, I evaluated AI-generated speech transcriptions and chatbot dialogue flows for East African English variants. I annotated intent, slot filling, and entity extraction, flagging bias-prone outputs for fairness improvement. I also developed internal evaluation templates for TTS and ASR quality. • Evaluated linguistic naturalness and semantic accuracy of generated outputs • Labeled intent, slot, and entity in conversational AI datasets • Flagged outputs for ethical and fairness review • Developed templates for TTS and ASR output assessment

2021 - 2022

Education

Work History