Nereah Oduor

Key Skills

Software

Other

Scale AI

Top Subject Matter

No subject matter listed

Top Data Types

Image

Text

Audio

Top Label Types

Bounding Box

Question Answering

Object Detection

Tracking

Evaluation Rating

Text Generation

Text Summarization

Fine Tuning

Classification

Audio Recording

Freelancer Overview

I have hands‑on experience in AI training data and annotation, working across platforms like RWS Diamond, Outlier, Remotasks, and GoTranscript. I’ve contributed to projects involving LLM evaluation, adversarial prompt design, multi‑turn dialogue creation, search relevance rating, and multimodal data labeling for text, images, audio, and 3D environments. My work focuses on assessing model accuracy, coherence, safety, and emotional intelligence while generating high‑quality prompts and realistic persona‑driven conversations. What sets me apart is the analytical precision I bring from over a decade in audit roles at Grant Thornton and KPMG. I’m skilled at interpreting complex guidelines, identifying inconsistencies, analyzing large datasets, and documenting findings clearly — strengths that directly enhance the quality and reliability of the AI training data I produce.

Labeling Experience

LLM Rater & Prompt Designer

OtherTextQuestion AnsweringText Generation

As an LLM Rater & Prompt Designer at Outlier, I created adversarial prompts and persona-based dialogues. I ranked model outputs and documented failure modes, focusing on model evaluation. I also tested for emotional intelligence, reasoning, and instruction-following capabilities in LLMs. • Specialized in red teaming and adversarial testing of LLMs. • Developed persona simulations and prompt engineering tasks. • Used the Outlier interface for model evaluation and documentation. • Provided detailed feedback on model performance.

As an LLM Rater & Prompt Designer at Outlier, I created adversarial prompts and persona-based dialogues. I ranked model outputs and documented failure modes, focusing on model evaluation. I also tested for emotional intelligence, reasoning, and instruction-following capabilities in LLMs. • Specialized in red teaming and adversarial testing of LLMs. • Developed persona simulations and prompt engineering tasks. • Used the Outlier interface for model evaluation and documentation. • Provided detailed feedback on model performance.

2024

AI Trainer

OtherImageBounding BoxQuestion Answering

As an AI Trainer at RWS Diamond, I evaluated multi-turn AI conversations for accuracy, coherence, and safety. I rated search relevance and webpage quality and conducted sentiment, intent, and toxicity labelling. I also performed annotation of text, images, and audio, along with conducting QA reviews for dataset consistency. • Evaluated emotional intelligence, reasoning, and instruction-following in AI outputs. • Identified hallucinations, inconsistencies, and policy violations in datasets. • Used RWS rating tools for AI evaluation and annotation tasks. • Annotated for both NLP and computer vision projects.

As an AI Trainer at RWS Diamond, I evaluated multi-turn AI conversations for accuracy, coherence, and safety. I rated search relevance and webpage quality and conducted sentiment, intent, and toxicity labelling. I also performed annotation of text, images, and audio, along with conducting QA reviews for dataset consistency. • Evaluated emotional intelligence, reasoning, and instruction-following in AI outputs. • Identified hallucinations, inconsistencies, and policy violations in datasets. • Used RWS rating tools for AI evaluation and annotation tasks. • Annotated for both NLP and computer vision projects.

2024

Transcription Specialist

OtherAudioAudio Recording

As a Transcription Specialist at Go Transcript, I transcribed multi-speaker audio files with high accuracy and adherence to style guidelines. I applied speaker segmentation and ensured clarity in textual conversions. My work contributed to high-quality datasets for audio processing projects. • Utilized GoTranscript editor for precise transcription and labeling tasks. • Maintained accuracy in transcribing diverse audio content. • Followed strict transcription protocols for quality control. • Supported dataset development for natural language processing tasks.

As a Transcription Specialist at Go Transcript, I transcribed multi-speaker audio files with high accuracy and adherence to style guidelines. I applied speaker segmentation and ensured clarity in textual conversions. My work contributed to high-quality datasets for audio processing projects. • Utilized GoTranscript editor for precise transcription and labeling tasks. • Maintained accuracy in transcribing diverse audio content. • Followed strict transcription protocols for quality control. • Supported dataset development for natural language processing tasks.

2023

Data Annotator

Scale AITextClassification

As a Data Annotator for Remo tasks, I performed annotation on text, images, and audio data for NLP and computer vision projects. My work involved sentiment analysis, intent recognition, and toxicity classification, as well as comprehensive QA checks. I ensured dataset accuracy through detailed, multi-modal annotation and quality review. • Annotated data using the Remotasks platform for diverse use cases. • Focused on both linguistic and visual data types in labeling tasks. • Supported large-scale training datasets through rigorous quality checks. • Acted as a reviewer for dataset consistency and reliability.

As a Data Annotator for Remo tasks, I performed annotation on text, images, and audio data for NLP and computer vision projects. My work involved sentiment analysis, intent recognition, and toxicity classification, as well as comprehensive QA checks. I ensured dataset accuracy through detailed, multi-modal annotation and quality review. • Annotated data using the Remotasks platform for diverse use cases. • Focused on both linguistic and visual data types in labeling tasks. • Supported large-scale training datasets through rigorous quality checks. • Acted as a reviewer for dataset consistency and reliability.

2021 - 2023

Education

Work History