James Harrison

Key Skills

Software

Data Annotation Tech

Top Subject Matter

No subject matter listed

Top Data Types

Text

Top Label Types

Question Answering

Text Generation

Emotion Recognition

Text Summarization

RLHF

Freelancer Overview

I have over six years of experience specializing in data analysis, quality assurance, and AI training data evaluation. My background includes reviewing and annotating AI-generated outputs, identifying factual inconsistencies, and providing structured feedback to improve model performance. I excel at ensuring data accuracy, clarity, and adherence to evaluation guidelines, with hands-on experience in both structured and semi-structured data across various domains. My expertise includes LLM response evaluation, human-in-the-loop feedback, and rigorous validation processes. I am skilled at translating technical findings into actionable insights and thrive in independent, remote work environments where attention to detail and analytical reasoning are critical.

Labeling Experience

LLM Response Evaluation and Quality Assurance Specialist

Data Annotation TechTextQuestion AnsweringText Generation

serve as an AI Data & Quality Analyst focusing on the end-to-end validation of AI-generated text outputs. My work involves identifying factual inconsistencies and reasoning gaps in complex model responses to ensure high-quality, safe, and useful data for model training. I apply rigorous evaluation standards and structured annotation rubrics to provide qualitative feedback and quality scoring for LLM performance improvement

serve as an AI Data & Quality Analyst focusing on the end-to-end validation of AI-generated text outputs. My work involves identifying factual inconsistencies and reasoning gaps in complex model responses to ensure high-quality, safe, and useful data for model training. I apply rigorous evaluation standards and structured annotation rubrics to provide qualitative feedback and quality scoring for LLM performance improvement

2023

Education

Work History