For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

LoginCreate account
Invite to Job
S

Sophia Nelson

AI Conversation Evaluation & Ambiguity Testing (Freelance Project)

UNITED_KINGDOM flag
united kingdom, United Kingdom
$35.00/hrEntry LevelMercor

Key Skills

Software

MercorMercor

Top Subject Matter

Conversational AI
Ambiguity Testing
Retail Banking — AI Chatbots

Top Data Types

TextText

Top Task Types

Evaluation Rating
Prompt Response Writing SFT
RLHF

Freelancer Overview

I have experience evaluating AI-generated responses using structured criteria such as instruction-following, accuracy, completeness, and clarity. I’ve assessed outputs for issues like hallucinations and relevance while maintaining consistency and attention to detail across tasks. I am currently completing an MSc in Business Analytics, with experience in data analysis and working with structured datasets using tools such as Python, Excel, and SQL. I am also developing an LLM evaluation project to further strengthen my understanding of AI model performance and data quality.

Entry LevelEnglish

Labeling Experience

AI Chatbot Engagement in Retail Banking (MSc Dissertation)

OtherText
This project analysed customer interaction and feedback data to evaluate performance and user trust in AI chatbots. Natural language processing and sentiment analysis (BERT) techniques were used to identify engagement and quality drivers. The project provided actionable recommendations to improve chatbot outcomes and system effectiveness.• Applied NLP and sentiment analysis to chatbot interaction logs. • Evaluated driver factors for response quality and user engagement. • Delivered structured feedback to inform system refinements. • Contributed commercially relevant analysis for business outcomes.

This project analysed customer interaction and feedback data to evaluate performance and user trust in AI chatbots. Natural language processing and sentiment analysis (BERT) techniques were used to identify engagement and quality drivers. The project provided actionable recommendations to improve chatbot outcomes and system effectiveness.• Applied NLP and sentiment analysis to chatbot interaction logs. • Evaluated driver factors for response quality and user engagement. • Delivered structured feedback to inform system refinements. • Contributed commercially relevant analysis for business outcomes.

2024 - 2024

AI Conversation Evaluation & Ambiguity Testing (Freelance Project)

Text
This experience involved designing and evaluating multi-turn conversational tasks to assess AI systems. The focus was on testing the model's ability to resolve implicit context and ensure coherent reasoning. Responses were assessed for logical consistency, hedging, redundancy, and clarity.• Created progressively ambiguous prompts to stress-test model interpretation. • Assessed AI-generated responses against defined performance thresholds. • Worked within structured quality control (QC) systems for consistent evaluations. • Provided structured feedback on response quality for model improvement.

This experience involved designing and evaluating multi-turn conversational tasks to assess AI systems. The focus was on testing the model's ability to resolve implicit context and ensure coherent reasoning. Responses were assessed for logical consistency, hedging, redundancy, and clarity.• Created progressively ambiguous prompts to stress-test model interpretation. • Assessed AI-generated responses against defined performance thresholds. • Worked within structured quality control (QC) systems for consistent evaluations. • Provided structured feedback on response quality for model improvement.

2023 - 2023

Education

U

University of Surrey

Master of Science, Business Analytics

Master of Science
2025 - 2026
U

University of Surrey

Bachelor of Science, Business Management

Bachelor of Science
2016 - 2019

Work History

O

Office Angels

Corporate Receptionist & Admin Support

London
2024 - Present
T

The Openwork Partnership

CRM Adoption Consultant

London
2021 - 2023