For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

LoginCreate account
Invite to Job
Kristina Ely

Kristina Ely

AI Reasoning & Evaluation Specialist - AI Governance

USA flag
Montrose, Usa
$28.00/hrIntermediateDon T Disclose

Key Skills

Software

Don't disclose

Top Subject Matter

No subject matter listed

Top Data Types

TextText
VideoVideo
AudioAudio

Top Label Types

RLHF
Evaluation Rating

Freelancer Overview

I am an AI evaluation specialist with hands-on experience in assessing and annotating large language model outputs for reasoning quality, factual accuracy, and instruction adherence. My work involves using structured rubrics to label and rank model responses, identify hallucinations, and ensure compliance with safety and policy guidelines. I excel at constructing complex prompts, analyzing ambiguous cases, and producing clear, explanatory justifications to support AI training and alignment. With a strong background in information science, regulatory interpretation, and data analysis using tools like SQL, R, and Excel, I bring a detail-oriented and analytical approach to AI data labeling and annotation projects. My experience spans adversarial prompt testing, RLHF alignment, and multi-step reasoning evaluation, enabling me to contribute to high-quality, reliable AI systems across diverse domains.

IntermediateEnglish

Labeling Experience

Conversational AI & Voice Model Evaluation

Don T DiscloseAudioEvaluation Rating
Conducted live conversational testing of voice-enabled AI models. Evaluated models' ability to accurately understand user intent, demonstrate appropriate emotional intelligence, and maintain context across multi-turn dialogues. Assessed quality of AI-generated audio outputs including naturalness, clarity, and emotional tone. Provided feedback on comprehension accuracy, response relevance, and conversational flow.

Conducted live conversational testing of voice-enabled AI models. Evaluated models' ability to accurately understand user intent, demonstrate appropriate emotional intelligence, and maintain context across multi-turn dialogues. Assessed quality of AI-generated audio outputs including naturalness, clarity, and emotional tone. Provided feedback on comprehension accuracy, response relevance, and conversational flow.

2025

Video Content Summarization Evaluation

Don T DiscloseVideoEvaluation Rating
Evaluated AI-generated summaries of video content including social media posts for factual accuracy, completeness, and safety compliance. Identified misrepresentations, hallucinations, and policy violations in AI descriptions of visual content. Applied content safety guidelines and moderation standards to flag potentially harmful of inappropriate material.

Evaluated AI-generated summaries of video content including social media posts for factual accuracy, completeness, and safety compliance. Identified misrepresentations, hallucinations, and policy violations in AI descriptions of visual content. Applied content safety guidelines and moderation standards to flag potentially harmful of inappropriate material.

2025

AI Model Evaluation & RLHF Annotation

Don T DiscloseTextRLHF
Evaluated large language model outputs using structured rubrics to assess reasoning quality, factual accuracy, and instruction adherence. Ranked competing model responses to support RLHF training data. Identified hallucinations, logical inconsistencies, and safety/policy violations. Applied adversarial prompting techniques to test edge cases. Provided detailed written justifications for rankings to improve model alignment.

Evaluated large language model outputs using structured rubrics to assess reasoning quality, factual accuracy, and instruction adherence. Ranked competing model responses to support RLHF training data. Identified hallucinations, logical inconsistencies, and safety/policy violations. Applied adversarial prompting techniques to test edge cases. Provided detailed written justifications for rankings to improve model alignment.

2025

Education

C

Clarion Penn West University

Master of Library and Information Science, Library and Information Science

Master of Library and Information Science
2022 - 2024
E

East Carolina University

Bachelor of Arts, Political Science

Bachelor of Arts
2000 - 2000

Work History

S

Susquehanna County Historical Society & Free Library Association

Library Administrator

Montrose
2022 - 2024
U

USDA Farm Service Agency

County Executive Director

Montrose
2015 - 2020