For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

LoginCreate account
Invite to Job
Bryn Williamson

Bryn Williamson

LLM Evaluation and Alignment Specialist – Outlier AI

SCOTLAND flag
Dundee, Scotland
$17.00/hrIntermediateOneformaData Annotation TechAppen

Key Skills

Software

OneFormaOneForma
Data Annotation TechData Annotation Tech
AppenAppen

Top Subject Matter

AI Large Language Models (LLM)
Multimodal AI Models
Legal Services & Contract Review

Top Data Types

TextText
DocumentDocument

Top Task Types

Bounding Box
Segmentation
Prompt Response Writing SFT
Function Calling
Text Summarization
Text Generation
Object Detection
Question Answering
RLHF
Evaluation Rating

Freelancer Overview

LLM Evaluation and Alignment Specialist – Outlier AI. Brings 11+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal and Proprietary Tooling. Education includes Doctor of Philosophy, University of Dundee (2023) and Master of Science, University of Dundee (2016). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

IntermediateEnglish

Labeling Experience

Multimodal Response Evaluator (Aether Project) – Outlier AI

Text
In the Aether Project at Outlier AI, I evaluated AI-generated multimodal outputs to ensure cross-modal accuracy and user intent alignment. Assessments emphasized model safety, constraint adherence, and rapid fact-checking against references. My work contributed to maintaining high-quality outputs and detecting harmful content or hallucinations. • Evaluated text, image, and data visualization outputs for consistency. • Verified model adherence to safety and formatting constraints. • Flagged and documented potentially harmful or factually incorrect content. • Ensured user prompt intent was correctly identified by the model.

In the Aether Project at Outlier AI, I evaluated AI-generated multimodal outputs to ensure cross-modal accuracy and user intent alignment. Assessments emphasized model safety, constraint adherence, and rapid fact-checking against references. My work contributed to maintaining high-quality outputs and detecting harmful content or hallucinations. • Evaluated text, image, and data visualization outputs for consistency. • Verified model adherence to safety and formatting constraints. • Flagged and documented potentially harmful or factually incorrect content. • Ensured user prompt intent was correctly identified by the model.

2025 - Present

LLM Evaluation and Alignment Specialist – Outlier AI

Text
As an LLM Evaluation and Alignment Specialist at Outlier AI, I engineered and audited evaluation prompts and rubrics for language model stress-testing. My work focused on identifying model weaknesses, crafting robust evaluation logic, and ensuring data validity through precise prompt design. Outputs were assessed for instruction following, contextual awareness, and logical consistency. • Developed “stump” prompts to test LLM comprehension boundaries. • Audited outputs for adherence to complex instructions and logical soundness. • Designed rubrics ensuring model data remained temporally stable. • Applied structured logic auditing to eliminate ambiguity in labeled data.

As an LLM Evaluation and Alignment Specialist at Outlier AI, I engineered and audited evaluation prompts and rubrics for language model stress-testing. My work focused on identifying model weaknesses, crafting robust evaluation logic, and ensuring data validity through precise prompt design. Outputs were assessed for instruction following, contextual awareness, and logical consistency. • Developed “stump” prompts to test LLM comprehension boundaries. • Audited outputs for adherence to complex instructions and logical soundness. • Designed rubrics ensuring model data remained temporally stable. • Applied structured logic auditing to eliminate ambiguity in labeled data.

2025 - Present

Education

U

University of Dundee

Master of Science, Management and Economics (Energy Sector Focus)

Master of Science
2015 - 2016
U

University of Abertay

Bachelor of Arts (Honours), Business Studies with Economics

Bachelor of Arts (Honours)
2011 - 2015

Work History

S

Self-Directed

Quantitative Researcher & Algorithmic Trader

Dundee
2016 - Present
A

ALL Logistics Consultants

Business Development Analyst

Dundee
2022 - 2025