For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
E

Erik Shively

Senior AI Content Specialist / Professional Engineer (PE) / Subject Matter Expert (SME)

USA flagArlington, Usa
$60.00/hrExpertAppenData Annotation TechLabelbox

Key Skills

Software

AppenAppen
Data Annotation TechData Annotation Tech
LabelboxLabelbox
MindriftMindrift
Other

Top Subject Matter

Civil/Transportation Engineering
STEM Domain Expertise
Technical QA/QC

Top Data Types

TextText
VideoVideo
DocumentDocument

Top Task Types

RLHFRLHF
Fine-tuningFine-tuning
Red TeamingRed Teaming
Text GenerationText Generation
Evaluation/RatingEvaluation/Rating
Data CollectionData Collection
Question AnsweringQuestion Answering
ClassificationClassification
Text SummarizationText Summarization
Prompt + Response Writing (SFT)Prompt + Response Writing (SFT)

Freelancer Overview

Licensed Professional Engineer (PE), Senior AI Data Specialist, and AI Subject Matter Expert with 2.5+ years of full-time experience training frontier Large Language Models (LLMs). I specialize in Technical Plan Review, STEM-domain factuality (Civil/Transportation), and multi-axis evaluation. Leveraging my background as a corporate Quality Control Manager and senior engineering auditor, I apply rigorous Quality Management Systems (QMS) to AI training. This ensures 100% accuracy in high-stakes environments and enables me to identify hallucination gaps in complex technical datasets that generalist models miss. AI-specific work skills include RLHF, Multi-Axis Evaluation, Rubrics, Prompt Engineering, Model Factuality, Logic Validation.

ExpertEnglish

Labeling Experience

Senior AI Content Specialist / SME (Contract)

TextRLHF
As Senior AI Content Specialist/SME, I performed high-complexity audits of AI-generated technical solutions for logic, factuality, and reasoning. I executed Reinforcement Learning from Human Feedback (RLHF) and multi-axis evaluation, contributing to the training and validation of frontier Large Language Models in STEM domains. I authored technical justifications for model rankings and evaluated multi-modal datasets, including voice and video, to enhance model understanding and safety. • Conducted redline audits of AI-generated engineering solutions • Applied rigorous Quality Management Systems to model evaluation • Improved prediction accuracy and hallucination detection in LLMs • Led instruction-based technical ranking and multi-modal dataset assessment • Created and utilized rubrics across 8+ axes for response ratings and evaluations.

As Senior AI Content Specialist/SME, I performed high-complexity audits of AI-generated technical solutions for logic, factuality, and reasoning. I executed Reinforcement Learning from Human Feedback (RLHF) and multi-axis evaluation, contributing to the training and validation of frontier Large Language Models in STEM domains. I authored technical justifications for model rankings and evaluated multi-modal datasets, including voice and video, to enhance model understanding and safety. • Conducted redline audits of AI-generated engineering solutions • Applied rigorous Quality Management Systems to model evaluation • Improved prediction accuracy and hallucination detection in LLMs • Led instruction-based technical ranking and multi-modal dataset assessment • Created and utilized rubrics across 8+ axes for response ratings and evaluations.

2023 - Present

Education

U

University of Virginia

Bachelor of Science, Civil Engineering

Bachelor of Science
1990 - 1994

Work History

A

AAA Club Alliance

Travel Professional

Arlington
2023 - Present
S

Sole Proprietor

Consultant/Insurance Agent

Arlington
2015 - 2023