Morgan Alex

Key Skills

Software

Data Annotation Tech

Mindrift

Remotasks

Top Subject Matter

LLM output evaluation

linguistic annotation

conversational AI

Top Data Types

Text

Audio

Document

Top Task Types

RLHF

Entity Ner Classification

Classification

Transcription

Freelancer Overview

AI Training Specialist (Contract). Brings 3+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Data Annotation Tech, Mindrift, and Internal. Education includes Bachelor of Arts, Boston University (2024). AI-training focus includes data types such as Text and Audio and labeling workflows including RLHF, Entity (NER) Classification, and Classification.

Labeling Experience

AI Training Specialist (Contract)

Data Annotation TechTextRLHF

As an AI Training Specialist at DataAnnotation Tech, Appen, and Rexzone, I designed and executed structured evaluation tasks for large language models (LLMs) across varied output types. I created annotation guidelines, led RLHF preference rating sessions, and documented model failure patterns that informed product development. Additionally, I contributed adversarial prompts for red-teaming and mentored annotators on quality standards. • Developed team-wide annotation guidelines for complex linguistic phenomena. • Conducted RLHF evaluation sessions to improve conversational AI. • Identified systematic LLM failure modes and delivered actionable reports. • Led annotator onboarding, calibration, and maintained a >98.5% personal quality score.

As an AI Training Specialist at DataAnnotation Tech, Appen, and Rexzone, I designed and executed structured evaluation tasks for large language models (LLMs) across varied output types. I created annotation guidelines, led RLHF preference rating sessions, and documented model failure patterns that informed product development. Additionally, I contributed adversarial prompts for red-teaming and mentored annotators on quality standards. • Developed team-wide annotation guidelines for complex linguistic phenomena. • Conducted RLHF evaluation sessions to improve conversational AI. • Identified systematic LLM failure modes and delivered actionable reports. • Led annotator onboarding, calibration, and maintained a >98.5% personal quality score.

2025 - Present

AI Data Analyst & Linguistic Evaluator (Contract)

MindriftTextEntity Ner Classification

At Mindrift, I produced and quality-checked multilingual annotation datasets for NLP and speech recognition pipelines, focusing on English and Spanish. I improved annotation quality, piloted a revised QA checklist, and built evaluation sets for translation and summary assessment. My work included adversarial prompt creation for red-teaming and documentation for new annotators. • Labeled text for intent classification, named entity recognition, sentiment, and dialogue acts. • Evaluated AI-generated translations for semantic fidelity and fluency. • Authored onboarding materials reducing contributor ramp time. • Created adversarial prompts for model safety and robustness testing.

At Mindrift, I produced and quality-checked multilingual annotation datasets for NLP and speech recognition pipelines, focusing on English and Spanish. I improved annotation quality, piloted a revised QA checklist, and built evaluation sets for translation and summary assessment. My work included adversarial prompt creation for red-teaming and documentation for new annotators. • Labeled text for intent classification, named entity recognition, sentiment, and dialogue acts. • Evaluated AI-generated translations for semantic fidelity and fluency. • Authored onboarding materials reducing contributor ramp time. • Created adversarial prompts for model safety and robustness testing.

2024 - 2024

Research Assistant — Computational Linguistics Lab

TextClassification

As a Research Assistant at Boston University, I manually coded over 2,500 conversation excerpts to create a labeled corpus for discourse coherence and pragmatic inference analysis. I maintained high inter-annotator agreement and contributed to academic outputs on language model performance. My data annotation work set a research-grade standard and informed RLHF training data design. • Labeled multi-turn dialogues for discourse and pragmatic categories. • Iteratively refined coding schemas to achieve kappa > 0.80. • Co-authored conference poster based on annotation findings. • Automated pre-processing through Python scripting, supporting analysis.

As a Research Assistant at Boston University, I manually coded over 2,500 conversation excerpts to create a labeled corpus for discourse coherence and pragmatic inference analysis. I maintained high inter-annotator agreement and contributed to academic outputs on language model performance. My data annotation work set a research-grade standard and informed RLHF training data design. • Labeled multi-turn dialogues for discourse and pragmatic categories. • Iteratively refined coding schemas to achieve kappa > 0.80. • Co-authored conference poster based on annotation findings. • Automated pre-processing through Python scripting, supporting analysis.

2022 - 2024

AI Product Feedback Contributor & Data Specialist (Freelance)

RemotasksAudioTranscription

During my tenure as a freelance data specialist with Remotasks and Lionbridge AI, I annotated audio and text datasets for a variety of AI training tasks. My work included speaker diarization, accent and dialect annotation, and transcription, directly supporting ASR and NLP model development. I also developed annotation guides and participated in structured feedback cycles for AI product improvement. • Annotated speech and text data for linguistic and acoustic features. • Delivered extensive transcription and subtitling for diverse client sectors. • Created personal guidelines for challenging audio annotation scenarios. • Provided structured product feedback throughout multiple test cycles.

During my tenure as a freelance data specialist with Remotasks and Lionbridge AI, I annotated audio and text datasets for a variety of AI training tasks. My work included speaker diarization, accent and dialect annotation, and transcription, directly supporting ASR and NLP model development. I also developed annotation guides and participated in structured feedback cycles for AI product improvement. • Annotated speech and text data for linguistic and acoustic features. • Delivered extensive transcription and subtitling for diverse client sectors. • Created personal guidelines for challenging audio annotation scenarios. • Provided structured product feedback throughout multiple test cycles.

2021 - 2024

Education

Work History