Kirven Marcus

Key Skills

Software

Labelbox

Other

Top Subject Matter

Model alignment

Rlhf Domain Expertise

LLM safety

Top Data Types

Text

Document

Top Task Types

RLHF

Entity Ner Classification

Freelancer Overview

Lead AI Training Consultant – Model Alignment, RLHF & Red Teaming. Brings 10+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Labelbox and Other. Education includes Doctor of Philosophy, The University of Texas at Austin (2020) and Master of Science, Texas Tech University (2014). AI-training focus includes data types such as Text and labeling workflows including RLHF and Entity (NER) Classification.

Labeling Experience

Lead AI Training Consultant – Model Alignment, RLHF & Red Teaming

LabelboxTextRLHF

As Lead AI Training Consultant, I specialize in model alignment, RLHF, and red teaming, testing large language models for logical gaps and safety risks. My role involves writing rationales, auditing model outputs, and managing teams to refine raw datasets into high-quality training materials. Using industry-leading platforms and proprietary tools, I help develop safer, more reliable AI systems. • Led hands-on 'stress testing' and human-in-the-loop quality control for next-gen LLM models. • Authored and curated rationales to improve model responses and humanize outputs. • Managed multidisciplinary teams cleaning and validating large, messy datasets. • Employed tools like Labelbox and Scale AI in creating 'Gold Standard' data for AI training.

As Lead AI Training Consultant, I specialize in model alignment, RLHF, and red teaming, testing large language models for logical gaps and safety risks. My role involves writing rationales, auditing model outputs, and managing teams to refine raw datasets into high-quality training materials. Using industry-leading platforms and proprietary tools, I help develop safer, more reliable AI systems. • Led hands-on 'stress testing' and human-in-the-loop quality control for next-gen LLM models. • Authored and curated rationales to improve model responses and humanize outputs. • Managed multidisciplinary teams cleaning and validating large, messy datasets. • Employed tools like Labelbox and Scale AI in creating 'Gold Standard' data for AI training.

2021 - Present

Senior Graduate Researcher – Data Curation & NLP Annotation

OtherTextEntity Ner Classification

As a Senior Graduate Researcher, I oversaw data curation and annotation of a major NLP project involving over 50,000 data points. I ensured each tag and label was accurate, shaping the dataset for successful research outcomes. My focus included labeling real-world, ambiguous scenarios to challenge and develop robust NLP models. • Managed entity tagging and data cleaning for large-scale natural language corpora. • Conducted rigorous quality checks, reducing annotation errors and increasing reproducibility. • Devised tagging schemes to handle ambiguity in real-world human language data. • Facilitated training and onboarding of junior researchers in annotation protocols.

As a Senior Graduate Researcher, I oversaw data curation and annotation of a major NLP project involving over 50,000 data points. I ensured each tag and label was accurate, shaping the dataset for successful research outcomes. My focus included labeling real-world, ambiguous scenarios to challenge and develop robust NLP models. • Managed entity tagging and data cleaning for large-scale natural language corpora. • Conducted rigorous quality checks, reducing annotation errors and increasing reproducibility. • Devised tagging schemes to handle ambiguity in real-world human language data. • Facilitated training and onboarding of junior researchers in annotation protocols.

2015 - 2020

Education

Work History