Tyrone Porter

Key Skills

Software

Scale AI

Appen

iMerit

Labelbox

Other

Top Subject Matter

Nlp Domain Expertise

computer vision

generative AI

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Entity Ner Classification

Freelancer Overview

AI Generalist Trainer & Data Annotator. Brings 3+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI, Appen, and iMerit. Education includes Bachelor of Science, University of Texas (2024). AI-training focus includes data types such as Text and labeling workflows including RLHF, Content Development, and Evaluation.

Labeling Experience

LLM Response Quality Evaluation Framework Creator

Text

I built and implemented a personal scoring rubric for evaluating LLM-generated outputs based on accuracy, tone, safety, and helpfulness dimensions. This framework was adopted by a 15-person annotation team as a reference for quality evaluation tasks. The process involved systematic analysis and iterative improvement of the rubric for high annotation consistency. • Facilitated LLM output evaluation for enhanced model performance • Directly improved consistency and inter-annotator agreement • Provided scalable rubric-based evaluation methodology • Used internal/proprietary tooling for evaluation tasks

I built and implemented a personal scoring rubric for evaluating LLM-generated outputs based on accuracy, tone, safety, and helpfulness dimensions. This framework was adopted by a 15-person annotation team as a reference for quality evaluation tasks. The process involved systematic analysis and iterative improvement of the rubric for high annotation consistency. • Facilitated LLM output evaluation for enhanced model performance • Directly improved consistency and inter-annotator agreement • Provided scalable rubric-based evaluation methodology • Used internal/proprietary tooling for evaluation tasks

2023 - Present

AI Generalist Trainer & Data Annotator

Scale AITextRLHF

I performed 1,000+ annotation tasks across diverse datasets including NLP, computer vision, and generative AI projects. My work focused on rating, ranking, and rewriting AI-generated responses for RLHF pipelines to enhance model safety and helpfulness. Additionally, I created annotation guidelines and contributed to red-teaming exercises for safety-critical scenarios. • Achieved 98%+ inter-annotator agreement over multiple projects • Developed quality checklists widely adopted by large remote teams • Used Scale AI, Appen, iMerit, and Labelbox as key annotation platforms • Supported AI research labs and tech startups in data-centric roles.

I performed 1,000+ annotation tasks across diverse datasets including NLP, computer vision, and generative AI projects. My work focused on rating, ranking, and rewriting AI-generated responses for RLHF pipelines to enhance model safety and helpfulness. Additionally, I created annotation guidelines and contributed to red-teaming exercises for safety-critical scenarios. • Achieved 98%+ inter-annotator agreement over multiple projects • Developed quality checklists widely adopted by large remote teams • Used Scale AI, Appen, iMerit, and Labelbox as key annotation platforms • Supported AI research labs and tech startups in data-centric roles.

2022 - Present

NER Annotation Project Lead & Quality Assurance

Scale AITextEntity Ner Classification

I led quality assurance and labeling for a multilingual named entity recognition project covering a 50,000-token dataset in English and Spanish. My efforts yielded a 12% F1 score improvement over baseline through precise labeling and ongoing dataset review. The project required in-depth linguistic analysis and adherence to established annotation protocols. • Specialized in text entity classification across languages • Applied QA checks and iterative feedback to annotation process • Employed annotation platforms and proprietary QA tools • Enhanced dataset accuracy and performance metrics

I led quality assurance and labeling for a multilingual named entity recognition project covering a 50,000-token dataset in English and Spanish. My efforts yielded a 12% F1 score improvement over baseline through precise labeling and ongoing dataset review. The project required in-depth linguistic analysis and adherence to established annotation protocols. • Specialized in text entity classification across languages • Applied QA checks and iterative feedback to annotation process • Employed annotation platforms and proprietary QA tools • Enhanced dataset accuracy and performance metrics

2021 - 2022

Content Developer & AI Curriculum Designer

OtherText

I designed and delivered AI literacy training modules for non-technical learners, focusing on practical AI understanding and safe usage. I created written explainers, video scripts, and interactive exercises aimed at reducing onboarding time and increasing AI literacy. My collaboration with ML engineers helped bridge the gap between technical documentation and annotation team training. • Produced curriculum content covering ML, prompt engineering, and responsible AI • Authored step-by-step guides and technical documentation • Helped annotation teams understand and interpret model behavior • Utilized instructional design tools and platform-based learning modules

I designed and delivered AI literacy training modules for non-technical learners, focusing on practical AI understanding and safe usage. I created written explainers, video scripts, and interactive exercises aimed at reducing onboarding time and increasing AI literacy. My collaboration with ML engineers helped bridge the gap between technical documentation and annotation team training. • Produced curriculum content covering ML, prompt engineering, and responsible AI • Authored step-by-step guides and technical documentation • Helped annotation teams understand and interpret model behavior • Utilized instructional design tools and platform-based learning modules

2021 - 2022

Education

Work History