For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
Layne Porta

Layne Porta

Expert in SFT and fine-grained criteria generation for LLMs.

USA flagOrlando, Usa
$20.00/hrIntermediateData Annotation TechRemotasksOther

Key Skills

Software

Data Annotation TechData Annotation Tech
RemotasksRemotasks
Other
Scale AIScale AI

Top Subject Matter

No subject matter listed

Top Data Types

DocumentDocument
ImageImage
TextText

Top Task Types

Classification
Evaluation Rating
Prompt Response Writing SFT
RLHF
Text Generation

Freelancer Overview

As an experienced freelancer in LLM training, I have contributed stellar work to a range of global projects for high-profile clients. My areas of expertise include RLHF, SFT, rubric/criteria creation and evaluation, fact-checking, classification, and reviewing and correcting other contributors’ attempts. My professional expertise in writing, research, and text analysis and my PhD in Rhetoric enable me to efficiently and effectively deliver exceptional work in a timely manner, as evidenced by the 20+ distinct projects I have contributed to.

IntermediateFrenchEnglish

Labeling Experience

Data Annotation Tech

Fine-Grained Criteria Creation

Data Annotation TechTextFine Tuning
Created fine-grained criteria for a model response based on a provided prompt. Evaluated and compared two model responses using the fine-grained criteria.

Created fine-grained criteria for a model response based on a provided prompt. Evaluated and compared two model responses using the fine-grained criteria.

2024
Data Annotation Tech

Supervised Fine-Tuning: Images

Data Annotation TechImageFine Tuning
I selected appropriate images, created complex prompts about the image(s) that were designed to get the LLM to fail, then evaluated and compared responses across two models.

I selected appropriate images, created complex prompts about the image(s) that were designed to get the LLM to fail, then evaluated and compared responses across two models.

2024 - 2024
Data Annotation Tech

AI-Generated Email and Action Items Evaluation

Data Annotation TechTextQuestion Answering
Evaluated AI-generated action items based on email threads and AI-generated email responses to customer service inquiries.

Evaluated AI-generated action items based on email threads and AI-generated email responses to customer service inquiries.

2024 - 2024
Data Annotation Tech

Sensitive Topics Evaluations

Data Annotation TechTextQuestion Answering
Evaluated and compared AI model responses according to whether the model was stereotyping or over-generalizing and how it handled sensitive prompts such as those related to medical advice, violence, and sexuality and sexual health.

Evaluated and compared AI model responses according to whether the model was stereotyping or over-generalizing and how it handled sensitive prompts such as those related to medical advice, violence, and sexuality and sexual health.

2024 - 2024
Scale AI

General Evaluations and Ratings

Scale AITextRLHF
Evaluated and compared responses from two different AI models using criteria including truthfulness, safety, instruction-following, writing style, and delightfulness.

Evaluated and compared responses from two different AI models using criteria including truthfulness, safety, instruction-following, writing style, and delightfulness.

2024 - 2024

Education

U

University of Louisville

PhD, Rhetoric and Composition

PhD
2015 - 2019
U

University of Louisville

Master of Arts, English

Master of Arts
2013 - 2015

Work History

R

Rollins College

Instructor, English Department

Winter Park
2020 - Present
R

Rollins College

Director, Tutoring and Writing Center

Winter Park
2019 - Present