Paul Tsien

Key Skills

Software

Labelbox

Remotasks

Other

Scale AI

Top Subject Matter

No subject matter listed

Top Data Types

Audio

Image

Text

Top Task Types

Audio Recording

Classification

Evaluation Rating

Prompt Response Writing SFT

RLHF

Freelancer Overview

I am a multidisciplinary AI trainer with 1+ years experience providing feedback and data for LLMs on Outlier. The bulk of my time has been spent on RLHF projects with great attention to detail placed on using rubrics to accurately grade model failures. I was placed on the Oracle program within Outlier for top contributors in Summer 2024, which allowed me to gain experience in other training/annotation fields including multimodal RLHF, prompt generation, visual recognition, audio and voice acting. My academic and professional experience has made me a great fit for writing and audio projects, specifically. I currently work in the music industry as a sound designer/audio engineer and am especially interested in projects involving audio analysis, recording, technical description, and transcription.

Labeling Experience

Bulk Audio Prompt Transcription/Review

Scale AIAudioEmotion RecognitionTranslation Localization

This project involved creating and recording prompts through professional and improvised recording setups over the course of a few weeks. These prompts were recorded in a variety of locations and across a range of subjects and emotional context. Collected audio would generate a transcript which required edits to accurately portray the speaker and fit project formatting guidelines. My access to professional recording equipment, location, and experience with prompt creation and transcription allowed me to excel in this project. Upon project completion, I acted as a senior reviewer, assessing audio quality, transcription accuracy, and proper categorization for a large pool of submissions.

This project involved creating and recording prompts through professional and improvised recording setups over the course of a few weeks. These prompts were recorded in a variety of locations and across a range of subjects and emotional context. Collected audio would generate a transcript which required edits to accurately portray the speaker and fit project formatting guidelines. My access to professional recording equipment, location, and experience with prompt creation and transcription allowed me to excel in this project. Upon project completion, I acted as a senior reviewer, assessing audio quality, transcription accuracy, and proper categorization for a large pool of submissions.

2025 - 2025

RLHF for API/Function-based Models

Scale AITextClassificationRLHF

Acted as senior reviewer for an extended period on an RLHF project (large tech company through Scale AI). Users were given a pre-loaded prompt and asked to analyze/assess two code outputs for appropriate external API usage. Full model responses were generated following logic assessment. An extensive rubric was followed to grade each response in aspects including but not limited to: truth, adherence to instructions, harmful content, writing quality. Worked as a contributor on this project for two weeks before moving to reviewer. Consistent quality on tasks led me to become a senior reviewer for the remainder of this project's activity.

Acted as senior reviewer for an extended period on an RLHF project (large tech company through Scale AI). Users were given a pre-loaded prompt and asked to analyze/assess two code outputs for appropriate external API usage. Full model responses were generated following logic assessment. An extensive rubric was followed to grade each response in aspects including but not limited to: truth, adherence to instructions, harmful content, writing quality. Worked as a contributor on this project for two weeks before moving to reviewer. Consistent quality on tasks led me to become a senior reviewer for the remainder of this project's activity.

2024 - 2024

Education

Work History