Shawn Joseph

Key Skills

Software

Clickworker

Lionbridge

OneForma

Remotasks

Telus

Scale AI

Top Subject Matter

English LLM Evaluation

Audio Evaluation

AI Assistant RLHF

Top Data Types

Audio

Image

Text

Top Task Types

Classification

Data Collection

Prompt Response Writing SFT

RLHF

Freelancer Overview

An expert in RLHF, I've contributed to improving LLM Assistants for my company's client. My experience includes performing quality assurance across 10+ AI language model tasks, such as generating accurate web search responses, analyzing sources for user queries, and summarizing content, including images. I’ve provided detailed feedback using client rating tools to enhance generative AI responses to user queries, with a focus on user intent satisfaction, information accuracy, and grammatical coherence. Additionally, I perform web research with credible resources to verify claims to refine AI algorithms and ensure reliable assistance. Additionally, I flag hallucinations, canned responses, and text annotation errors for data cleanup. My analytical expertise extends to evaluating over 100+ daily search queries, optimizing AI assistant responses for a better user experience.

Labeling Experience

Search Engine Evaluator

TelusTextRLHF

In my current role, I contribute to reinforcement learning with human feedback for models performing text summarization and factuality claims.

In my current role, I contribute to reinforcement learning with human feedback for models performing text summarization and factuality claims.

2021

Education

Work History