Anna Larson

Key Skills

Software

Scale AI

Top Subject Matter

No subject matter listed

Top Data Types

Audio

Image

Text

Top Task Types

Emotion Recognition

Evaluation Rating

Prompt Response Writing SFT

RLHF

Freelancer Overview

I am an AI evaluator with nearly a year of dedicated experience working at Outlier AI, where I have specialized in grading responses generated by large language models (LLMs) and performing detailed data labeling tasks. My work involves careful analysis of AI-generated content to ensure accuracy, coherence, relevance, and adherence to specific guidelines. Through this role, I have developed a strong ability to follow complex instructions consistently while maintaining a high standard of quality and precision. In my position at Outlier AI, I have been responsible for reviewing outputs from various LLMs, including popular and emerging models used in natural language processing applications. My primary task is to evaluate the quality of AI responses by comparing them to benchmarks and grading them according to detailed rubrics. This requires a deep understanding of language, context, and nuance, as well as the ability to identify errors such as factual inaccuracies, misleading information, and inappropriate or biased content. I have become adept at distinguishing subtle differences in tone, intent, and semantic meaning, which are critical for helping AI systems improve their natural language generation capabilities. Alongside grading responses, I perform data labeling, a task essential to training and refining AI models. This involves annotating text data with precise tags and categories that guide machine learning algorithms in recognizing patterns and relationships within la

Labeling Experience

Outlier AI

Scale AITextEvaluation Rating

At Outlier AI, I’ve graded LLM responses using detailed rubrics across a wide range of topics, including education, health, business, and everyday queries. My work involved evaluating accuracy, clarity, relevance, and tone, ensuring consistent quality and adherence to guidelines to help refine AI performance in diverse real-world contexts.

At Outlier AI, I’ve graded LLM responses using detailed rubrics across a wide range of topics, including education, health, business, and everyday queries. My work involved evaluating accuracy, clarity, relevance, and tone, ensuring consistent quality and adherence to guidelines to help refine AI performance in diverse real-world contexts.

2024

Education

Work History