Carly Nielsen

Key Skills

Software

Data Annotation Tech

Top Subject Matter

Large Language Models

AI Training

Natural Language Processing

Top Data Types

Text

Video

Document

Top Task Types

Prompt + Response Writing (SFT)

Freelancer Overview

LLM Evaluator. Brings 13+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Data Annotation Tech. Education includes Certificate in Advanced Arts and Entertainment Management, Capilano University (2024) and No Degree Awarded, Vancouver Community College (2023). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

LLM Evaluator

Data Annotation TechText

As an LLM Evaluator at Data Annotation Tech, I evaluated large language model outputs for accuracy, factuality, and quality. My responsibilities included prompt writing, data labeling, audio transcription, document annotation, and contributing to AI training. I edited and proofread documents to ensure high standards and provided feedback on LLM-generated content. • Conducted data labeling and annotation tasks across multiple data types, primarily text and audio. • Performed factuality checks and content evaluation to ensure relevance and correctness. • Contributed to prompt and response writing for supervised fine-tuning (SFT) and RLHF processes. • Utilized internal/proprietary platforms and tools for annotation, transcription, and AI training workflows.

As an LLM Evaluator at Data Annotation Tech, I evaluated large language model outputs for accuracy, factuality, and quality. My responsibilities included prompt writing, data labeling, audio transcription, document annotation, and contributing to AI training. I edited and proofread documents to ensure high standards and provided feedback on LLM-generated content. • Conducted data labeling and annotation tasks across multiple data types, primarily text and audio. • Performed factuality checks and content evaluation to ensure relevance and correctness. • Contributed to prompt and response writing for supervised fine-tuning (SFT) and RLHF processes. • Utilized internal/proprietary platforms and tools for annotation, transcription, and AI training workflows.

2026 - Present

Education

Work History