Sydney Knodle

Key Skills

Software

Appen

CrowdSource

Internal/Proprietary Tooling

Scale AI

Clickworker

Top Subject Matter

LLM Output Evaluation

General AI Data Annotation

Search Quality Evaluation

Top Data Types

Audio

Image

Text

Top Task Types

Evaluation Rating

Question Answering

RLHF

Prompt Response Writing SFT

Classification

Text Generation

Text Summarization

Transcription

Object Detection

Data Collection

Freelancer Overview

AI Data Rater & Reviewer (Contract). Brings 9+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Outlier, Appen, and Welocalize. Education includes General Educational Development, Hononegah Community High School. AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

AI Data Rater & Reviewer (Contract)

AudioText Generation

In this project-based contract, I evaluated and reviewed AI-generated text responses for accuracy, reasoning quality, and coherence. I audited the work of other contributors to ensure the overall dataset met high-quality standards. I identified inconsistencies and provided feedback to improve LLM output reliability. • Conducted structured evaluations using pre-defined guidelines • Audited and rated AI outputs and contributor submissions • Improved response consistency and accuracy through detailed review • Focused on natural language understanding and logic flows

In this project-based contract, I evaluated and reviewed AI-generated text responses for accuracy, reasoning quality, and coherence. I audited the work of other contributors to ensure the overall dataset met high-quality standards. I identified inconsistencies and provided feedback to improve LLM output reliability. • Conducted structured evaluations using pre-defined guidelines • Audited and rated AI outputs and contributor submissions • Improved response consistency and accuracy through detailed review • Focused on natural language understanding and logic flows

2025 - 2026

AI Data Contributor (Contract)

AppenTextClassification

As an AI Data Contributor, I completed data annotation and labeling tasks focused on text-, image-, video-, and audio-based AI datasets. I applied structured guidelines to ensure every annotation was consistent and highly accurate. My pattern recognition and attention to detail were essential in producing quality-labeled data. • Performed precise classification and annotation on AI-related datasets • Maintained high annotation accuracy through careful guideline adherence • Managed deadlines and workflow in a remote contract setting • Leveraged platform tools efficiently for data labeling

As an AI Data Contributor, I completed data annotation and labeling tasks focused on text-, image-, video-, and audio-based AI datasets. I applied structured guidelines to ensure every annotation was consistent and highly accurate. My pattern recognition and attention to detail were essential in producing quality-labeled data. • Performed precise classification and annotation on AI-related datasets • Maintained high annotation accuracy through careful guideline adherence • Managed deadlines and workflow in a remote contract setting • Leveraged platform tools efficiently for data labeling

2025 - 2025

Search Quality Rater

TextEvaluation Rating

As a Search Quality Rater, I evaluated search results and AI-generated outputs for relevance and factual accuracy. I used structured evaluation systems to assign ratings and flagged low-quality or irrelevant content. My work contributed directly to the ongoing improvement of search and language models. • Assessed and rated large volumes of AI-driven search results • Applied standardized rubrics to ensure rating consistency • Identified edge cases and pattern anomalies for further review • Communicated findings clearly to project managers and engineers

As a Search Quality Rater, I evaluated search results and AI-generated outputs for relevance and factual accuracy. I used structured evaluation systems to assign ratings and flagged low-quality or irrelevant content. My work contributed directly to the ongoing improvement of search and language models. • Assessed and rated large volumes of AI-driven search results • Applied standardized rubrics to ensure rating consistency • Identified edge cases and pattern anomalies for further review • Communicated findings clearly to project managers and engineers

2024 - 2025

Education

Work History