Aubrey Krawczyk

Key Skills

Software

Scale AI

Other

Data Annotation Tech

Top Subject Matter

Scientific research

Stem Domain Expertise

behavioral science

Top Data Types

Text

Document

Top Task Types

Classification

Object Detection

Text Generation

Question Answering

Text Summarization

Transcription

Evaluation Rating

Data Collection

Segmentation

Freelancer Overview

AI Trainer & Domain Expert (Freelance / Contract). Core strengths include Scale AI, Other, and Data Annotation Tech. Education includes Bachelor of Science, University of California, Berkeley (2019). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Trainer & Domain Expert (Freelance / Contract)

Scale AIText

As an AI Trainer & Domain Expert at Outlier AI through the Scale AI platform, I provided expert-level annotations, ratings, and feedback to refine large language models. My work emphasized research design, scientific methodology, hypothesis testing, and logical reasoning in both STEM and behavioral domains. I regularly edited, evaluated, and created high-quality research-focused content for AI system improvement. • Delivered nuanced critiques and iterative feedback to improve model performance • Conducted extended sessions with high attention to detail using precise rubrics • Analyzed and revised methodological and logical content for scientific best practices • Contributed to prompt and output refinements for more robust AI capabilities.

As an AI Trainer & Domain Expert at Outlier AI through the Scale AI platform, I provided expert-level annotations, ratings, and feedback to refine large language models. My work emphasized research design, scientific methodology, hypothesis testing, and logical reasoning in both STEM and behavioral domains. I regularly edited, evaluated, and created high-quality research-focused content for AI system improvement. • Delivered nuanced critiques and iterative feedback to improve model performance • Conducted extended sessions with high attention to detail using precise rubrics • Analyzed and revised methodological and logical content for scientific best practices • Contributed to prompt and output refinements for more robust AI capabilities.

2021 - Present

AI Expert Validator & Research Trainer (Freelance / Contract)

OtherText

At Handshake AI, I delivered domain-expert validation and detailed feedback for generative AI systems focused on research methodology. I assessed model outputs for factual accuracy, methodological soundness, reproducibility, and analytical depth across complex scientific prompts. I also edited and curated datasets to enhance model capabilities with gold-standard research examples. • Judged performance against human-expert benchmarks in research tasks • Participated in rapid, high-precision, multi-turn interaction projects • Validated experimental logic and evidence-based reasoning in AI outputs • Curated and refined technical content for iterative training purposes.

At Handshake AI, I delivered domain-expert validation and detailed feedback for generative AI systems focused on research methodology. I assessed model outputs for factual accuracy, methodological soundness, reproducibility, and analytical depth across complex scientific prompts. I also edited and curated datasets to enhance model capabilities with gold-standard research examples. • Judged performance against human-expert benchmarks in research tasks • Participated in rapid, high-precision, multi-turn interaction projects • Validated experimental logic and evidence-based reasoning in AI outputs • Curated and refined technical content for iterative training purposes.

2020 - 2021

AI Data Annotator & Model Trainer (Freelance / Contract)

Data Annotation TechText

During my tenure at DataAnnotation Tech, I performed precise data labeling, comparative rating, and quality assurance for text-based model training datasets. The focus was on research prompts, scientific reasoning, behavioral analysis, and the creation of synthetic scenarios for AI development. I was responsible for ensuring high accuracy in experimental design evaluations within flexible remote workflows. • Conducted side-by-side evaluations of AI and human responses • Highlighted deficiencies in statistical, logical, and methodological output • Authored and edited synthetic training content targeting complex queries • Maintained strict adherence to detailed annotation guidelines.

During my tenure at DataAnnotation Tech, I performed precise data labeling, comparative rating, and quality assurance for text-based model training datasets. The focus was on research prompts, scientific reasoning, behavioral analysis, and the creation of synthetic scenarios for AI development. I was responsible for ensuring high accuracy in experimental design evaluations within flexible remote workflows. • Conducted side-by-side evaluations of AI and human responses • Highlighted deficiencies in statistical, logical, and methodological output • Authored and edited synthetic training content targeting complex queries • Maintained strict adherence to detailed annotation guidelines.

2019 - 2019

Education

Work History