Kimberly Calavera

Key Skills

Software

Telus

OneForma

Toloka

Remotasks

Mindrift

Top Subject Matter

Content Safety & Policy

Generative AI

Audio Data Annotation

Top Data Types

Text

Audio

Image

Document

Top Task Types

RLHF

Transcription

Question Answering

Text Summarization

Red Teaming

Prompt + Response Writing (SFT)

Freelancer Overview

Content Safety Expert (AI Community). Brings 15+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Telus, Centific, and OneForma. Education includes Bachelor of Science, Saint Louis University (2011) and Bachelor of Science, PATTS College of Aeronautics (2008). AI-training focus includes data types such as Text and Audio and labeling workflows including RLHF, Transcription, and Evaluation.

Labeling Experience

Content Safety Expert (AI Community)

TelusTextRLHF

Oversaw content safety procedures and applied human-in-the-loop review to generative AI outputs. Labeled and moderated diverse data types to ensure compliance with global content standards. Performed fact-checking and linguistic quality assurance on model training data. • Conducted detailed QA review of AI-generated text, images, and videos. • Evaluated and flagged AI model hallucinations and misinformation. • Applied policy and safety rules to all reviewed content. • Collaborated internationally on AI digital guardianship initiatives.

Oversaw content safety procedures and applied human-in-the-loop review to generative AI outputs. Labeled and moderated diverse data types to ensure compliance with global content standards. Performed fact-checking and linguistic quality assurance on model training data. • Conducted detailed QA review of AI-generated text, images, and videos. • Evaluated and flagged AI model hallucinations and misinformation. • Applied policy and safety rules to all reviewed content. • Collaborated internationally on AI digital guardianship initiatives.

2026 - 2026

AI Safety Evaluator

OneformaText

Evaluated AI-generated text responses for safety, helpfulness, and reliability. Applied strict guidelines to assess accuracy, tone, and user value of model outputs. Provided structured feedback that improved the trustworthiness of AI systems. • Rated LLM and generative model outputs across diverse prompts. • Flagged unhelpful or potentially harmful responses for correction. • Used structured rubrics for judgment consistency. • Contributed to improved model safety protocols over 7 months.

Evaluated AI-generated text responses for safety, helpfulness, and reliability. Applied strict guidelines to assess accuracy, tone, and user value of model outputs. Provided structured feedback that improved the trustworthiness of AI systems. • Rated LLM and generative model outputs across diverse prompts. • Flagged unhelpful or potentially harmful responses for correction. • Used structured rubrics for judgment consistency. • Contributed to improved model safety protocols over 7 months.

2025 - 2025

Linguistic Data Annotator – Audio

AudioTranscription

Transcribed and annotated large volumes of audio data for ASR and language model training. Tagged lexical disfluencies such as filler words and repetitions to enhance dataset quality. Maintained consistency and accuracy through regular review and quality control. • Completed transcription and annotation of varied audio samples. • Applied linguistic tagging guidelines for disfluency detection. • Ensured dataset readiness for automated speech recognition tasks. • Handled high task volumes with strict quality standards.

Transcribed and annotated large volumes of audio data for ASR and language model training. Tagged lexical disfluencies such as filler words and repetitions to enhance dataset quality. Maintained consistency and accuracy through regular review and quality control. • Completed transcription and annotation of varied audio samples. • Applied linguistic tagging guidelines for disfluency detection. • Ensured dataset readiness for automated speech recognition tasks. • Handled high task volumes with strict quality standards.

2025 - 2025

Education

Work History