Katalina May

Key Skills

Software

Data Annotation Tech

Other

Top Subject Matter

Large Language Model Evaluation

Bilingual Data Annotation

Prompt Engineering

Top Data Types

Document

Text

Top Label Types

Classification

Entity Ner Classification

Evaluation Rating

Prompt Response Writing SFT

Question Answering

Relationship

RLHF

Routing

Text Generation

Text Summarization

Translation Localization

Freelancer Overview

Over 10 years of experience working with language and communication across diverse domains. Native Polish speaker with a Master’s degree in Polish Philology and advanced English proficiency (C1), shaped by long-term international experience. Broad background in communication spanning marketing, public relations, business, education, personal development, and leadership. Currently focused on bilingual data annotation, LLM quality evaluation, and AI language training, including prompt testing, evaluation rubric design, response ranking, and translation/localization.

Labeling Experience

Data Annotation - Document Evaluation

Data Annotation TechDocumentClassificationEvaluation Rating

A document based-data annotation project involving the comparison and evaluation of retail receipts. The task requires analyzing pairs of receipt records and determining whether they refer to the same transaction, despite low image quality, blurred text, and incomplete information.

A document based-data annotation project involving the comparison and evaluation of retail receipts. The task requires analyzing pairs of receipt records and determining whether they refer to the same transaction, despite low image quality, blurred text, and incomplete information.

2025 - 2025

Freelance LLM Quality Evaluator, AI Language Trainer & Data Annotator

Data Annotation TechText

As a Freelance LLM Quality Evaluator, AI Language Trainer, and Data Annotator, I evaluated and ranked AI-generated responses for accuracy, clarity, instruction adherence, and factual consistency. I designed adversarial prompts and contributed to evaluation rubric design to test and improve model robustness. I also refined AI outputs for high-quality linguistic coherence and intent alignment while performing bilingual data annotation, translation, and localization for Polish–English language data. • Evaluated and ranked AI-generated text responses for quality auditing • Designed prompts and participated in red-teaming and model failure detection • Developed and refined evaluation rubrics and guidelines for LLMs • Performed bilingual text annotation, translation, and localization tasks

As a Freelance LLM Quality Evaluator, AI Language Trainer, and Data Annotator, I evaluated and ranked AI-generated responses for accuracy, clarity, instruction adherence, and factual consistency. I designed adversarial prompts and contributed to evaluation rubric design to test and improve model robustness. I also refined AI outputs for high-quality linguistic coherence and intent alignment while performing bilingual data annotation, translation, and localization for Polish–English language data. • Evaluated and ranked AI-generated text responses for quality auditing • Designed prompts and participated in red-teaming and model failure detection • Developed and refined evaluation rubrics and guidelines for LLMs • Performed bilingual text annotation, translation, and localization tasks

2025 - Present

Freelance Bilingual Linguist & Communication Specialist

OtherText

As a freelance Bilingual Linguist & Communication Specialist, I delivered bilingual language analysis, translation, and localization projects involving Polish and English data. I analyzed message clarity, semantic accuracy, and audience alignment, supporting a range of communication and data annotation needs. My work encompassed both linguistic evaluation and annotation for AI-based systems and training data creation. • Performed bilingual text analysis and annotation for communication accuracy • Managed translation and localization tasks for Polish–English projects • Conducted semantic, syntactic, and clarity-focused evaluations for AI systems • Delivered annotated language data for model training and quality assurance

As a freelance Bilingual Linguist & Communication Specialist, I delivered bilingual language analysis, translation, and localization projects involving Polish and English data. I analyzed message clarity, semantic accuracy, and audience alignment, supporting a range of communication and data annotation needs. My work encompassed both linguistic evaluation and annotation for AI-based systems and training data creation. • Performed bilingual text analysis and annotation for communication accuracy • Managed translation and localization tasks for Polish–English projects • Conducted semantic, syntactic, and clarity-focused evaluations for AI systems • Delivered annotated language data for model training and quality assurance

2019 - Present

LLM Response Evaluator - Self-Help Domain

Data Annotation TechTextEmotion RecognitionRLHF

Text-based AI evaluation project focused on assessing model responses in the self-help domain. Tasks involved reviewing user prompts and comparing multiple model responses against criteria such as emotional appropriateness, psychological safety, clarity, and alignment with both explicit and implicit user needs, selecting the most suitable response.

Text-based AI evaluation project focused on assessing model responses in the self-help domain. Tasks involved reviewing user prompts and comparing multiple model responses against criteria such as emotional appropriateness, psychological safety, clarity, and alignment with both explicit and implicit user needs, selecting the most suitable response.

2025 - 2025

Education

Work History