Michele Paima

Key Skills

Software

iMerit

Appen

Other

Top Subject Matter

No subject matter listed

Top Data Types

Text

Image

Top Task Types

Text Generation

Bounding Box

Evaluation Rating

Data Collection

Question Answering

Prompt Response Writing SFT

Classification

Translation Localization

Freelancer Overview

I am a business analyst with hands-on experience in AI model evaluation, data annotation, and quality assurance for large language models. My work has included side-by-side (SxS) evaluation of AI-generated responses, PII tagging, and detailed data quality assessments using web-based and annotation tools. I have contributed to projects focused on natural language processing, consistently providing structured, evidence-based feedback in both English and Spanish to improve model performance. My strong analytical skills, attention to detail, and ability to adapt to remote, fast-paced environments allow me to deliver high-quality results for AI training data and evaluation tasks.

Labeling Experience

Quality Assurance & Risk Assessment Specialist - AI Data Privacy

ImeritTextEvaluation RatingData Collection

Performed dual-role responsibilities including L1 risk assessment and L2 quality control for conversational AI interactions. Evaluated conversations to identify PII and classify risk levels (High/Low Reid), distinguishing between personal data, business information, public figures, and fictional content. Conducted quality assurance reviews on disagreements between human annotators and LLM assessments, making final determinations on complex edge cases. Applied nuanced decision frameworks to assess whether data could narrow down individuals to groups of 100 or fewer people using available resources. Maintained strict accuracy and consistency standards while processing sensitive privacy-related content.

Performed dual-role responsibilities including L1 risk assessment and L2 quality control for conversational AI interactions. Evaluated conversations to identify PII and classify risk levels (High/Low Reid), distinguishing between personal data, business information, public figures, and fictional content. Conducted quality assurance reviews on disagreements between human annotators and LLM assessments, making final determinations on complex edge cases. Applied nuanced decision frameworks to assess whether data could narrow down individuals to groups of 100 or fewer people using available resources. Maintained strict accuracy and consistency standards while processing sensitive privacy-related content.

2025 - 2025

Spanish Language Specialist - PII Tagging & Data Annotation

ImeritTextText Generation

Performed specialized data annotation and PII (Personally Identifiable Information) tagging in Spanish for tech clients. Identified and classified sensitive information including names, addresses, phone numbers, and financial data following established protocols. Worked with specialized annotation tools to ensure consistent tagging according to strict client specifications while maintaining confidentiality standards. Demonstrated high attention to detail and accuracy in processing large volumes of user data.

Performed specialized data annotation and PII (Personally Identifiable Information) tagging in Spanish for tech clients. Identified and classified sensitive information including names, addresses, phone numbers, and financial data following established protocols. Worked with specialized annotation tools to ensure consistent tagging according to strict client specifications while maintaining confidentiality standards. Demonstrated high attention to detail and accuracy in processing large volumes of user data.

2025 - 2025

Conversational AI Tester - Multi-Platform Evaluation & Bug Reporting

OtherTextClassificationQuestion Answering

Conducted comprehensive evaluations of conversational AI systems across multiple messaging platforms including Messenger, WhatsApp and Instagram. Tested AI-generated responses and avatar interactions, evaluating response quality, accuracy, contextual appropriateness, and natural conversation flow. Assessed how AI avatars on Meta Studio responded to user queries across different scenarios, rating responses based on specific criteria including relevance, tone, helpfulness, and platform-specific behavior. Identified and documented bugs, inconsistencies, and performance issues with detailed reproduction steps and severity classifications. Created comprehensive reports analyzing AI response patterns, conversation breakdowns, and areas requiring improvement across both platforms.

Conducted comprehensive evaluations of conversational AI systems across multiple messaging platforms including Messenger, WhatsApp and Instagram. Tested AI-generated responses and avatar interactions, evaluating response quality, accuracy, contextual appropriateness, and natural conversation flow. Assessed how AI avatars on Meta Studio responded to user queries across different scenarios, rating responses based on specific criteria including relevance, tone, helpfulness, and platform-specific behavior. Identified and documented bugs, inconsistencies, and performance issues with detailed reproduction steps and severity classifications. Created comprehensive reports analyzing AI response patterns, conversation breakdowns, and areas requiring improvement across both platforms.

2024 - 2024

Language Localization & AI Quality Evaluator - Spanish LLM Specialist

AppenTextQuestion AnsweringData Collection

Evaluated quality and naturalness of AI-generated responses in Spanish across multiple linguistic domains. Designed strategic prompts to test language model capabilities including grammar, fluency, cultural appropriateness, and contextual accuracy. Conducted comparative evaluations between different AI model responses, rating them based on specific quality criteria such as coherence, relevance, tone, and linguistic correctness. Provided detailed corrections and feedback to improve AI response quality, identifying patterns in model weaknesses and inconsistencies. Applied rigorous evaluation frameworks to assess LLM performance and ensure outputs met native Spanish language standards.

Evaluated quality and naturalness of AI-generated responses in Spanish across multiple linguistic domains. Designed strategic prompts to test language model capabilities including grammar, fluency, cultural appropriateness, and contextual accuracy. Conducted comparative evaluations between different AI model responses, rating them based on specific quality criteria such as coherence, relevance, tone, and linguistic correctness. Provided detailed corrections and feedback to improve AI response quality, identifying patterns in model weaknesses and inconsistencies. Applied rigorous evaluation frameworks to assess LLM performance and ensure outputs met native Spanish language standards.

2024 - 2024

Image Annotation Specialist - Object Detection & Classification

ImeritImageBounding Box

Performed image annotation tasks including bounding box creation, object detection, and image classification for AI training datasets. Accurately identified and labeled objects, people, and visual elements following detailed annotation guidelines. Ensured consistency across large image datasets while maintaining high quality standards. Worked on diverse projects requiring precise spatial recognition and attention to visual detail.

Performed image annotation tasks including bounding box creation, object detection, and image classification for AI training datasets. Accurately identified and labeled objects, people, and visual elements following detailed annotation guidelines. Ensured consistency across large image datasets while maintaining high quality standards. Worked on diverse projects requiring precise spatial recognition and attention to visual detail.

2024 - 2024

Education

Work History