Ilyas Sayh

Key Skills

Software

Scale AI

Remotasks

Labelbox

Top Subject Matter

AI Response Evaluation and RLHF

Chatbot Evaluation and Safety Review

Machine Learning Data Annotation

Top Data Types

Text

Image

Video

Top Task Types

RLHF

Classification

Bounding Box

Evaluation Rating

Transcription

Freelancer Overview

AI Data Annotator & Evaluator | Scale AI. Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Outlier AI, and Remotasks. Education includes Bachelor of Science, Sup’RH (2025). AI-training focus includes data types such as Text and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

LLM Evaluator & AI Response Reviewer | Outlier AI

Text

As an LLM Evaluator & AI Response Reviewer at Outlier AI, I evaluated chatbot responses for helpfulness, correctness, and safety using structured criteria. I performed pairwise comparison tasks and flagged unsafe or biased content to improve AI performance. I ensured that all reviews were well-documented and justified per project requirements. • Rated and evaluated chatbot-generated text. • Flagged biased, toxic, or unsafe responses based on review guidelines. • Provided detailed written justifications for decisions. • Ensured reliability and safety of model outputs.

As an LLM Evaluator & AI Response Reviewer at Outlier AI, I evaluated chatbot responses for helpfulness, correctness, and safety using structured criteria. I performed pairwise comparison tasks and flagged unsafe or biased content to improve AI performance. I ensured that all reviews were well-documented and justified per project requirements. • Rated and evaluated chatbot-generated text. • Flagged biased, toxic, or unsafe responses based on review guidelines. • Provided detailed written justifications for decisions. • Ensured reliability and safety of model outputs.

2025 - 2026

AI Data Annotator & Evaluator | Scale AI

Scale AITextRLHF

As an AI Data Annotator & Evaluator at Scale AI, I performed RLHF tasks such as ranking and comparing multiple AI outputs using strict annotation guidelines. I identified factual errors, hallucinations, and guideline violations while ensuring quality and accuracy in annotations. I conducted thorough quality assurance and validation of submitted outputs. • Ranked and compared AI-generated text responses for preference alignment. • Identified errors and inconsistencies in AI outputs in English, French, and Arabic. • Reviewed and corrected annotation work before submission. • Maintained adherence to project guidelines and high-quality standards.

As an AI Data Annotator & Evaluator at Scale AI, I performed RLHF tasks such as ranking and comparing multiple AI outputs using strict annotation guidelines. I identified factual errors, hallucinations, and guideline violations while ensuring quality and accuracy in annotations. I conducted thorough quality assurance and validation of submitted outputs. • Ranked and compared AI-generated text responses for preference alignment. • Identified errors and inconsistencies in AI outputs in English, French, and Arabic. • Reviewed and corrected annotation work before submission. • Maintained adherence to project guidelines and high-quality standards.

2025 - 2026

AI Data Annotation Projects | Remotasks

RemotasksTextClassification

During data annotation projects at Remotasks, I labeled various datasets for machine learning, working with text, images, and structured data. I completed annotation tasks such as sentiment analysis, intent classification, and entity recognition while ensuring accuracy. I reviewed my annotation work for consistency and followed detailed instructions. • Performed text classification, entity recognition, and sentiment analysis. • Annotated and reviewed both text and image data. • Followed comprehensive annotation guidelines for each project. • Used CVAT and Remotasks platform for annotation activities.

During data annotation projects at Remotasks, I labeled various datasets for machine learning, working with text, images, and structured data. I completed annotation tasks such as sentiment analysis, intent classification, and entity recognition while ensuring accuracy. I reviewed my annotation work for consistency and followed detailed instructions. • Performed text classification, entity recognition, and sentiment analysis. • Annotated and reviewed both text and image data. • Followed comprehensive annotation guidelines for each project. • Used CVAT and Remotasks platform for annotation activities.

2025 - 2025

Education

Work History