For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
M

Millan

Search Quality Evaluator

AUSTRALIA flag
Sydney, Australia
ExpertMindriftAppenRemotasks

Key Skills

Software

MindriftMindrift
AppenAppen
RemotasksRemotasks

Top Subject Matter

Search relevance
AI-generated content
Nlp Domain Expertise

Top Data Types

TextText
DocumentDocument

Top Task Types

No task types listed

Freelancer Overview

Search Quality Evaluator. Brings 5+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Mindrift, Appen, and Remotasks. Education includes Doctor of Philosophy, University of Sydney (2024) and Master of Arts, University of Melbourne (2023). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Expert

Labeling Experience

Mindrift

Search Quality Evaluator

MindriftText
I evaluated search engine results and AI-generated answers for relevance, accuracy, and usefulness following detailed guidelines. I compared outputs from different systems, ranked them by quality, and provided justifications for my ratings. I actively participated in calibration sessions and contributed to refining evaluation guidelines. • Rated AI-generated text for factuality, coherence, and user needs • Consistently ranked in top 10% for quality audits • Applied detailed rubrics based on E-A-T and needs met standards • Provided feedback to improve quality assurance across projects.

I evaluated search engine results and AI-generated answers for relevance, accuracy, and usefulness following detailed guidelines. I compared outputs from different systems, ranked them by quality, and provided justifications for my ratings. I actively participated in calibration sessions and contributed to refining evaluation guidelines. • Rated AI-generated text for factuality, coherence, and user needs • Consistently ranked in top 10% for quality audits • Applied detailed rubrics based on E-A-T and needs met standards • Provided feedback to improve quality assurance across projects.

2024 - Present
Appen

AI Quality Assurance Specialist

AppenText
I annotated large datasets of AI-generated responses with a focus on fluency, factual accuracy, and alignment with user intent. I participated in specialized projects involving LLM outputs for both search and conversational AI systems. I provided structured feedback to machine learning teams to facilitate model improvements. • Maintained a 98% alignment score across assignments • Used structured rubrics to evaluate LLM-generated outputs • Worked remotely as part of distributed quality teams • Contributed to measurable improvements in model performance.

I annotated large datasets of AI-generated responses with a focus on fluency, factual accuracy, and alignment with user intent. I participated in specialized projects involving LLM outputs for both search and conversational AI systems. I provided structured feedback to machine learning teams to facilitate model improvements. • Maintained a 98% alignment score across assignments • Used structured rubrics to evaluate LLM-generated outputs • Worked remotely as part of distributed quality teams • Contributed to measurable improvements in model performance.

2023 - 2024
Remotasks

Search Relevance Rater

RemotasksText
I rated search results for experimental ranking algorithms used by a major search engine project. I completed a high volume of individual rating tasks while following strict project guidelines and maintaining consistent quality. I used annotation platforms to deliver detailed feedback for search relevance experiments. • Performed over 5,000 rating tasks on search results • Maintained 95% consistency with gold-set standards • Applied structured rubrics during rapid task completion • Used Remotasks/Scale AI platforms for annotation workflow.

I rated search results for experimental ranking algorithms used by a major search engine project. I completed a high volume of individual rating tasks while following strict project guidelines and maintaining consistent quality. I used annotation platforms to deliver detailed feedback for search relevance experiments. • Performed over 5,000 rating tasks on search results • Maintained 95% consistency with gold-set standards • Applied structured rubrics during rapid task completion • Used Remotasks/Scale AI platforms for annotation workflow.

2023 - 2023

Education

U

University of Melbourne

Master of Arts, Computational Linguistics

Master of Arts
2022 - 2023
U

University of Melbourne

Bachelor of Arts, English Language and Literature

Bachelor of Arts
2018 - 2021

Work History

U

University of Sydney

Assistant Professor

Sydney
2024 - Present
U

University of Melbourne

Teaching Assistant

Melbourne
2022 - 2023