For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
Randy Warren

Randy Warren

AI Model Evaluator - Healthcare Diagnostics

USA flag
NEW YORK, Usa
$30.00/hrExpertLabelboxLabelimgLabel Studio

Key Skills

Software

LabelboxLabelbox
LabelImgLabelImg
Label StudioLabel Studio
Scale AIScale AI

Top Subject Matter

No subject matter listed

Top Data Types

DocumentDocument
ImageImage
TextText
VideoVideo

Top Label Types

Classification
Diagnosis
Evaluation Rating
Tracking

Freelancer Overview

I am a healthcare AI model evaluator and dental sciences specialist with over three years of hands-on experience in clinical AI response evaluation, medical data annotation, and RLHF workflows. My expertise lies in reviewing and labeling AI-generated diagnostic outputs for factual accuracy, safety, hallucination detection, and logical consistency, particularly within medical and dental domains. I am skilled in structured output ranking, reinforcement learning from human feedback, red teaming, and designing diagnostic prompts to enhance model reasoning. My background in clinical research and advanced dental education allows me to apply evidence-based standards to annotation tasks, ensuring high-quality training data for large language models and clinical decision support systems. I thrive in remote, independent work environments and am adept at using data labeling platforms and evaluation tools to improve AI model performance and safety.

ExpertEnglishPortuguese

Labeling Experience

Scale AI

Medical Document Annotator

Scale AIDocumentClassification
I reviewed, classified, and annotated medical documents and clinical literature as part of AI data training initiatives. Classification tasks covered diagnosis, compliance, and evidence alignment in annotation projects. Supported larger AI training feedback loops through structured document review and labeling. • Synthesized medical documentation for model learning. • Implemented evidence-based documentation workflows. • Participated in multi-modal data training cycles. • Ensured documentation clarity and medical accuracy.

I reviewed, classified, and annotated medical documents and clinical literature as part of AI data training initiatives. Classification tasks covered diagnosis, compliance, and evidence alignment in annotation projects. Supported larger AI training feedback loops through structured document review and labeling. • Synthesized medical documentation for model learning. • Implemented evidence-based documentation workflows. • Participated in multi-modal data training cycles. • Ensured documentation clarity and medical accuracy.

2022 - 2025
LabelImg

Medical Image Annotator

LabelimgImageDiagnosis
I performed diagnostic labeling on medical and dental images as part of structured annotation workflows. Labeling included identifying clinically significant features and aligning outputs to diagnostic guidelines. Integrated these annotations into supervised fine-tuning and model evaluation cycles. • Applied medical diagnostics expertise to image annotation. • Used labeling tools for images and radiographs. • Ensured annotations matched evidence-based and regulatory standards. • Collaborated with red teaming and safety review processes.

I performed diagnostic labeling on medical and dental images as part of structured annotation workflows. Labeling included identifying clinically significant features and aligning outputs to diagnostic guidelines. Integrated these annotations into supervised fine-tuning and model evaluation cycles. • Applied medical diagnostics expertise to image annotation. • Used labeling tools for images and radiographs. • Ensured annotations matched evidence-based and regulatory standards. • Collaborated with red teaming and safety review processes.

2022 - 2025
Label Studio

AI Model Evaluator and Clinical Data Annotator

Label StudioTextEvaluation Rating
I evaluated and annotated AI-generated clinical and dental outputs, focusing on text-based model responses. I ranked outputs using structured rubrics to assess accuracy, safety, and compliance with evidence-based guidelines. Responsible for comparative ranking as part of RLHF processes and provided feedback for model improvement. • Identified hallucinations, unsafe recommendations, and reasoning errors. • Designed diagnostic prompt scenarios to test model reasoning. • Performed safety and compliance reviews on model outputs. • Contributed to reinforcement learning and fine-tuning cycles.

I evaluated and annotated AI-generated clinical and dental outputs, focusing on text-based model responses. I ranked outputs using structured rubrics to assess accuracy, safety, and compliance with evidence-based guidelines. Responsible for comparative ranking as part of RLHF processes and provided feedback for model improvement. • Identified hallucinations, unsafe recommendations, and reasoning errors. • Designed diagnostic prompt scenarios to test model reasoning. • Performed safety and compliance reviews on model outputs. • Contributed to reinforcement learning and fine-tuning cycles.

2022 - 2025

Education

C

Columbia University College of Dental Medicine

Doctor of Philosophy, Dental Sciences

Doctor of Philosophy
2021 - 2024
N

New York University College of Dentistry

Master of Dental Surgery, Conservative Dentistry and Endodontics

Master of Dental Surgery
2018 - 2021

Work History

N

New York City Hospital

Clinical Research & Data Analyst

New York
2018 - 2021