AI Annotator, Reviewer & Evaluator (Freelance)
Annotated image, video, audio, and text data for various AI projects using different labeling techniques. Reviewed and quality-checked annotation batches for error detection and guideline compliance. Calibrated with teams to align on standards and led calibration sessions. Evaluated AI model outputs using RLHF, preference ranking, and fine-tuning feedback. • Performed tasks including bounding box, segmentation, classification, and object detection. • Generated and rated prompts and responses for RLHF and fine-tuning tasks. • Worked across platforms such as Labelbox, Label Studio, Prodigy, CVAT, Scale AI, Amazon SageMaker Ground Truth, Remotasks, and proprietary tools. • Ensured content safety, conducted red teaming, and provided training to new annotators.