AI Operations & Quality Specialist – Annutacon / Verity Lab
As an AI Operations & Quality Specialist at Annutacon / Verity Lab, I reviewed and audited video and text model outputs across multiple evaluation divisions. I performed RLHF annotation, preference ranking, world knowledge benchmarking, and quality auditing for dynamic, audio-visual, and emotion-based model outputs. Regularly assigned reviewer duties, I ensured annotation accuracy and compliance while reporting systemic quality findings to the team. • Evaluated video model outputs for audiovisual, identity, and emotion consistency against RLHF rubrics. • Audited annotator work, provided calibration feedback, and reported systemic issues impacting data quality. • Built and reviewed benchmark questions targeting model knowledge gaps across several domains. • Ran reward modeling and preference ranking across varied content types according to project rubrics.