AI Operations Specialist (Contract)
As an AI Operations Specialist at Handshake AI, I led red-teaming efforts to uncover vulnerabilities in LLM safety filters. My work involved structured feedback and iterative evaluation for improved model robustness. I also helped design internal labeling rubrics to enhance annotation consistency across teams. • Led comprehensive red-teaming workflows targeting LLM safety features. • Developed structured, actionable feedback loops for iterative improvement. • Architected guidelines that reduced inter-annotator disagreement by 15%. • Curated synthetic datasets for technical domain gap areas.