Senior Domain Expert Annotator (CS & Mathematics)
I executed advanced data labeling assignments for post-graduate mathematics, algorithmic problem-solving, and software engineering datasets. My work included pairwise comparisons of LLM outputs using multi-dimensional rubrics for factuality and safety, as well as auditing and correcting machine-generated code and proofs. I also led the design of taxonomy guidelines and adversarial red-teaming protocols to reduce domain-specific misclassifications. • Applied RLHF, pairwise comparison, and red teaming for large language model output evaluation • Performed detailed logical and syntactical error tagging on code and mathematical proofs • Developed annotation guidelines to improve accuracy in advanced mathematics datasets • Used proprietary platforms and multi-modal rubrics to enhance LLM guardrails and decrease hallucinations