DSA Expert, Senior Reviewer
As a DSA Expert and Senior Reviewer at Scale AI and DataAnnotationApp, I contributed extensively to reinforcement learning from human feedback (RLHF) and supervised fine-tuning (SFT) projects for advanced AI models. My responsibilities included writing high-quality prompts, evaluating AI responses, providing golden code and test suite, and rating model behaviors. I excelled in crafting evaluation tasks for both single-turn and multi-turn conversations, deeply testing large language models like Opus, Gemini, and Qwen through prompt engineering and rubrics authoring. • Developed and reviewed over 300 DSA-related prompts for AI evaluation • Authored 200+ prompts to test and curate model conversational behaviors • Provided high-quality RLHF and SFT data for model improvement • Rated as an 'excellent reviewer (Oracle)' across multiple projects