Fine-Grained Criteria Creation
Created fine-grained criteria for a model response based on a provided prompt. Evaluated and compared two model responses using the fine-grained criteria.
Hire this AI Trainer
Sign in or create an account to invite AI Trainers to your job.
No subject matter listed
As an experienced freelancer in LLM training, I have contributed stellar work to a range of global projects for high-profile clients. My areas of expertise include RLHF, SFT, rubric/criteria creation and evaluation, fact-checking, classification, and reviewing and correcting other contributors’ attempts. My professional expertise in writing, research, and text analysis and my PhD in Rhetoric enable me to efficiently and effectively deliver exceptional work in a timely manner, as evidenced by the 20+ distinct projects I have contributed to.
Created fine-grained criteria for a model response based on a provided prompt. Evaluated and compared two model responses using the fine-grained criteria.
I selected appropriate images, created complex prompts about the image(s) that were designed to get the LLM to fail, then evaluated and compared responses across two models.
Evaluated AI-generated action items based on email threads and AI-generated email responses to customer service inquiries.
Evaluated and compared AI model responses according to whether the model was stereotyping or over-generalizing and how it handled sensitive prompts such as those related to medical advice, violence, and sexuality and sexual health.
Evaluated and compared responses from two different AI models using criteria including truthfulness, safety, instruction-following, writing style, and delightfulness.
PhD, Rhetoric and Composition
Master of Arts, English
Instructor, English Department
Director, Tutoring and Writing Center