AI Annotator
1. Mapping: Ensure clarity in Option Key mapping to minimize ambiguity, reduce QA rejections, and maintain alignment with the client’s taxonomy. These guidelines apply to all items, regardless of whether a specific attribute is displayed on the category page. 2. Evaluation/Rating: Reframe the previous rationales using a new scoring rubric. Write a rationale for the Overall Quality rating for a single response task and choice between the two models for a pairwise task. 3. Data Collection: Analyze the merchant's collection data to determine whether it is taxonomy-related, identify any gaps between the merchant's intent and the standardized attributes, and assess the overall match quality.