Search Relevance Task
I worked on an e-commerce search relevance evaluation project in the Polish language, focused on assessing how well offered products matched user search queries. The task involved manual relevance rating of query–product pairs based on defined relevance categories: Exact, Substitute, Complementary, Irrelevant, and Unjudgeable, following detailed annotation guidelines. Project Size & Quality Measures The project consisted of 100 e-commerce search queries, each evaluated for intent match, product relevance, and overall usefulness to the customer. Quality was maintained through strict guideline adherence, careful linguistic and contextual analysis in Polish, and consistency checks to ensure accurate and reliable relevance judgments across all annotations.