Role OverviewThe Retail SME - AI Evaluation Expert will guide research and engineering teams to close knowledge gaps in retail merchandising, category management, and operations reasoning. They will design challenging, domain-relevant retail tasks and evaluate AI model outputs against structured rubrics.
What You Will Do
The main day-to-day responsibilities of this role include designing and evaluating retail tasks, providing clear feedback on AI model outputs, and collaborating with other subject matter experts to ensure consistency and accuracy in training data.
Why It Might Be a Fit
To be a good fit for this role, you should have 8+ years of dedicated professional experience in retail, prior experience evaluating LLM/AI model outputs, and strong verbal and written communication skills.
Requirements
- 8+ years of dedicated professional experience in retail
- Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria
- Demonstrable career progression
- Ability to engage reliably for at least 35 hours/week during weekdays
- Verbal and written communication skills, problem-solving skills, and interpersonal skills
]]>