Role OverviewEvaluate full shopper and agent conversations, identify issues, and classify them with primary and secondary tags. Write concise comments explaining shopper intent, agent actions, and rationale for tags. Work independently and asynchronously to maintain consistency across evaluations.
What You Will Do
Evaluate full shopper and agent conversations, identify issues, and classify them with primary and secondary tags. Write concise comments explaining shopper intent, agent actions, and rationale for tags.
Why It Might Be a Fit
Must have rule discipline for consistent taxonomy application, comfort reading structured traces, and restraint under ambiguity. Preferred qualifications include consumer e-commerce fluency, annotation experience, and familiarity with the Shop app or other AI shopping assistants.
Requirements
- Rule discipline for consistent taxonomy application
- Comfort reading structured traces to understand agent actions
- Restraint under ambiguity to use the unknown label appropriately
- Clear, concise written English for effective communication
]]>