Role OverviewAs a Shop App Annotator, you will evaluate full shopper-agent conversations, identify issues, and classify them with primary and secondary tags. You will work independently and asynchronously to maintain consistency in tagging across conversations.
What You Will Do
Your main day-to-day responsibilities will include evaluating conversations, identifying issues, and classifying them with primary and secondary tags. You will also write concise comments explaining the shopper's intent, the agent's actions, and the rationale for the tags.
Why It Might Be a Fit
To be a fit for this role, you should have rule discipline to apply a fixed taxonomy consistently, comfort reading structured traces, and restraint under ambiguity. You should also have clear, concise written English and experience with consumer e-commerce, annotation, or model-evaluation work.
Requirements
- Rule discipline to apply a fixed taxonomy consistently
- Comfort reading structured traces to understand agent actions
- Restraint under ambiguity to use the unknown label appropriately
- Clear, concise written English for explaining labeling decisions
Benefits
- Flexible work arrangement
- Competitive hourly rate ($40–$50/hour)
- Opportunity to work with leading AI research labs
]]>