Role OverviewEvaluate JSON-formatted AI model outputs against defined grading rubrics. Work independently to meet tight deadlines within 12-24 hours. Ensure attention to detail and consistency in applying rubric criteria.
What You Will Do
Read and understand written task descriptions and rubrics. Parse, read, and assess JSON-based outputs, grading them against provided rubrics.
Why It Might Be a Fit
Must be comfortable reading and interpreting JSON files. Prior Mercor experience is preferred, especially in applying detailed rubrics and evaluation criteria consistently.
Requirements
- Available to start today, July 24, running to July 27-28.
- Comfortable reading and interpreting JSON files.
- Based in the US.
- Access to a desktop or laptop computer (no Chromebooks).
Benefits
- Flexible work arrangement (20–40 hours/week)
- Competitive hourly rate ($50–$175/hour)
]]>