Role OverviewEvaluate JSON-formatted AI model outputs against defined grading rubrics, reading and understanding written task descriptions and rubrics, and parsing, reading, and assessing JSON-based outputs.
What You Will Do
Evaluate JSON-formatted AI model outputs, read and understand written task descriptions and rubrics, and parse, read, and assess JSON-based outputs.
Why It Might Be a Fit
Must be comfortable reading and interpreting JSON files, available to start immediately, and have prior Mercor experience in applying detailed rubrics and evaluation criteria consistently.
Requirements
- Available to start today, July 24, running to July 27-28
- Comfortable reading and interpreting JSON files
- Based in the US
- Access to a desktop or laptop computer (no Chromebooks)
]]>