Critical Reviewer - Fully Remote

Mercor
New York, NY
Category Research
Job Description
We are looking for a Critical Reviewer to evaluate AI-generated responses, provide structured written feedback, and develop clear rationales. The role involves working independently and asynchronously to improve AI model performance. The ideal candidate should have a bachelor's degree from a top-100 globally ranked university, strong analytical and written communication skills, and native English fluency.

Requirements

  • Evaluate AI-generated responses to enhance reasoning and rigor in model outputs.
  • Provide structured written feedback to improve training data quality and downstream performance.
  • Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
  • Collaborate with AI research teams to ensure consistency and coverage across datasets.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.
]]>