Critical Reviewer - Fully Remote

Mercor
San Francisco, NY
Job Description
We are looking for a Critical Reviewer to evaluate AI-generated responses, provide structured written feedback, and develop clear written rationales to enhance model performance. The ideal candidate will have strong analytical and written communication skills, a bachelor's degree from a top-100 globally ranked university, and native English fluency.

Requirements

  • Evaluate AI-generated responses to enhance reasoning and rigor in model outputs.
  • Provide structured written feedback to improve training data quality and downstream performance.
  • Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
  • Collaborate with AI research teams to ensure consistency and coverage across datasets.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Benefits

  • Competitive hourly rate
]]>