Business Operations Expert - Evaluator

Mercor
San Francisco, CA
Job Description
Role Overview

The Business Operations Expert - Evaluator will work independently to evaluate AI model-generated outputs for a specific task, ranking them 1-5 with evidence-based rationales. The role requires 5+ years of experience in Admin, Marketing, Human Resources, or Accounting, and the ability to write clear, specific rationales within a short turnaround window.

What You Will Do

The main day-to-day responsibilities include solving a realistic task using source files, reviewing model-generated outputs, ranking them, and providing structured feedback on the task and study design.

Why It Might Be a Fit

This role might be a fit for candidates with 5+ years of experience in Admin, Marketing, Human Resources, or Accounting, who can work independently and provide clear, specific rationales within a short turnaround window.

Requirements

  • 5+ years of hands-on professional experience in Admin, Marketing, Human Resources, or Accounting
  • Currently or recently practicing to judge work as a working professional would
  • Ability to write a clear, specific, evidence-grounded rationale for a judgment
  • Reliable within a short turnaround window

Benefits

  • Hourly contractor compensation ($60-$80/hour)
]]>