Baseball Expert - AI Evaluator

Mercor
New York, NY
Job Description
Role Overview

Mercor is seeking a Baseball Expert - AI Evaluator to follow live MLB postseason games, ask AI assistants real fan questions, and rate each response for helpfulness, factual accuracy, and presentation.

What You Will Do

The role involves running the same question on two AI products side by side, capturing share links and full screenshots of every conversation, and working independently and asynchronously during game windows on scheduled game days.

Why It Might Be a Fit

The ideal candidate will have solid baseball knowledge, be comfortable using AI chat assistants and web search, and have strong written English and sharp attention to detail.

Requirements

  • Based in the United States
  • 1+ year of professional work experience
  • Solid baseball knowledge: rules, teams, players, and postseason structure
  • Comfortable using AI chat assistants and web search
  • Strong written English and sharp attention to detail
]]>