AI Annotation Specialist

Mercor
New York, NY
Job Description
Role Overview

Mercor connects elite creative and technical talent with leading AI research labs. The AI Annotation Specialist will review recorded sessions where users interact with an AI assistant via voice and camera, comparing the assistant's responses to visible video content and identifying hallucinated or fabricated visual details.

What You Will Do

Review recorded sessions, score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use, and write detailed comments supporting scores with concrete session evidence.

Why It Might Be a Fit

The ideal candidate will have native or native-level English, attention to detail, and consistent rubric application. Experience in data annotation, linguistic QA, content moderation, or AI model evaluation is preferred.

Requirements

  • Native or native-level English, spoken and written
  • Clear, precise written English
  • An Android phone with a working camera and microphone
  • Attention to detail and consistent rubric application
]]>