Legal Domain Expert — AI Training & Evaluation

Mercor
San Francisco, CA
Category Legal
Job Description
Role Overview

Evaluate the quality of legal knowledge work tasks and AI model outputs, develop instruction specs, and provide written feedback to improve AI model performance. Collaborate with the research team to build legal-specific skills and tools.

What You Will Do

Evaluate AI model outputs, develop instruction specs, design challenging legal tasks, and provide written feedback to improve AI model performance.

Why It Might Be a Fit

Must have a Juris Doctor (JD) from an accredited law school, 5+ years of substantive post-qualification legal practice, and experience with large language models in professional work.

Requirements

  • Juris Doctor (JD) from an accredited law school
  • 5+ years of substantive post-qualification legal practice
  • Specialization in a substantive practice area (e.g., corporate, litigation, regulatory)
  • Seniority with real ownership of matters
  • Active admission to at least one U.S. state bar, in good standing
  • Experience with large language models in professional work
  • Ability to commit to 40 hours per week for 6 months
  • Reside in the Bay Area, California and able to come on-site when required

Benefits

  • W-2 employment with Cincinnatus LLC
  • Paid weekly
]]>