DevOps Engineer - AI Model Evaluator

Mercor
Any Location, IA
Job Description
Role Overview

Mercor connects elite creative and technical talent with leading AI research labs. The DevOps Engineer - AI Model Evaluator will use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.

What You Will Do

Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation. Identify bugs, edge cases, reliability issues, and failure modes in model outputs.

Why It Might Be a Fit

The ideal candidate will have 2+ years of professional DevOps, SRE, or Cloud Engineering experience and regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.

Requirements

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions

Benefits

  • $400 per accepted task
  • Compensation tied to accepted work
]]>