Role OverviewDesign coding tasks that challenge frontier AI coding agents. Each task is a self-contained Docker environment with a broken piece of software; an AI agent attempts the fix; automated tests verify the outcome.
What You Will Do
Invent a realistic developer scenario, build a reproducible Docker environment, write pytest tests, and create an instruction.md file. Calibrate difficulty so current state-of-the-art agents solve the task 20–60% of the time.
Why It Might Be a Fit
You have 3+ years of production software development experience in one backend stack (Python, Go, Node.js, Java, or Rust) and are fluent in Python + pytest. You have experience with Docker authoring, Linux & Bash, and AI coding agents.
Requirements
- 3+ years of production software development experience in one backend stack (Python, Go, Node.js, Java, or Rust)
- Python + pytest fluency
- Docker authoring experience
- Linux & Bash experience
- AI coding agent experience (Claude Code, Cursor, Roo Code, or similar)
- English proficiency (B2+ written)
Benefits
- Paid contributions up to $35/hour
- Task-based compensation equivalent to hourly rate, depending on performance and volume
- Incentive payments for some projects
]]>