Role OverviewAs a Senior Python Engineer, you will create challenging tasks and evaluation criteria within realistic simulated environments to evaluate AI coding agents. You will work on a project-based basis, not permanent employment, and have the flexibility to choose when and how to work.
What You Will Do
Your main responsibilities will include creating tasks from intermediate states of simulated environments, writing tests to verify agent solutions, and iterating on tasks and tests based on QA feedback.
Why It Might Be a Fit
This role requires 8+ years of experience in software development, with a strong focus on Python, JavaScript/TypeScript, Docker, Postgres, Kafka, and Redis. You will need to have experience writing tests (functional, integration) and a high level of English proficiency (B2+).
Requirements
- 8+ years in software development
- Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
- Experience writing tests (functional, integration)
- English proficiency - B2+
Benefits
- Paid per accepted task
- Rate depends on qualification tier and efficiency
- Up to the equivalent of $200/hr
]]>