Role OverviewWe are seeking experienced Senior Software Engineers to contribute to advanced large language model evaluation, coding benchmark development, and AI-assisted software-engineering research. The work combines senior-level software engineering judgement with structured evaluation and benchmark design.
What You Will Do
Curate high-quality code examples, develop precise reference solutions, evaluate AI-generated code, design mechanisms for automated verification, and assess code quality against professional engineering standards.
Why It Might Be a Fit
Ideal candidates will have several years of professional software-engineering experience, strong full-stack development capabilities, and a deep understanding of software architecture and system design.
Requirements
- Several years of professional software-engineering experience
- At least 2 years of continuous full-time experience at a top-tier product company
- Strong full-stack development capabilities
- Experience building scalable, production-grade software
- Deep understanding of software architecture and system design
- Strong knowledge of debugging and code-quality assessment
- Experience reviewing and improving complex production code
- Proficiency in one or more of Python, JavaScript, C/C++, Java, Rust, or Go
- ReactJS experience is valuable for frontend-oriented assignments
- Strong understanding of API design and production implementation
- Familiarity with software monitoring and operational maintenance
- Ability to reason across the complete software-engineering lifecycle
- Strong analytical and problem-solving capabilities
- Excellent written and verbal communication skills
- Ability to produce clear and structured evaluation rationales
- Comfortable collaborating with research and technical teams in a remote environment
Benefits
- Competitive hourly rate
- Flexible workload of up to 40 hours per week
- Partial overlap with PST working hours is required
]]>