Role OverviewJoin our team to build and evolve next-generation inference systems for large-scale online traffic, optimize distributed inference, and develop high-performance kernels for frontier model architectures.
What You Will Do
Build and evolve next-generation inference systems, optimize distributed inference, develop high-performance kernels, and explore AI-driven infrastructure for inference systems.
Why It Might Be a Fit
Successful candidates must be able to commit to an onboarding date by the end of the year, have a strong understanding of asynchronous scheduling, resource pooling, and load balancing, and have strong engineering skills in performance optimization and production system development.
Requirements
- PhD degree in Software Development, Computer Science, Computer Engineering, or a related technical discipline
- Familiarity with large-model architectures
- Strong system design skills for complex, high-concurrency environments
- Strong understanding of asynchronous scheduling, resource pooling, and load balancing in distributed microservice systems
- Strong engineering skills in performance optimization and production system development
]]>