Machine Learning Systems Engineer

Recruiting from Scratch
Palo Alto, CA
Job Description
Role Overview

As a Machine Learning Systems Engineer, you'll work on the infrastructure that enables large-scale model training and inference, contributing directly to systems that make advanced AI models faster, more efficient, and more reliable. This is an opportunity to join an elite AI team where you can work at the intersection of machine learning, distributed systems, GPU infrastructure, and high-performance model serving.

What You Will Do

Design, build, and operate infrastructure supporting large-scale ML training and inference systems, develop high-performance systems for serving and deploying large language models, optimize model inference for latency, throughput, memory utilization, and cost efficiency, and build and maintain production ML infrastructure across GPU and cloud environments.

Why It Might Be a Fit

This is an opportunity to join a highly technical AI company working on one of the most important challenges in modern machine learning: making advanced language models significantly faster and more efficient. You'll work directly on the infrastructure powering next-generation AI models, solving difficult problems across distributed systems, GPU computing, model inference, and production ML infrastructure.

Requirements

  • 2–5 years of professional experience in ML Systems Engineering, ML Infrastructure, AI Infrastructure, or related engineering roles
  • Experience building and operating production ML systems
  • Experience working on infrastructure for model training and/or inference
  • Experience deploying machine learning models into production environments
  • Experience working with GPU-based computing infrastructure
  • Experience building scalable ML or distributed systems
  • Experience working with modern deep learning frameworks
  • Experience operating in technically demanding engineering environments
  • Strong ownership mentality with demonstrated execution ability
  • Comfortable working on complex technical problems with limited precedent
  • Strong interest in machine learning systems and AI infrastructure
  • Ability to operate effectively in a fast-moving, research-driven environment

Benefits

  • Base Salary: $200,000 – $300,000
  • Competitive Equity Package
  • Opportunity to work on cutting-edge diffusion-based language models
  • Direct collaboration with world-class AI researchers and founders
  • Opportunity to work on large-scale ML training and inference infrastructure
  • Exposure to advanced GPU optimization and AI systems engineering
  • Significant technical ownership in a small, elite engineering organization
  • Opportunity to influence foundational ML infrastructure and model-serving architecture
  • High-growth AI company environment
  • Opportunity to work on AI systems being deployed by Fortune 500 organizations
]]>