Senior Staff Software Engineer, Systems Infrastructure

This role will be based in Sunnyvale or Mountain View, CA. The work location of this role is hybrid, meaning it will be performed both from home and from a LinkedIn office on select days, as determined by the business needs of the team. The team sits at the center of LinkedIn’s AI platform, owning the layer between model training and production serving. The work focuses on making large-scale models run faster, cheaper, and more efficiently on GPUs at LinkedIn scale.

What You Will Do

Lead the design, development, and optimization of LinkedIn’s large-scale LLM serving infrastructure, drive performance improvements across AI inference systems, including latency, throughput, GPU utilization, and cost efficiency, build and scale online and offline inference systems for LLMs and other AI models.

Why It Might Be a Fit

We are looking for a Senior Staff Software Engineer with deep expertise at the intersection of systems, machine learning, GPU infrastructure, and large-scale inference. This is a highly technical, high-leverage role for someone who enjoys going deep into how models interact with runtimes, compilers, and hardware, and who wants to drive meaningful improvements in performance, cost, latency, and scalability across LinkedIn’s AI systems.

Requirements

• BA/BS degree in Computer Science or related technical field, or equivalent practical experience
• 8+ years of experience in software engineering, distributed systems, infrastructure, or machine learning systems
• Experience building or optimizing large-scale production ML systems, model serving platforms, or AI infrastructure
• Experience with GPU-based systems, CUDA, kernel optimization, or hardware-aware performance tuning
• Experience with large-scale inference systems, including latency, throughput, reliability, and cost optimization
• Experience with deep learning frameworks such as PyTorch, TensorFlow, or similar
• Experience programming in one or more systems languages such as C++, Go, Python, or Java

Benefits

• Annual performance bonus
• Stock
• Benefits
• Incentive compensation plans