Jobs

SambaNova Systems is seeking a Senior ML Infrastructure Engineer to design, build, and operate production-grade inference infrastructure for their RDU architecture. This role is central to SambaNova's inference-first mission, transforming state-of-the-art inference techniques into reliable, high-performance services for customers. The engineer will own end-to-end systems, including request scheduling, advanced decoding algorithms, caching, and API surfaces, while collaborating closely with ML, compiler, runtime, and product teams. Ideal candidates will have 5+ years of experience in large-scale distributed systems, strong software engineering fundamentals, and working knowledge of modern LLM inference techniques.