Jobs

Inferact is seeking a Cloud Orchestration Engineer to build the operational backbone for vLLM, ensuring reliable and scalable AI model serving. This role involves designing systems for cluster management, deployment automation, and production monitoring across various cloud platforms and on-premise infrastructure. The ideal candidate will have strong experience with Kubernetes, container orchestration, and proficiency in Python/Rust/Go, with a focus on managing GPU clusters and improving ML system reliability.