Jobs

Inferact, founded by the creators of vLLM, is seeking an inference runtime engineer to join their team in Singapore. This role focuses on pushing the boundaries of LLM and diffusion model serving by optimizing how models execute across diverse hardware and architectures within the core vLLM engine. The ideal candidate will have a deep understanding of transformer architectures, strong Python and PyTorch skills, and experience with LLM inference systems. Your work will directly impact the efficiency and speed of AI inference globally.