Jobs

Together.ai is seeking an Inference Frameworks and Optimization Engineer to design, develop, and optimize distributed inference engines for large language and multimodal models. This role focuses on achieving low-latency, high-throughput inference through GPU/accelerator optimizations and software-hardware co-design. The ideal candidate will have 3+ years of experience in deep learning inference frameworks, distributed systems, or high-performance computing, with proficiency in Python and C++/CUDA. This is a unique opportunity to shape the future of LLM inference infrastructure and push the boundaries of AI performance and scalability.