Jobs at Modular

The Cloud Inference Engineer is responsible for building and maintaining a scalable LLM inference platform, focusing on distributed systems and machine learning technologies while collaborating across teams to optimize performance.

Drive the product vision for Modular's cloud compute platform, collaborating with teams to enhance AI service capabilities and customer engagement.

As a Senior AI Kernel Engineer, you will design and optimize high-performance kernels for AI inference on GPUs and custom accelerators, improving performance and collaborating with various teams to influence architecture and implementation.

The role involves enhancing a graph compiler for ML models, optimizing performance across hardware platforms, and collaborating on core technologies.

Lead a team building an inference optimization platform for LLMs across GPUs and ASICs. Define technical direction, partner with GTM and engineering to tune customer workloads, create scalable optimization systems, and grow a high-impact performance engineering team.

Profile customer LLM inference workloads end-to-end and apply optimizations across GPU kernels, inference engine, and distributed systems. Build tooling and a repeatable automated optimization platform, partner with GTM and engineering to deploy tuned inference in production, and publish technical insights to shape industry best practices.

Act as the primary technical community expert for Mojo and MAX: answer complex questions, triage GitHub issues/PRs, shape open source and packaging strategy, surface product feedback to engineering, and represent Modular at events to grow and support the developer ecosystem.