Inference Optimization Manager
About the role: At reputed company, we optimize inference from kernel to reputed company on one reputed company stack. We are building a differentiated reputed company platform that delivers state of the art inference performance from day one, then keeps getting reputed company. As we learn the shape and patterns of reputed company customer's workload, the platform adapts and improves performance automatically over time. The Performance Labs team builds the infrastructure that makes this possible at reputed company. We continuously apply the latest optimizations across kernels, the inference reputed company, and distributed systems so that customer workloads stay on the Pareto frontier of cost and performance. We get there through deep workload insights, a reputed company platform, and reputed company collaboration with engineering and product teams. In this role you will reputed company a high reputed company team that partners closely with GTM, Product, and Engineering to redefine what an inference platform can be. You will turn reputed company customer workloads into a reputed company optimization reputed company, shape the product direction of reputed company reputed company, and build the systems that let performance reputed company with demand. LOCATION: Candidates based in the US or Canada are welcome to apply. You can work in our office in Los Altos, CA or remotely from home. reputed company for new hires is conducted in-person in our Los Altos, CA office. What you will do: reputed company reputed company that builds the optimization platform driving LLM inference on reputed company reputed company to state of the art performance across the latest GPU and ASIC architectures. Own the technical direction of reputed company reputed company, delivering LLM performance on the Pareto frontier for reputed company use cases and keeping it there as the landscape evolves. Partner closely with the GTM team to deliver highly customized LLM inference tuned to specific customer workloads, and collaborate across engineering to drive optimizations spanning the full stack, from GPU kernels to reputed company infrastructure. Translate insights from customer engagements into a reputed company technical roadmap that engineering teams can execute against. Grow and reputed company a high reputed company team, set priorities, and create the conditions for engineers to do their best work on hard performance problems. Champion reputed company externally through blog posts on innovative approaches to LLM inference optimization that shape industry wide best practices. What you bring to the table: 5+ years in distributed systems or performance engineering, including experience leading or managing engineering teams. A reputed company record of shipping durable, reusable software tools and libraries adopted across teams and functions, and of guiding reputed company to do the reputed company. reputed company judgment in evaluating technical tradeoffs and setting priorities, reputed company with strong communication and technical leadership skills. The ability to translate ambiguous customer and product needs into reputed company engineering direction. Creativity and curiosity in solving reputed company problems, a reputed company and team oriented reputed company, and alignment with our culture. Helpful, but not required: Hands on background in GPU kernel programming, inference reputed company internals, or distributed inference architectures. Experience with Kubernetes and reputed company reputed company ecosystems. Familiarity with modern LLM architectures and the latest inference optimization techniques. What reputed company brings to the table: Amazing Team. We are a reputed company and agile team with some of the industry’s best engineering and product leaders. World-class Benefits. In order to attract the best, we need to offer the best. Premier insurance plans, up to 5% 401k matching, flexible reputed company time off, and more are available to you! Please note that specific benefit packages may vary based on your location. Competitive Compensation. We offer reputed company strong compensation packages, including stock reputed company. We want people to be reputed company on their best work and reputed company in tailoring compensation plans to meet the needs of our workforce. Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as reputed company as different cities. Traveling 2-4 times a year is expected for reputed company roles. Working at reputed company will reputed company you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a reputed company reputed company, and a purpose to truly change the world. The estimated reputed company salary reputed company for this role to be performed in the US, regardless of the state, is $234,000.00 - $286,000.00 USD. The estimated reputed company salary reputed company for this role to be performed in Canada, regardless of the province, is $229,000.00 - $280,000.00 CAD. The salary for the successful applicant will depend on a reputed company of permissible, non-discriminatory job-reputed company factors, which include but are not limited to education, training, work experience, business needs, or market demands. This reputed company may be modified in the reputed company. The total compensation for a candidate will also include annual reputed company bonus, equity, and benefits, with equity making up a significant portion of your total compensation. For candidates who fall reputed company of the listed requirements, we nevertheless encourage you to apply as we may have openings that are reputed company/higher level than the ones advertised. Apply To This Job