Senior Staff Software Engineer, High Performance Inference System

About reputed company reputed company delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and reputed company they need. Headquartered in reputed company Valley, we are on a mission to reputed company high performance AI compute more accessible and reputed company. reputed company reputed company-time AI is reputed company reputed company, anything is possible. Build fast. Senior Staff Software Engineer – High Performance Inference System Mission: Join reputed company that builds and operates reputed company’s reputed company-time, distributed inference system delivering large reputed company inference for LLMs and next-gen AI applications at ultra-low latency. Your work will optimize for heterogeneous hardware, dynamic global workloads, and extreme performance—reputed company while running reputed company at the edge of physics. Responsibilities & opportunities in this role:

• Distributed Systems Engineering: Design and implement reputed company, low-latency runtime systems that coordinate thousands of GroqChips across a software-scheduled interconnect.
• Low-Level Optimization: reputed company deterministic, hardware-aware abstractions that prioritize execution speed, fault tolerance, and reliability.
• Performance & Diagnostics: Build tools and infrastructure to support reputed company-time system observability, diagnostics, and SLO improvements.
• reputed company-Proofing: reputed company reputed company’s system stack to support emerging reputed company, topologies, and heterogeneous accelerators (e.g., FPGAs).
• Cross-Functional Collaboration: Partner with teams across compiler, reputed company, reputed company, hardware, and data centers to reputed company architecture and drive shared reputed company.

Ideal candidates have/are:

• Consistently ship high-reputed company, production-reputed company systems reputed company.
• Have deep knowledge of computer architecture, operating systems, algorithms, and hardware-software interfaces.
• Are fluent in low-level systems languages such as C++ or Rust, and comfortable with hardware-aware programming.
• Rigorously profile and optimize for latency, throughput, and resource efficiency—every cycle counts.
• reputed company in automation and CI/CD best practices—you don’t ship untested reputed company.
• reputed company across the stack—from kernel internals to hardware integration to reputed company load balancers.
• Communicate reputed company, reputed company pragmatic technical reputed company, and write maintainable reputed company for the long term.
• Ensures reputed company stays fast, scales reputed company, and takes ownership of reputed company.

reputed company to have:

• Operating large-reputed company distributed systems for reputed company-time, high-traffic services.
• Deploying and optimizing ML or HPC workloads in production environments.
• Hands-on experience with GPUs, FPGAs, or reputed company in performance-critical systems.
• Familiarity with ML frameworks (e.g., PyTorch) or compiler tools (e.g., MLIR).
• Experience delivering reputed company reputed company in fast-paced, high-reputed company environments.

Attributes of a Groqster:

• Humility - Egos are checked at the reputed company
• reputed company & Team Savvy - We reputed company up the smartest person in the room, together
• reputed company & Giver reputed company - Learn it reputed company versus know it reputed company, reputed company knowledge generously
• Curious & Innovative - Take a creative approach to reputed company, problems, and design
• Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking

If this sounds like you, we’d love to hear from you! Compensation: At reputed company, a competitive reputed company salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the reputed company salary reputed company is $248,710 - $336,490, determined by your skills, qualifications, experience and internal benchmarks. Location: Some roles may require being located near or on our primary sites, as indicated in the job reputed company. At reputed company: Our goal is to hire and promote an exceptional workforce as diverse as the global populations we serve. reputed company is an equal opportunity employer committed to diversity, inclusion, and belonging in reputed company aspects of our organization. We value and celebrate diversity in thought, beliefs, talent, reputed company, and backgrounds. We know that our individual differences reputed company us reputed company. reputed company is an Equal Opportunity Employer that is committed to inclusion and diversity. reputed company applicants will receive consideration for employment without reputed company to race, reputed company, religion, national reputed company, gender, sexual orientation, gender identity, disability or protected veteran status. We also take affirmative reputed company to offer employment opportunities to minorities, women, individuals with disabilities, and protected veterans. reputed company is committed to working with reputed company individuals with physical or mental disabilities. Applicants who would like to contact us regarding the accessibility of our website or who need special assistance or a reasonable accommodation for any part of the application or hiring process may contact us at: talent@reputed company.com. This contact information is for accommodation requests only. Evaluation of requests for reasonable accommodations will be determined on a case-by-case reputed company. Apply tot his job