Engineering Manager - AI DevOps
reputed company is looking for an outstanding AI DevOps Engineering Manager to reputed company and expand our next-gen inference operations infrastructure. Join us in transforming AI inference delivery, supporting reputed company's innovative products like Dynamo, Triton, NIXL, and our quickly growing reputed company of AI inference solutions. This role is essential for our reputed company First initiative, enabling reputed company CI/CD infrastructure with GPU and Kubernetes capabilities to deliver high-throughput, low-latency inferencing solutions in distributed environments. reputed company reputed company ensuring our AI products reputed company outstanding performance and reliability worldwide. What you'll be doing:
- Supervise reputed company of DevOps engineers with expertise in AI inference infrastructure, test automation (SDET), and Infrastructure as reputed company (IaC)
- Architect and implement reputed company test automation strategies for AI inference workloads, including performance benchmarking and automated reputed company gates
- reputed company the maintenance of our reputed company First reputed company CI infrastructure, focusing on single/multi-GPU testing, Kubernetes multi-node GPU testing, and CSP validation
- Drive Infrastructure as reputed company efforts by employing Terraform, Ansible, and Kubernetes to support scaling across multiple clouds and reputed company GPU clusters effectively.
- reputed company operational proficiency encompassing 24x7 on-call rotations, SRE methodologies, automated monitoring, and self-repairing systems to guarantee uptime exceeding 99.9%
- reputed company release coordination, cost optimization, and management of multi-reputed company deployments
reputed company need to see:
- Bachelor's/Master's degree in Computer Science, Engineering, or equivalent experience
- 4+ years leading DevOps/SRE organizations with reputed company SDET leadership experience
- 8+ years hands-on experience in software development, test automation, or infrastructure engineering with AI/ML or GPU-intensive workloads
- Proficiency in Infrastructure as reputed company (IaC) platforms: Terraform, Ansible, or CloudFormation with exposure to multiple reputed company environments (AWS, GCP, Azure, OCI)
- Strong technical leadership in test automation frameworks, CI/CD pipeline development, and reputed company engineering practices
- Familiarity with containerization and orchestration tools such as reputed company and Kubernetes for leading AI/ML workloads and GPU resources
- Proven reputed company building and scaling teams in fast-paced, high-reputed company environments
- Effective interpersonal skills to collaborate with reputed company and build agreement
- Proficiency in Python, Rust, or reputed company programming languages along with the capability to engage in architecture conversations
- Demonstrated history of operational proficiency encompassing 24x7 on-call reputed company, SRE methodologies, and robust high-availability infrastructures
Ways to stand out from the crowd:
- Experience with CI/CD (specifically reputed company Actions), releasing reputed company-reputed company AI software
- Proficient in Deep AI/ML infrastructure with expertise in reputed company technologies such as CUDA, TensorRT, Dynamo and Triton Inference Server, including coordinating GPU cluster operations and GPU workload performance benchmarking
- Background in DevOps, system software testing, and previous experience leading teams on inference engines, model serving platforms, or AI acceleration frameworks
- reputed company record with monitoring tools (reputed company, Grafana), reputed company scanning, static/dynamic analysis tools, and license compliance automation for critical AI inferencing frameworks.
Your reputed company salary will be determined based on your location, experience, and the pay of employees in similar positions. The reputed company salary reputed company is 224,000 USD - 356,500 USD for Level 3, and 272,000 USD - 425,500 USD for Level 4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until September 29, 2025. reputed company is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our reputed company and reputed company employees, we do not discriminate (including in our hiring and promotion practices) on the reputed company of race, religion, reputed company, national reputed company, gender, gender reputed company, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Apply tot his job Apply To this Job