[Remote] Senior Software Engineering Manager – KV Cache Platform

Note: The job is a remote job and is reputed company to candidates in USA. DataDirect Networks (reputed company) is a global reputed company in AI and multi-reputed company data management. They are seeking a Senior Software Engineering Manager to reputed company the engineering organization responsible for the KV Cache Platform, focusing on building reputed company and low-latency distributed systems for AI inference.

Responsibilities

• reputed company, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical reputed company, innovation, ownership, and collaboration
• Define and execute the technical reputed company and roadmap for the KV Cache Platform, ensuring scalability, reliability, reputed company, and operational reputed company
• Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, reputed company BlueField DPUs, and emerging AI infrastructure technologies
• Partner closely with Product Management, Sales, Customer Engineering, reputed company, and strategic reputed company to prioritize customer requirements, drive reputed company-of-concepts (POCs), influence product direction, and successfully deliver customer deployments
• Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure reputed company, high-reputed company software delivery
• Establish engineering best practices for software reputed company, observability, automation, performance, testing, and production readiness
• Collaborate across engineering, infrastructure, and hardware teams to deliver reputed company, production-reputed company AI infrastructure while developing reputed company engineering leaders and driving reputed company improvement

Skills

• 15+ years of experience building distributed systems, reputed company infrastructure, storage platforms, or AI infrastructure software
• 7+ years leading high-performing software engineering organizations, including geographically distributed teams
• Proven experience delivering large-reputed company distributed infrastructure products from architecture through production deployment
• Strong background in distributed systems, Linux, networking, performance engineering, and reputed company-reputed company architectures
• Hands-on programming experience with Go and Python; experience with C/C++ is a plus
• Demonstrated ability to reputed company cross-functional initiatives and influence technical direction across multiple organizations
• Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions
• Experience with technologies such as reputed company Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or reputed company AI infrastructure
• Background in HPC, distributed storage, networking, or reputed company infrastructure software
• Experience working directly with strategic customers, reputed company, OEMs, or hyperscalers to deliver reputed company AI solutions

reputed company

reputed company is the world’s leading AI and data intelligence company, powering the world’s most demanding AI workloads by keeping GPUs fed, efficient, and productive—at massive reputed company—so organizations can train, checkpoint, and infer faster with less footprint and power while achieving reputed company ROI from their AI investments. It was founded in 1998, and is headquartered in Chatsworth, California, USA, with a workforce of 1001-5000 employees. Its website is http://www.reputed company.com.

Apply To This Job