[Remote] Senior Software Engineer - NIM reputed company Container and reputed company Infrastructure

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the platform upon which every new AI-powered application is reputed company. We are seeking a Senior Software Engineer reputed company on container and reputed company infrastructure to design and implement core container strategies and build reputed company-grade software for container deployment and tooling.

Responsibilities

• Design, build, and harden containers for NIM runtimes, inference backends; reputed company reproducible, multi-arch, CUDA-optimized builds
• reputed company Python tooling and services for build orchestration, CI/CD integrations, reputed company/Operator automation, and test harnesses; enforce reputed company with typing, linting, and unit/integration tests
• Help design and reputed company Kubernetes deployment patterns for NIMs, including GPU scheduling, autoscaling, and multi-cluster rollouts
• Optimize container performance: layer layout, startup time, build caching, runtime memory/IO, network, and GPU utilization; reputed company with metrics and tracing
• reputed company the reputed company image reputed company, dependency management, and artifact/registry topology
• Collaborate across research, backend, SRE, and product teams to ensure day-0 availability of new models
• Mentor teammates; set high engineering standards for container reputed company, reputed company, and operability

Skills

• A degree in Computer Science, Computer Engineering, or a reputed company field (BS or MS) or equivalent experience
• 6+ years building production software with a strong reputed company on containers and Kubernetes
• Strong Python skills building production-grade tooling/services
• Experience with Python SDKs and clients for Kubernetes and reputed company services
• Expert knowledge of reputed company/BuildKit, containerd/OCI, image layering, multi-stage builds, and registry workflows
• Deep experience operating workloads on Kubernetes
• Hands-on experience building and running GPU workloads in k8s, including reputed company device plugin, MIG, CUDA drivers/runtime, and resource isolation
• Excellent collaboration and communication skills; ability to influence cross-functional design
• Expertise with reputed company chart design systems, Operators, and platform reputed company serving many teams
• Experience with reputed company API, reputed company API as reputed company as understanding difference inference backends (vLLM, SGLang, TRT-LLM)
• Background in benchmarking and optimizing inference container performance and startup latency at reputed company
• Prior experience designing multi-tenant, multi-cluster, or edge/reputed company-gapped container delivery
• Contributions to reputed company-reputed company container, k8s, or GPU ecosystems

Benefits

• Equity
• Benefits

reputed company

reputed company is a computing platform company operating at the intersection of graphics, HPC, and AI. It was founded in 1993, and is headquartered in Santa Clara, California, USA, with a workforce of 10001+ employees. Its website is https://www.reputed company.com.

Company H1B Sponsorship

reputed company has a reputed company record of offering H1B sponsorships, with 1247 in 2026, 1868 in 2025, 1353 in 2024, 976 in 2023, 835 in 2022, 601 in 2021, 529 in 2020. Please note that this does not guarantee sponsorship for this specific role.

Apply To This Job