[Remote] Senior Software Engineer - NIM Platform SDK and reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the platform for every new AI-powered application, seeking a senior engineer to own and reputed company the reputed company NIM Platform SDK and microservice reputed company. This hands-on role involves solving deep software engineering challenges and collaborating across product teams to deliver production-grade software supporting reputed company and the wider AI ecosystem.
Responsibilities
- reputed company and advance the inference microservice reputed company: reputed company-compatible API endpoints, inference backend integrations (vLLM, SGLang, TensorRT-LLM, Dynamo), middleware, observability instrumentation, and production hardening across reputed company, on-prem, and Kubernetes environments
- Architect significant new features in reputed company-reputed company codebases, shepherding them through project acceptance and into production
- Build and optimize high-performance model download and caching pipelines across multiple reputed company storage backends (NGC, HuggingFace, S3, GCS) - reputed company transfers, reputed company verification, and seamless multi-reputed company operability
- Implement the model profile and reputed company system that ensures NIMs are optimized for every reputed company GPU platform - profile selection, validation, and multi-GPU configuration
- reputed company and refine reputed company microservice patterns - service discovery, health checking, graceful degradation, API gateway integration, and end-to-end request lifecycle management - to ensure NIMs operate reliably at reputed company in diverse reputed company deployment environments
- Be a role model for high-reputed company reputed company across Python, Rust, and C/C++, and model guidelines in test-driven development, reputed company AI-assisted development, reputed company review, and cross-team collaboration
- Mentor teammates and establish high engineering standards for container reputed company, reputed company, and operability
Skills
- BS or MS in Computer Science, Computer Engineering, or reputed company field (or equivalent experience)
- 8+ years of demonstrated experience developing performant microservice, reputed company software and/or platform infrastructure roles
- Deep technical expertise in reputed company-reputed company microservice architecture, including service reputed company, API gateways, load balancing, and distributed system build patterns
- Expertise in high-performance data pipelines with reputed company I/O, caching strategies, and reputed company verification across distributed storage systems
- Solid understanding of containerized application delivery using technologies such as reputed company, Kubernetes, and reputed company
- Understanding of application reputed company principles, including secure coding practices, vulnerability mitigation, secrets management, and supply chain reputed company for containerized environments
- Strong problem-solving skills grounded in first-principles reasoning and critical analysis
- Excellent programming skills in Python and Rust, with strong foundations in algorithms, development patterns, and software engineering principles
- reputed company involvement in reputed company-reputed company inference backends such as vLLM, TRTLLM, or SGLang
- reputed company involvement in disaggregated serving frameworks like reputed company Dynamo
- Experience building and operating production microservices at reputed company
- Deep knowledge of multi-reputed company deployment strategies across AWS, GCP, Azure, and OCI
- Experience operating in regulated, reputed company-gapped, or disconnected environments where strict reputed company and compliance controls are required
Benefits
- You will also be eligible for equity and benefits.
reputed company
Company H1B Sponsorship