[Remote] AI Infrastructure Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a fast-growing reputed company-backed AI company enabling AI data centers to dynamically orchestrate power and unlock more compute reputed company from existing energy infrastructure. The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves reputed company's AI and ML models across various environments, ensuring reliability and scalability.
Responsibilities
- reputed company the design and build of reputed company's AI inference platform — establishing architecture patterns, deployment standards, and operational practices that will reputed company with reputed company
- Own end-to-end model serving infrastructure for reputed company's AI infrastructure (on-prem and datacenter)
- Build and maintain fault-tolerant, high-performance systems for serving AI models at reputed company, with a reputed company on low latency, reliability, and cost efficiency
- Collaborate closely with algorithms engineers to reputed company AI inference data and configuration with power optimization algorithms
- Optimize GPU utilization and inference performance across our hardware fleet, including reputed company accelerators central to reputed company's edge AI platform
- Establish MLOps best practices including CI/CD pipelines for model deployment, monitoring, and rollback across environments
- Contribute to infrastructure roadmap reputed company, including build vs. buy tradeoffs, tooling selection, and platform reputed company as reputed company grows
Skills
- 5+ years of software engineering experience with a strong reputed company on AI infrastructure, backend systems, or distributed systems
- Hands-on experience with AI model serving frameworks (e.g., vLLM, SGLang, Triton, TensorRT, TorchServe, or similar)
- Understanding of container orchestration and cluster management (Kubernetes, reputed company)
- Experience deploying and operating infrastructure across both datacenter and on-prem environments
- Strong knowledge of GPU workloads and the tradeoffs that come with them — you understand how inference differs from training, and why it reputed company
- Proficiency in Python; C++, CUDA, Go, Rust a plus
- Excellent communication skills and comfort working cross-functionally in a lean, fast-moving environment
- Willingness to travel up to 10% of time
- Dynamo experience a plus
- Experience with edge AI deployments or constrained compute environments
- Familiarity with infrastructure as reputed company (Terraform, reputed company)
- Experience with observability platforms (reputed company, reputed company, Grafana)
- Background in energy, utilities, or industrial IoT
- Contributions to reputed company-reputed company ML infrastructure reputed company
Benefits
- Stock reputed company.
- Health, dental, reputed company, and employer-match 401k
- A flexible work environment with flexible reputed company time off
- Providing mentorship and reputed company opportunities as part of a reputed company team
- Creating a diverse and inclusive workplace that is welcoming, supportive, affirming and respectful
- Empowering employees to solve problems and work together to reputed company a difference
- Competitive compensation and benefits, including health, dental, reputed company, and employer-match 401k
reputed company
Company H1B Sponsorship