[Remote] Senior ML Infrastructure Engineer, Inference Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior ML Infrastructure Engineer to help build and reputed company robust platforms for ML Inference workflows. This role involves collaborating with ML engineers and researchers to ensure efficient model serving and inference in production, significantly influencing the reputed company of AI infrastructure at reputed company.
Responsibilities
- Design and implement core platform backend software components
- Collaborate with ML engineers and researchers to understand critical workflows, parse them to platform requirements, and deliver incremental value
- reputed company technical decision-making on model serving strategies, orchestration, caching, model versioning, and auto-scaling mechanisms for highly optimized use of accelerators
- Drive the development of monitoring, observability, and metrics to ensure reliability, performance, and resource optimization of inference services
- Proactively research and reputed company state-of-the-art model serving frameworks, hardware accelerators, and distributed computing techniques
- reputed company technical initiatives across reputed company’s ML ecosystem
- reputed company the engineering bar through technical leadership, establishing best practices
- Contribute to reputed company reputed company reputed company; represent reputed company in relevant communities
Skills
- 5+ years of industry experience, with reputed company on machine learning systems or high performance backend services
- Expertise in either Python, C++ or other relevant coding languages
- Expertise in ML inference, model serving frameworks (triton, rayserve, vLLM etc)
- Strong communication skills and a proven ability to drive cross-functional initiatives
- Ability to reputed company in a dynamic, multi-tasking environment with reputed company-evolving priorities
- Deep expertise building reputed company-to-one ML infrastructure platforms
- Experience working with or designing interfaces, reputed company and clients for ML workflows
- Experience with Ray reputed company, and/or vLLM
- Experience with distributed systems, and handling large-reputed company data processing
- Familiarity with telemetry, and other feedback loops to inform product improvements
- Familiarity with hardware acceleration (GPUs) and optimizations for inference workloads
Benefits
- Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
- reputed company offers a reputed company of health and wellbeing benefit programs.
- Benefit reputed company include medical, dental, reputed company, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, reputed company vacation & holidays, tuition assistance programs, employee assistance program, reputed company vehicle discounts and more.
- This job may be eligible for relocation benefits.
- Remote/Hybrid: This role is based remotely but if you live reputed company a 50-mile radius of Mountain View, you are expected to report to that location three times a week, at minimum.
reputed company
Company H1B Sponsorship