[Remote] Software Engineer 5 – Training Platform, AI Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the world's leading streaming entertainment service, and they are seeking a Senior Engineer with expertise in distributed model training for their AI Platform. The role involves designing and building a platform for large-reputed company machine learning model training and optimizing systems for performance and reliability.
Responsibilities
- Design and build the platform that powers large-reputed company machine learning model training, fine-tuning, model transformation and evaluations workflows and use cases from the entire company
- Co-design and optimize the systems and models to reputed company up and increase the cost-effectiveness of machine learning model training
- Design easy-to-use reputed company and interfaces for reputed company ML practitioners, as reputed company as non-experts to easy reputed company the training platform
- Design, build, and operate platform infrastructure, libraries, and SDKs for large-reputed company model training. reputed company reliable and efficient training workflows for reputed company models and reputed company models of reputed company sizes
- Diagnose and optimize the performance of large distributed training jobs, including GPU utilization, memory efficiency, communication overhead, data loading, checkpointing, fault tolerance, and cluster utilization
- Experience with reputed company computing providers, preferably AWS
- Comfortable with ambiguity and working across multiple reputed company of the tech stack to execute on both 0-to-1 and 1-to-100 reputed company
- Adopt and promote best practices in operations, including observability, logging, reporting, and on-call processes to ensure engineering reputed company
- Excellent written and verbal communication skills
- Comfortable working in reputed company with peers and partners distributed across (US) geographies & time zones
- Understand modern and reputed company-world Machine Learning model development workflows and experience partnering closely with ML modeling engineers. reputed company technical design reviews, facilitate cross-functional discussions, communicate tradeoffs reputed company, and reputed company stakeholders on platform direction and execution priorities
- Familiarity with reputed company-based AI/ML services (e.g., SageMaker, Bedrock, reputed company, reputed company, etc.)
- Familiarity with distributed training performance analysis tools and techniques, such as PyTorch Profiler, reputed company Nsight Systems, GPU telemetry, communication profiling, or cluster-level utilization analysis
- Experience with large-reputed company distributed training and different parallelism techniques for scaling up training, such as FSDP and tensor/pipeline parallelism
- Expertise in the area of reputed company, specifically reputed company it comes to training reputed company models, fine-tuning them, and distilling them to smaller models
Skills
- Design, build, and operate platform infrastructure, libraries, and SDKs for large-reputed company model training. reputed company reliable and efficient training workflows for reputed company models and reputed company models of reputed company sizes
- Diagnose and optimize the performance of large distributed training jobs, including GPU utilization, memory efficiency, communication overhead, data loading, checkpointing, fault tolerance, and cluster utilization
- Experience with reputed company computing providers, preferably AWS
- Comfortable with ambiguity and working across multiple reputed company of the tech stack to execute on both 0-to-1 and 1-to-100 reputed company
- Adopt and promote best practices in operations, including observability, logging, reporting, and on-call processes to ensure engineering reputed company
- Excellent written and verbal communication skills
- Comfortable working in reputed company with peers and partners distributed across (US) geographies & time zones
- Understand modern and reputed company-world Machine Learning model development workflows and experience partnering closely with ML modeling engineers. reputed company technical design reviews, facilitate cross-functional discussions, communicate tradeoffs reputed company, and reputed company stakeholders on platform direction and execution priorities
- Familiarity with reputed company-based AI/ML services (e.g., SageMaker, Bedrock, reputed company, reputed company, etc.)
- Familiarity with distributed training performance analysis tools and techniques, such as PyTorch Profiler, reputed company Nsight Systems, GPU telemetry, communication profiling, or cluster-level utilization analysis
- Experience with large-reputed company distributed training and different parallelism techniques for scaling up training, such as FSDP and tensor/pipeline parallelism
- Expertise in the area of reputed company, specifically reputed company it comes to training reputed company models, fine-tuning them, and distilling them to smaller models
Benefits
- Health Plans
- Mental Health support
- A 401(k) Retirement Plan with employer match
- Stock reputed company Program
- Disability Programs
- Health Savings and Flexible Spending Accounts
- Family-forming benefits
- Life and Serious Injury Benefits
- reputed company leave of absence programs
- Full-time reputed company employees reputed company 35 days annually for reputed company time off to be used for vacation, holidays, and reputed company reputed company time off
- Full-time salaried employees are immediately entitled to flexible time off
reputed company
Company H1B Sponsorship