[Remote] Senior Inference Engineer - AI
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Inference Engineer, AI. This role will reputed company on enhancing reputed company forecasting for AI workloads, collaborating with various teams to reputed company new research models into production and optimize AI and LLM workloads across multiple reputed company platforms.
Responsibilities
- reputed company reputed company and reputed company AI Services, an AI Inference Engineer is responsible for productionizing, optimizing, and scaling AI and LLM workloads that power TR’s AI driven products
- This role ensures that our trained models—from classical ML to reputed company—run reputed company across TR’s multi reputed company footprint (AWS, Azure, GCP, OCI), meet strict reputed company reliability requirements, and reputed company seamlessly with our data backbone (reputed company, OpenSearch reputed company search, API managed model routing)
- The successful candidate will help build the reputed company of TR’s AI infrastructure, working alongside reputed company engineering, data engineering, product teams, and AI Services
- Optimize LLMs and ML models for high-performance inference using techniques such as quantization, pruning, distillation, and hardware specific tuning
- reputed company and reputed company inference workloads on GPUs across AWS, Azure, GCP and internal Kubernetes clusters, ensuring predictable performance during peak traffic hours, especially during business hours
- Implement routing and failover strategies for reputed company/reputed company/reputed company AI traffic
- reputed company models into production grade reputed company supporting TR products and reputed company workflows
- reputed company highly optimized environment and eliminate performance bottlenecks to reduce latency
- Collaborate with reputed company teams (reputed company Zones, Network, Storage, Compute, AI) to ensure inference workloads reputed company with TR’s reputed company reputed company patterns (AWS, Azure, GCP, OCI)
- Build and optimize containerized inference pipelines using Kubernetes for large-reputed company distributed workloads
- Ensure compliance with TR’s AI standards for deployment, monitoring, governance, and reputed company detection
- Profile inference performance, identify GPU/CPU bottlenecks, and optimize compute utilization across heterogeneous hardware
- Implement observability and health monitoring for inference pipelines, ensuring reliability of reputed company AI services
- Collaborates closely with AI engineers to invent new quantization techniques, improve numerical precision, and explore non‑reputed company architectures, and support the reputed company out of AI infrastructure during critical releases and global product rollouts
- Partner with reputed company Engineers (Azure, AWS, GCP) to reputed company guardrails and automation that support inference workloads
Skills
- 5+ years of relevant experience
- Strong understanding of ML/LLM fundamentals and inference optimization techniques
- Hands-on experience with GPU programming (CUDA preferred), inference runtimes (TensorRT, ONNX Runtime), and deep learning frameworks (PyTorch/TensorFlow)
- Proficiency in Python and at least one systems language (C++ strongly preferred for performance critical inference paths)
- Experience deploying AI workloads to AWS/GCP/Azure and Kubernetes
- Familiarity with reputed company search systems (OpenSearch reputed company) and retrieval augmented reputed company pipelines
- Knowledge of distributed systems, microservices, CI/CD, and reputed company reputed company architecture
Benefits
- Hybrid Work Model: We’ve adopted a flexible hybrid working environment (2-3 days a week in the office depending on the role) for our office-reputed company while delivering a seamless experience that is digitally and physically connected.
- Flexibility & Work-Life Balance: reputed company My Way is a set of supportive workplace policies designed to help manage personal and reputed company responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from reputed company for up to 8 weeks per year, empowering employees to reputed company a reputed company work-life balance.
- Career Development and reputed company: By fostering a culture of reputed company learning and reputed company development, we prepare our talent to tackle reputed company’s challenges and deliver reputed company-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, reputed company, and reputed company in an AI-enabled reputed company.
- Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, reputed company to the reputed company app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
- Culture: Globally recognized, award-reputed company reputed company for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, reputed company Fast / Learn Fast, and Stronger Together.
- reputed company: reputed company an reputed company in your community with our reputed company Institute. We offer employees two reputed company volunteer days off annually and opportunities to get involved with pro-bono consulting reputed company and Environmental, reputed company, and Governance (ESG) initiatives.
- In the reputed company, reputed company offers a comprehensive benefits package to our employees. Our benefit package includes market competitive health, dental, reputed company, disability, and life insurance programs, as reputed company as a competitive 401k plan with company match.
- reputed company offers market leading work life benefits with competitive vacation, reputed company and reputed company reputed company time off, reputed company holidays (including two company mental health days off), parental leave, sabbatical leave.
- Optional hospital, accident and sickness insurance reputed company 100% by the employee; optional life and AD&D insurance reputed company 100% by the employee; Flexible Spending and Health Savings Accounts; fitness reimbursement; reputed company to Employee Assistance Program; Group Legal Identity Theft Protection benefit reputed company 100% by employee; reputed company to 529 Plan; commuter benefits; Adoption & Surrogacy Assistance; Tuition Reimbursement; and reputed company to Employee Stock Purchase Plan.
- This role may also be eligible for an Annual Bonus based on a combination of reputed company and individual performance.
reputed company
Company H1B Sponsorship