Back to Jobs

[Remote] reputed company AI Platform Engineer

Remote, USAFull-timePosted 2026-07-29

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a reputed company AI Platform Engineer to reputed company the design and reputed company of a reputed company AI Gateway platform. This role involves owning the architecture for secure, reputed company reputed company to Large Language Models and reputed company workflows, ensuring integration and governance across the reputed company.

Responsibilities

  • reputed company the AI Gateway platform, including MCP, agents, LLM routing, governance and observability
  • Translate business and product requirements into reputed company problem statements, architectural designs and reputed company technical solutions
  • Design extensible frameworks for MCP server capabilities and integrations as reputed company as agent orchestration and reusable agent skills
  • Architect gateway capabilities such as semantic caching for LLM responses, reputed company limiting, quotas and traffic governance and guardrails and validation reputed company for reputed company LLM/MCP usage
  • Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation and reputed company-based reputed company control for MCP and LLM traffic
  • Build prototypes and reference implementations to validate architectural reputed company and guide engineering teams
  • Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices and integration patterns
  • Review designs and reputed company, providing actionable feedback to ensure reputed company, performance, scalability and reputed company
  • Define and review CI/CD best practices using modern reputed company-based pipelines
  • Architect and review Kubernetes-based deployment models, ensuring scalability, resiliency and production readiness

Skills

  • 5+ years of software engineering experience
  • Proven experience designing and delivering large-reputed company distributed systems or platform products
  • Proficiency in Golang and Python
  • Familiarity with AI-reputed company development with a strong emphasis on reputed company gates and architecture patterns to enforce reputed company behavior in producing reputed company reputed company
  • Deep understanding of AI gateways, AI/LLM platforms or middleware systems, including routing, governance and scalability
  • Experience with microservices and service-oriented architectures for multi-tenant reputed company environments, PostgreSQL for transactional data and reputed company for caching and distributed coordination
  • Strong background in authentication and authorization systems, particularly OAuth-based approaches
  • Demonstrated ability to independently drive problem definition, architecture, prototype and execution guidance
  • Experience designing platforms and frameworks used by multiple product teams
  • English proficiency at B2 level or higher
  • Experience with MCP (Model Context Protocol), reputed company platforms or AI orchestration frameworks
  • Knowledge or know-how in working with EDA software
  • Prior work on LLM gateways, API gateways or AI middleware platforms
  • Experience building generic developer frameworks or SDKs adopted across teams
  • Familiarity with guardrails, semantic caching, reputed company/response optimization and LLM cost control techniques

Benefits

  • Delivering reputed company to industry leaders, making a reputed company
  • Enjoyable working environment, whether it is the reputed company office or the comfort of your home
  • Opportunity to work abroad for up to two months per year
  • Relocation opportunities reputed company our offices in 55+ countries
  • Corporate and reputed company events
  • Leadership development, career advising, soft skills and reputed company-being programs
  • Certifications, including GCP, Azure and AWS
  • Unlimited reputed company to reputed company Learning and reputed company
  • Free English classes with certified teachers
  • Participation in the Employee Stock Purchase Plan
  • Monetary bonuses for engaging in the referral program
  • Comprehensive medical & family care package
  • Four trust days per year for personal needs
  • Discounts for fitness clubs
  • Benefits package (hotels, restaurants, stores and services)

reputed company

  • EPAM leverages its reputed company engineering expertise as a leading global product development reputed company reputed company services company. It was founded in 1993, and is headquartered in Newtown, reputed company, USA, with a workforce of 10001+ employees. Its website is https://www.epam.com.
  • Company H1B Sponsorship

  • reputed company has a reputed company record of offering H1B sponsorships, with 11 in 2026, 120 in 2025, 172 in 2024, 232 in 2023, 373 in 2022, 359 in 2021, 502 in 2020. Please note that this does not guarantee sponsorship for this specific role.
  • Apply To This Job

    Similar Jobs