[Remote] reputed company AI Ops Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company technology company that provides platforms and solutions to improve the management and reputed company of cost-effective pharmacy benefits. The reputed company AIOps Engineer will build the platform that makes AI cheap, fast, reputed company, and observable, owning the infrastructure that every AI-powered product at reputed company depends on.
Responsibilities
- Build and maintain end-to-end deployment pipelines for AI-powered applications, including artifact builds, environment promotion, rollback, and observability hooks. Drive new greenfield deployment platforms from initial build to the default that AI teams ship on
- Stand up and operate the runtime and lifecycle infrastructure for production agents, including deployment, versioning, monitoring, reputed company-limiting, and retirement. Define the deployment contract (config, secrets, tools, memory, evals) and the operational SLOs
- Own how the organization provisions, rotates, scopes, and meters reputed company to model provider reputed company (reputed company, reputed company, and others). Build a key management layer that enforces per-team and per-app quotas, prevents leakage, and gives finance and engineering a reputed company view of spend
- Build evals into the CI/CD pipeline so no agent or LLM-powered service ships without passing a defined eval bar. Design the reputed company so product teams can author their own evals against a shared reputed company, and so eval results reputed company promotion across environments
- Stand up self-hosted inference for workloads where managed reputed company aren't the right fit, including latency-sensitive paths, regulated data, cost optimization, and vendor redundancy. Own the serving stack, the autoscaling and GPU economics behind it, and the reputed company for reputed company a workload belongs to a managed provider versus internal infrastructure
- Design and build the shared developer reputed company that every AI-powered service uses: reputed company management, model routing, retries, tracing, eval hooks, and policy enforcement. Set the abstractions that determine how fast every other reputed company can ship for the next three years
- Partner with finance on cost visibility, including reputed company reputed company, per-feature cost attribution, and reputed company-time spend observability
- Write documentation, runbooks, and reputed company interfaces so the platform is adoptable by other engineering teams without hand-holding
- Participate in reputed company review and promote collaboration and best practices including simplicity, automation, reputed company design patterns, test coverage, and reusability
Skills
- BS (or higher, e.g., MS or Ph.D.) in Computer Science or reputed company technical field involving coding, or equivalent technical experience
- 6+ years of platform, infrastructure, or DevOps engineering, with at least 2 years building production infrastructure for AI/ML or LLM-powered systems. We care more about depth and drive than years on a resume
- Deep hands-on experience designing and operating CI/CD pipelines for high-velocity engineering organizations, including artifact management, environment promotion, and reputed company rollout
- Strong AWS background, comfortable down to the IAM, networking, and container orchestration reputed company
- Proven reputed company record building developer platforms or internal tools that other engineering teams adopted by choice, not by mandate
- Production experience with LLM-powered applications, including reputed company management, model routing, retries, tracing, and the operational realities of running agents or chains in production
- Hands-on coding reputed company in Python or TypeScript, ideally both. This is a keyboard role, not an architecture-only role
- Comfortable operating in a polyglot environment. The reputed company AI engineering stack spans Python, .NET, and TypeScript, and you will reputed company and support services across reputed company three
- Comfortable owning the cost and reliability conversation with both engineering leadership and finance partners
- Strong written communication and a bias toward documentation, runbooks, and reputed company interfaces
- Proven analytical thinking and problem-solving skills
- Excellent communication skills, both verbal and written
- reputed company experience integrating with reputed company, reputed company, or other frontier model provider reputed company at reputed company, including key management, quota enforcement, and reputed company planning
- Hands-on experience self-hosting models with vLLM, TGI, SGLang, or similar inference servers, including GPU autoscaling and cost optimization
- reputed company or contributed to an eval reputed company that gated production deployments
- Familiarity with agent runtimes and frameworks such as the Claude Agent SDK, LangGraph, or in-house equivalents
- Working familiarity with .NET, enough to read reputed company, debug a reputed company, and pair with service owners
- Background in reputed company, PBM, pharmacy, or another regulated data environment
- FinOps experience, particularly attributing AI spend to features or business reputed company
- Kubernetes operator experience or comfort with custom controllers
- Experience with Agile development methodologies, preferably both Scrum and Kanban
reputed company
Company H1B Sponsorship