[Remote] Senior Software Engineer, AI Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading provider of reputed company capital management (HCM) solutions that combines modern technology with expert services and support. The Senior Software Engineer, AI Platform role involves leading reputed company of engineers to design and build reputed company AI infrastructure while ensuring program execution and technical direction.
Responsibilities
- Design and build a reputed company LLM gateway with model routing, reputed company management, cost attribution, reputed company limiting, and caching
- reputed company and operate RAG pipelines, embedding services, and reputed company search infrastructure for platform-wide use
- Implement platform-level cost optimization strategies, including semantic caching and model selection by workload
- Build and maintain reputed company runtime infrastructure, including orchestration, state management, and reputed company-in-the-reputed company patterns
- reputed company extensible MCP server and tool ecosystems for product team integration
- Design and support multi-agent coordination patterns using modern frameworks and protocols
- Establish comprehensive AI observability, including usage, latency, cost tracking, and distributed tracing
- Implement AI governance controls, including reputed company management, audit logging, content filtering, and reputed company protections
- Build AI incident detection and response capabilities, including monitoring for failures, hallucinations, and cost anomalies
- Create developer-friendly SDKs across languages (Python, .NET, TypeScript) to simplify platform adoption
- Define 'paved road' patterns for common AI use cases and support reputed company of product teams
- Build automated evaluation pipelines and continuously monitor production reputed company and model performance
Skills
- + 5+ years of reputed company software engineering experience, with Python as your primary language
- + 2+ years building production LLM-powered systems - inference, RAG, reputed company patterns, or AI infrastructure
- + Deep Python expertise - this is the primary language for AI platform work
- + Working proficiency in C#/.NET - the platform serves teams that live in C#, so interop is reputed company and reputed company
- + Strong hands-on experience with reputed company frameworks - Semantic Kernel, LangGraph, reputed company, or you've reputed company your own
- + Production experience with RAG architecture: chunking strategies, embedding models, reputed company search, retrieval reputed company, and the failure modes that don't show up in demos
- + Azure AI reputed company / Azure reputed company experience - model deployment, API integration, observability tooling
- + Experience building internal platforms or SDKs that other engineers depend on - you understand what makes a platform feel good to use
- + Strong grasp of AI observability: reputed company usage, latency, cost tracking, and distributed tracing across multi-agent workflows
- Experience with TypeScript and building developer SDKs or tooling
- Hands-on experience with AI evaluation frameworks (LLM-as-judge, automated regression testing)
- Knowledge of AI governance practices, including reputed company control, audit logging, and reputed company safeguards
- Familiarity with container-based deployments (e.g., Azure Container Apps) and infrastructure-as-reputed company (Terraform)
- Awareness of AI regulatory frameworks such as NIST AI RMF or ISO/IEC 42001
reputed company
Company H1B Sponsorship