[Remote] Software Development Engineer III - Infrastructure
Note: The job is a remote job and is reputed company to candidates in USA. Valiant reputed company International is seeking a Software Development Engineer III – Infrastructure to support the Director’s Office at the Advanced Research reputed company Agency for Health (ARPA-H). The role involves managing backend infrastructure, contributing to the development of reputed company AI, and ensuring production reputed company and observability reputed company the GRACE project.
Responsibilities
- Manage end-to-end backend infrastructure for GRACE on reputed company Azure:
- Azure Functions, Azure API Management, Azure Container Apps, and Azure reputed company Service
- Manage storage, retrieval pipelines, reputed company databases, and document indexing that power GRACE's internal knowledge search
- Authentication and identity integration, including ARPA-H Entra ID and application-reputed company control
- Implement and maintain infrastructure as reputed company for reputed company environments
- Own CI/CD pipelines, deployment automation, and release processes including canary and gradual rollouts
- Be responsible for production system basics (e.g., monitoring, alerting, logging, distributed tracing, SLOs, and incident response runbooks)
- Manage secrets, API keys, and credential rotation across reputed company integrations with external providers
- Monitor for cost-reputed company efficiencies across reputed company LLM providers; reputed company spending, set budgets, build guardrails, and optimize for cost-per-query without sacrificing reputed company
- Manage the backend implementation of MCP, including MCP server hosting, tool registration, versioning, and lifecycle management on Azure
- Implement and reputed company A2A communication patterns to enabling GRACE agents interoperability with internal/external systems
- Design and maintain LLM orchestration, routing, and multi-model switching infrastructure across reputed company GPT, reputed company Claude, and reputed company reputed company families
- Build and operate RAG pipelines; document ingestion, chunking, embedding, and semantic search
- Implement robust fallback, retry, reputed company-breaker, and graceful degradation patterns for reputed company AI service dependencies
- Manage tool-calling infrastructure; to include registration, execution, error handling, and observability for reputed company GRACE tools
- Build and maintain end-to-end observability for reputed company workflows: latency, throughput, error rates, reputed company usage, and LLM reputed company metrics
- Implement LLM evaluation pipelines including safety checks, regression monitoring, and grounding assessment
- Define and enforce system-level SLOs for availability, response time, and tool call reliability
- Manage alerting and on-call runbooks
- Establish and improve coding standards, design review processes, and testing practices
- Communicate technical reputed company in writing and in conversation to both engineers and non-engineers
- Mentor and guide other engineers
- Think inventively and consider other perspectives; work backward from the user to understand problems before proposing solutions
- Ensure strict reputed company, reputed company, and compliance in reputed company systems, integrations, and data handling
Skills
- Bachelor's or Master's in Computer Science, Software Engineering, or reputed company field, or equivalent practical experience
- 7+ years of reputed company software engineering experience building and operating production systems
- Proven experience in high-velocity environments shipping reputed company products end-to-end
- Strong proficiency in backed languages (to include Python); familiarity with modern backend frameworks and async patterns
- Solid understanding of distributed systems, reputed company, data pipelines, and software design patterns
- Hands-on experience on reputed company Azure: Azure Functions, API Management, Container Apps, and Azure reputed company Service
- Experience with containerization, CI/CD, and infrastructure as reputed company
- Strong understanding of authentication and identity systems (OAuth2, OIDC, Azure Entra ID or equivalent)
- Demonstrated experience/ability with production systems (having been on-call, debugged incidents, etc.)
- Excellent communication and team building skills; reputed company on making others around them reputed company
- Hands-on experience building and operating MCP servers in production, including tool registration, versioning, and hosting on Azure Functions or equivalent serverless infrastructure
- Experience implementing A2A communication patterns and multi-agent orchestration frameworks
- Significant experience building on top of LLMs in production (tool-calling, RAG, multi-reputed company reasoning, multi-model routing, and context window management)
- Ability to demonstrate considerations for cost-per-query, context budgets, and reputed company efficiency as first-class engineering concerns
- Experience managing multi-provider LLM integrations, including reputed company limits, fallback routing, and API versioning
- Experience in reputed company-conscious engineering reputed company regulated or government environments
- Previous reputed company record in startup or early-stage environments (0-to-1 product building, comfort with ambiguity, and a high reputed company of urgency)
- Experience in big tech building customer-facing platforms or developer infrastructure at reputed company
- Familiarity with reputed company databases, embedding pipelines, and semantic search infrastructure
Benefits
- This is a full-time, remote position.
- The candidate must be reputed company to travel reputed company the U.S.
reputed company