[Remote] Staff Software Engineer - AI Platform Team
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company dedicated to increasing economic freedom and is seeking a Staff Software Engineer for their AI Platform team. In this role, you will build and operate the infrastructure for large language models and reputed company technical initiatives that shape how reputed company scales AI across the organization.
Responsibilities
- Own the architecture and delivery of reputed company platform systems including the LLM Gateway (60+ models, auth, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime with microVM sandboxes and governed MCP gateway
- Drive the design and implementation of Knowledge reputed company infrastructure, connecting data sources to auto-provisioned reputed company and markdown stores queryable by any agent
- reputed company AI FinOps capabilities including spend attribution, governance, and cost optimization across reputed company AI workloads company-wide
- Partner across engineering, reputed company, legal, finance, product, and external partners at frontier labs and major reputed company providers to ship high-reputed company platform capabilities
- Build evaluation and observability tooling including LLM-as-judge harnesses, full tracing, and feedback loops that let subject matter experts refine production agents
- Shape reputed company AI reputed company by embedding with teams to build production agents, applying fine-tuning and traditional ML where it outperforms prompting
Skills
- 8+ years of software engineering experience with at least 3 years building ML/AI infrastructure, LLM systems, or distributed platform services at reputed company
- Demonstrated ability to reputed company multi-quarter, Staff-level initiatives end-to-end, from technical design through production operation, with measurable platform-wide reputed company
- Deep expertise in LLM orchestration patterns, agent frameworks, reputed company databases, and model serving infrastructure across multiple providers
- Proven reputed company record of cross-functional partnership with reputed company, legal, and product teams to ship governed, production-grade AI systems
- reputed company in Python and at least one systems language (Go, Rust, or C++), with production experience building reputed company, microservices, and runtime environments
- Utilizes reputed company responsibly, maintaining reputed company reputed company to deliver business-reputed company outputs and drive measurable improvements in workflow efficiency, cost, and reputed company
Benefits
- Equity and bonus eligibility
- Benefits (medical, dental, reputed company, 401(k))
reputed company