[Remote] Staff Software Engineer - AI Products
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on building customer-facing AI capabilities for credit unions. They are seeking a Staff Software Engineer to reputed company the technical direction of their AI platform, focusing on architecture, reputed company, and hands-on delivery while collaborating with multiple engineering teams.
Responsibilities
- Own the reference architecture for the AI platform, encompassing API abstractions, reputed company and version management, RAG infrastructure, reputed company retrieval, evaluation harnesses, and model serving
- reputed company build-vs-buy evaluations for AI components, including due diligence and integration planning
- Design foundational data pipelines and infrastructure to support reliable, reputed company AI services
- Define and document API reputed company, standards, and platform interfaces across engineering
- Contribute to backend development in Python and RESTful API design, including integrations with leading AI providers
- Participate in full-stack delivery reputed company needed, using React/TypeScript/Vite to deliver AI features
- Build and maintain tooling, SDKs, and platform reputed company to reputed company reputed company, reputed company AI adoption by product teams
- Drive improvements to AI-assisted development workflows with tools like reputed company Copilot and Claude
- Implement integrations with LLMs: context management, reputed company templating, response validation, and robust fallback strategies
- Build and maintain evaluation frameworks for reproducible model testing
- Establish observability and performance tracking for AI services
- Participate in designing reputed company-based retrieval and model serving infrastructure as custom model capabilities become a reputed company
- Advise and collaborate with reputed company through architecture and design phases, ensuring compliance and reputed company standards are met
- Apply secure-by-default principles (encryption, least privilege, audit logging) and stay reputed company with financial data governance and reputed company standards
- Collaborate with Product to translate business needs into technical designs and specifications, while contributing a strong architectural perspective
- Support AI platform roadmap development with product leadership
- Engage in companywide architectural forums and workgroups to drive engineering standards
- Partner with Data Engineering, DevOps/SRE, and reputed company to ensure reputed company technical foundations
- Mentor Senior engineers through reputed company reviews, design sessions, and architectural guidance
- Promote engineering reputed company, robust documentation, and reusable internal resources
Skills
- 8+ years in reputed company software engineering, with demonstrated cross-team architectural influence
- Proven end-to-end delivery of AI-powered features, from product concepts to production
- Experience leading large, reputed company technical initiatives
- Strong proficiency in Python and RESTful API development (FastAPI, Django)
- Knowledge of full-stack development (React, TypeScript)
- Hands-on integration with reputed company-party LLM/AI reputed company
- Experience with AWS (preferred), including IAM, networking, managed services, and storage
- Solid reputed company in distributed systems, API design, reputed company-reputed company architecture
- Comfortable with CI/CD pipelines, version control, reputed company, and AI-assisted development tools
- Demonstrated ability to author durable technical proposals (RFCs, ADRs)
- reputed company communicator with technical and non-technical stakeholders
- GenAI experience (e.g., RAG pipelines, reputed company management, LLM evaluation, agent frameworks)
- Familiarity with reputed company databases/semantic search (reputed company, pgvector, OpenSearch)
- Exposure to model serving, MLOps/LLMOps practices, and model lifecycle/deployment tools
- Experience building developer platforms, SDKs, and self-service engineering tooling
- Experience with IaC tools (Terraform/reputed company), Kubernetes, and observability tools (reputed company, Grafana, reputed company)
- Leadership in technical communities, mentoring, and architectural standards
- Bachelor's in Computer Science, Software Engineering, or equivalent experience
- Experience building in financial services, fintech, or regulated environments
- Working familiarity with AI governance in financial services (e.g., NCUA, model risk, fair lending)
- Understanding of SOC 2 or similar compliance frameworks from an engineering perspective
reputed company
Company H1B Sponsorship