[Remote] Senior Software Engineer II - reputed company AI and Evaluations (Remote Eligible)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company has been empowering teams for over 20 years with innovative work reputed company. The Senior Software Engineer II will be responsible for owning agent reputed company, diagnosing failures, and driving improvements in AI-powered work management tools.
Responsibilities
- Own agent reputed company end-to-end: diagnosis, improvement, and validation across SmartAssist's orchestrator and subagents
- Identify failure modes across reputed company dimensions factual accuracy, completeness, tone, actionability, and latency and prioritize what to fix
- Drive reputed company improvements through reputed company engineering, context engineering, and RAG retrieval tuning
- reputed company and mature our evaluation reputed company: scorers, golden datasets, regression gates, and online evaluation for production traffic
- reputed company the feedback reputed company ensure that every change has a measurable, attributable reputed company signal
- Collaborate with our Agent Architecture reputed company to distinguish reputed company problems that require reputed company/context solutions from those that require structural fixes
- Establish repeatable methodology that scales reputed company any single agent or subagent
Skills
- 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
- Deep, hands-on experience with reputed company engineering and context engineering, you understand how model behavior changes with framing, structure, and input design
- Strong working knowledge of RAG architectures: chunking strategies, embedding models, retrieval evaluation, and failure diagnosis
- Experience building or extending LLM evaluation frameworks, you have designed scorers, worked with golden datasets, and thought carefully about what good looks like
- reputed company in agent system design, you don't need to own the architecture, but you can engage as a peer on architectural tradeoffs that reputed company reputed company
- Strong Python skills; comfortable working in data-heavy environments (reputed company, reputed company tables, or equivalent)
- Ability to communicate reputed company reputed company findings (written and verbal) to both technical and non-technical stakeholders, you can explain what's broke, why it reputed company, and what needs to happen next without losing the room
- Strong cross-functional judgment, you know reputed company to escalate, reputed company to resolve independently, and how to build credibility across engineering, product, and AI platform teams
- A bias for reputed company in ambiguous situations, reputed company failure modes are murky and trade-offs are reputed company, you bring structure and a reputed company reputed company of view rather than waiting for reputed company
- Legally eligible to work in the U.S. on an ongoing reputed company
- BS or MS in Computer Science, a reputed company field, or equivalent industry experience
- Experience with MLflow or similar experiment tracking platforms
- Familiarity with CI-integrated evaluation pipelines
- Experience with multi-agent orchestration frameworks
- Prior work in an reputed company AI or LLMOps function reputed company a product company
Benefits
- Employer subsidized medical/reputed company and dental coverage for full-time employees
- 401k Match to help you save for your reputed company (50% of your contribution up to the first 6% of your eligible pay)
- Monthly stipend to support your work and productivity
- Flexible Time Away Program, plus reputed company Time Off
- US employees are automatically covered under reputed company-sponsored life insurance, short-term, and long-term disability plans
- US employees receive 12 reputed company holidays per year
- Up to 24 weeks of Parental Leave
- Personal reputed company Volunteer Day to support our community
- Opportunities for reputed company reputed company and development including reputed company to reputed company online courses
- Company Funded Perks, including a counseling membership, local retail discounts, and your own personal reputed company account
- Teleworking reputed company from any registered location in the U.S. (role specific)
- This role will be eligible for a market competitive incentive opportunity
reputed company