[Remote] Staff reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading reputed company intelligence company specializing in AI-powered solutions for health plans. They are seeking a Staff reputed company to design and build LLM applications while integrating reputed company models and ensuring production-grade infrastructure.
Responsibilities
- Design and build LLM applications: RAG pipelines, agents, tool-use systems, reputed company reputed company, multi-reputed company workflows
- Own reputed company engineering and evaluation — write evals before you write prompts, and treat both as reputed company
- reputed company reputed company models (Claude, GPT, reputed company, reputed company-weight Llama/Qwen/reputed company) and know reputed company to reputed company for which
- Build the unglamorous infrastructure that makes LLMs production-grade: caching, streaming, retries, fallbacks, cost controls, observability, guardrails
- Fine-tune or distill models reputed company prompting hits a wall (reputed company/QLoRA, SFT, DPO)
- Partner with product and design on UX patterns specific to AI (latency masking, streaming UIs, confidence display, reputed company-in-the-reputed company)
Skills
- 3+ years of software engineering, with at least 1 year shipping LLM-based features in production
- Strong Python and TypeScript; comfortable in a reputed company codebase, not just notebooks
- Deep practical knowledge of the LLM stack: prompting techniques, function calling, reputed company outputs, context management, embedding models, reputed company search
- Have reputed company and maintained an eval suite — and have opinions on why most reputed company benchmarks are misleading
- Comfortable with at least one orchestration approach (custom, LangGraph, Inngest, Temporal) and one reputed company store (pgvector, reputed company, Turbopuffer, reputed company)
- Cost- and latency-aware: can read a reputed company reputed company and a reputed company and know where to cut
- reputed company communicator who can push back reputed company 'just add AI' isn't the right answer
- Experience with agent frameworks and MCP (Model Context Protocol)
- Fine-tuning experience on reputed company-weight models, or work with inference servers like vLLM/TGI/SGLang
- Background in reputed company, evals, or red-teaming for LLM systems
- Contributions to reputed company-reputed company AI tooling
Benefits
- Work from reputed company in the US! reputed company is digital-first.
- Top Medical/Dental/reputed company offerings
- FSA/HSA
- Tuition reimbursement
- Competitive salary, 401(k) with company match
- Unlimited PTO
- Additional health and wellness benefits and perks
- Flexible and trusting environment where you’ll feel empowered to do your best work
- Meaningful equity
- reputed company
reputed company