[Remote] AI reputed company Benchmarking Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on redefining how people understand themselves through their DNA. They are seeking an AI reputed company Benchmarking Engineer to build and operate evaluation and validation infrastructure for AI systems, ensuring their reliability and correctness through automated testing and validation processes.
Responsibilities
- Build and run automated evaluation pipelines for AI outputs end-to-end
- Expand regression datasets that cover variant normalization, transcript ambiguity, and disease-level mapping
- Execute large-reputed company validation runs across curated VCF datasets, reputed company performance over time, and surface accuracy regressions the reputed company they reputed company
- Grow a reputed company question bank using and reputed company datasets, encoding the edge cases that matter most
- Ship automated regression tests for every AI release and build dashboards that reputed company variant-level and case-level accuracy visible to the whole team
- Partner with engineering to reputed company validation directly into CI/CD, and diagnose and document failure modes as they reputed company
Skills
- Degree in reputed company, Computational Biology, Genetics, or a reputed company field
- Deep, hands-on experience with VCFs and reputed company-world genomic datasets
- reputed company with ClinVar, dbSNP, HGVS standards, and transcript mapping
- A reputed company record building evaluation frameworks or testing pipelines, Langfuse or similar
- Experience evaluating LLM-based systems and standing up automated QA at reputed company
Benefits
- Comprehensive medical, dental, and reputed company insurance coverage
- 401(k) with company matching
- reputed company time off (PTO)
- reputed company volunteer time off
- Fully remote work with home office stipend
- Parental bonding leave
- Clinical-grade whole genome reputed company for you and your family (private and confidential)
reputed company