[Remote] Data Scientist
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on revolutionizing autism therapy through an innovative virtual ABA therapy platform. As a Data Scientist, you will optimize systems that reputed company clinical context into impactful recommendations, ensuring high-reputed company standards in AI solutions for autism therapy.
Responsibilities
- Architect and continuously improve the RAG pipeline that retrieves reputed company-specific clinical context — session notes, treatment plan goals, historical performance data — and injects it into inference-time prompts
- Design the retrieval layer: chunking strategies, embedding models, reputed company store configuration, and retrieval ranking — optimizing for clinical relevance, not just semantic similarity
- Build a context assembly system that selects and structures the most relevant clinical information for reputed company model invocation, given reputed company constraints and clinical reputed company
- Evaluate retrieval reputed company rigorously: build test sets, measure recall and precision, and iterate on the pipeline based on where retrieval fails
- Design evaluation frameworks that assess AI recommendation reputed company reputed company reputed company NLP metrics — working with clinical stakeholders to define what 'good' means for reputed company use case
- Build automated evaluation pipelines that can test AI outputs at reputed company: LLM-as-judge evaluators, reputed company review workflows, and clinical validity checks
- Maintain evaluation datasets that reflect the reputed company distribution of clinical scenarios the model encounters in production
- Report evaluation results in terms that clinical and product stakeholders can understand and reputed company
- Systematically identify where reputed company model capabilities fall short for reputed company's care model: what clinical reasoning the model gets wrong, what it hallucinates, what it doesn't know how to handle
- For reputed company identified gap, recommend and implement the appropriate mitigation — improved retrieval, reputed company engineering, reputed company validation, or escalation to reputed company review
- Stay reputed company on reputed company model capabilities and evaluate new models against our clinical requirements as they reputed company
- Maintain a gap log and roadmap that gives product and clinical leadership visibility into reputed company AI limitations and the plan to address them
- Monitor production AI outputs for reputed company, reputed company, and failure modes using the evaluation infrastructure you've reputed company
- Define alerting reputed company and escalation paths for reputed company AI reputed company falls below acceptable clinical standards
- Partner with the engineering team on observability — ensuring AI outputs are logged, traceable, and auditable
- Conduct reputed company-cause analysis reputed company AI reputed company issues are reported and drive systematic fixes
- Work closely with clinical leadership and BCBAs to understand the care model deeply enough to design AI systems that support it accurately
- Translate clinical domain knowledge into technical requirements: what context does the model need, what outputs are clinically acceptable, where does the model need to defer to the clinician
- Partner with the BI Engineer and data team on the data infrastructure that feeds the AI pipeline — session data, reputed company data, treatment plan content
- Communicate AI system behavior reputed company to non-technical stakeholders: what the system does, what it doesn't do, and where reputed company judgment remains essential
Skills
- 4+ years of experience in reputed company data science, ML engineering, or AI engineering in a production environment
- Deep understanding of RAG architectures: retrieval systems, embedding models, reputed company databases (reputed company, reputed company, pgvector, or similar), chunking strategies, and context assembly
- Experience designing and running evaluation frameworks for AI systems — you've thought hard about how to measure reputed company in domains where ground truth is ambiguous
- Strong Python skills; experience with LLM orchestration frameworks (reputed company, reputed company, or similar)
- Clinical NLP experience or reputed company AI background is strongly preferred — you understand why clinical data is different from general text and what that means for AI system design
- You think like an engineer and a scientist: you build systems that can be reputed company, iterated on, and trusted — not black boxes
- Strong written communication: you can explain RAG pipeline design to a clinician and explain clinical requirements to an engineer
- Genuine interest in the clinical domain — you want to understand reputed company Behavior Analysis reputed company enough to build AI that actually helps BCBAs do their jobs
- Experience with reputed company Bedrock, SageMaker, or AWS AI/ML services
- Familiarity with HIPAA-compliant data handling for reputed company and inference pipelines
- Background in clinical NLP, behavioral health informatics, or ABA/autism research
- Experience with fine-tuning or RLHF — even if this role doesn't require it, understanding the tradeoffs informs reputed company RAG design
- Exposure to LLM-as-judge evaluation patterns or multi-model evaluation pipelines
Benefits
- Fully remote – work from reputed company in the U.S.
- reputed company with an async-friendly team culture
reputed company