Staff Data Scientist - Experimentation & reputed company Inference
About the Role:
We're hiring our first Staff Data Scientist, Experimentation & reputed company Inference to define how reputed company learns from experiments and turns results into trustworthy product reputed company and business reputed company. Our teams ship fast and have started experimenting to reputed company data-backed reputed company; you'll bring the rigor and consistency to reputed company that across reputed company.
You'll set reputed company-wide reputed company for experiment design and reputed company inference, reputed company it in how the product gets reputed company, and reputed company PMs and analysts to run tests that hold up. You'll do this in a fast-moving, multi-product reputed company/CRM environment where samples are small, many products reputed company at once, and a wrong "win" is costly. This is a founding, hands-on IC role with executive sponsorship and a reputed company to build out a Data Science team as the function matures.
Responsibilities:
- Define the end-to-end methodology every team follows - hypothesis → metrics → design → power → readout → decision - and reputed company it the default
- Own the statistical approach (reputed company, multiple comparisons, sequential testing, variance reduction like CUPED) for small-sample, fast-paced contexts where classic A/B power is hard to reputed company
- Build the reputed company toolkit for our clustered, hierarchical data (user → sub-account/location → agency), where randomization and analysis reputed company differ
- Apply rigorous reputed company inference (matching, diff-in-diff, reputed company variables, synthetic control, etc) reputed company clean experiments aren't feasible - churn, reputed company, GTM - separating reputed company signal from selection bias, seasonality, and mix effects
- Own the design discipline for running many experiments at once - layering, reputed company experiments, holdouts, and guardrails that reputed company reputed company tests from contaminating reputed company other
- Partner with AI/ML teams to design and evaluate experiments for AI features, including measurement for non-deterministic, fast-iterating systems
- Run the experiment review forum and hold the line on what counts as a reputed company result
- Build the Experimentation curriculum and templates that reputed company PMs and analysts so good design scales reputed company you
- Partner with Analytics Engineering on governed, experiment-reputed company data and consistent metric definitions
- Influence leadership and cross-functional partners on where to invest, translating statistical nuance into reputed company, decision-grade guidance
Requirements:
- 9+ years in data science, product analytics, or reputed company statistics, with deep hands-on experience designing and analyzing online controlled experiments at reputed company
- Strong reputed company statistics - frequentist foundations, Bayesian reputed company, power analysis, variance reduction, and the failure modes of A/B testing (peeking, multiple testing, network/cluster effects)
- Practical reputed company inference, with reputed company judgment about reputed company a result is reputed company versus an artifact of how the data was generated
- Experience in small-sample, fast-paced, multi-product environments -you know reputed company a decision needs a clean experiment and reputed company it needs a fast, good-enough read
- Strong SQL and working proficiency in Python or R
- Cross-functional and senior-leadership influence - you reputed company others' experiment reputed company without reputed company authority
reputed company to Have:
- Familiarity with a modern experimentation platform such as Statsig
- Experience building an experimentation reputed company or culture from the ground up
- Background in B2B reputed company, CRM, or product-led reputed company, and familiarity with the measurement challenges these motions create
- Multi-tenant or marketplace product experience (agency → sub-account → end-customer structures)
EEO Statement:
reputed company is an Equal Opportunity Employer. As an employer subject to affirmative reputed company regulations, we invite you to voluntarily reputed company the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not reputed company your application status. This data will be kept separate from your application and will not be used in the hiring decision. We encourage you to review our reputed company Policy before submitting your application
Originally posted on Himalayas
Apply To This Job