Experimentation Advocate

About the role

We are looking for a data scientist to join our team to drive the conversation around digital experimentation and GrowthBook, work directly with active and prospective GrowthBook customers to ensure their experimentation programs are healthy, and help shape the roadmap for the GrowthBook product. This role is fully remote, but we do prefer candidates in US time zones so everyone has some overlapping work hours. As an early employee, you will have an immense impact on the product and business.

Some of the problems you’ll be working on

• Solving Challenging Customer Needs. GrowthBook’s customers often have multiple teams with different experimentation needs. Some teams will be experimenting across logged-in and logged-out tracking events; some teams will need to use pre-aggregated metrics and others will be working with raw event data; some teams will want to ship as early as they can rule out harm, and others will only want to ship clear winners. Answering these and other technical questions with both prospective and onboarding customers, as well as fielding experimentation-focused feature requests, will be an important part of the experimentation advocate’s roles.
• Improving the Quality of Experimentation Discourse. Advice online about best practices in experimentation can be fragmented or come from a particular perspective. As an open-core experimentation platform, GrowthBook serves a wide variety of experimenters with a wide variety of needs. To serve this community, the person in this role will be writing articles and engaging with online conversations about experimentation best practices and how to implement them with GrowthBook.
  • Example questions: How can I think about the trade-offs between sequential testing and classical frequentist testing? What is the best way to measure long-term user behavior in a short-term test? How should I organize my data warehouse for efficient experiment and product analytics? Why is post-stratification on top of CUPED powerful for my use case?
  • Other possible projects: A summary of the state of experimentation on GrowthBook; building a library of successful experiments.
• Leading the Internal Conversation about Experimentation Best Practices. In addition to serving as the external voice of GrowthBook, the experimentation advocate will attend conferences to speak, stay abreast of new developments, and share their knowledge and learnings with the team. This also means using your experience and knowledge to help shape the future of GrowthBook so it can stay at the cutting edge of experimentation practice.

Requirements

• Expert in digital experimentation, with 2+ years working on or with a large scale experimentation platform
• PhD or Masters background in statistics, or equivalent experience
• Solid understanding of SQL and data warehouses
• Experience working with internal or external stakeholders with experimentation needs
• Fluent English and good communication skills
• Startup experience or interest working in a small company
• Bonus: Contributed to an open-source project
• Bonus: Ability to contribute to
• Bonus: Used feature flags or A/B testing at a previous company
• Bonus: Experience with building experimentation or product analytics tooling

Benefits

• 100% remote work from anywhere (within US time zones)
• Health, Vision, and Dental benefits (we cover 100% of the cost for employees and 95% for dependents - though if located outside the US, benefits may vary)
• Generous tech stipend for your home office (or coworking space)
• Regular off-sites in exciting places

GrowthBook is an equal opportunity employer and is committed to creating an inclusive, supportive environment for all employees.

We regret that we cannot sponsor employment visas at this time, although we can make exceptions for H1B transfers.

Interview Process

We typically do 3 virtual interviews:

1. Intro call with data science team lead
2. Technical screen about experimentation challenges with data science team lead and founder
3. Behavioral / cultural interview

In all of these interviews, our goal is not to trick you or waste your time. There are no riddles or leet code questions. We want to see how you think and approach real-world problems and situations. Our goal is to make sure this role is a good fit for both of us.