
Senior/Staff Applied Scientist
Mountain View, CA at a glance
- Rent
- #2 of 51$2,780/mo+46% vs US avg
- Weather
- #17 of 51311 mild days0 hot · 0 cold
- Income tax
- #1 of 5113.3% top rateCalifornia
What you need
- Masters or PhD in Statistics, Mathematics, or Computer Science
- 5+ yrs applying statistics and ML to products
- Proficient in Python, SQL, and modern data stack (dbt)
- Experience with A/B experimentation platforms and B2B SaaS
What you'll do
- Develop and maintain the A/B experimentation platform
- Collaborate to identify experimentation techniques and tooling improvements
- Conduct end-to-end evaluations of AI use cases and tasks
- Design best practices, tools, and processes for evaluation problems
- Collaborate with product data science and engineering teams to identify techniques, tooling and process improvements in online A/B experimentation to assist rigorous decision making across all relevant product domains.
- Develop and maintain our A/B experimentation platform based on stakeholder feedback
- Write code or identify vendors to deploy these techniques to production in a scalable manner that’s easy to use by engineering, product data science, product management and design teams
- Conduct end to end evaluation of various hero use cases like document/URL uploads, including evaluation set generation, coming up with evaluation criteria and methods to interpret the results.
- Break down end to end evaluations into more granular evaluation of various tasks & skills including but not limited to content summarization/analysis/generation, multi-step reasoning & strategizing, tool selection & use, coding & system design.
- Design, develop and own best practices, tools and processes across various evaluation problems, e.g. query intent classification, standardizing the use of best statistical principles to handle LLM stochasticity, industry benchmarking.
- You have 5+ years of experience as a Masters degree holder, 3+ as a PhD degree holders (Masters/PhD degree in Statistics, Mathematics or Computer Science, or another quantitative field)
- You’re strong in statistics and/or machine learning. You have experience in applying these skills into tangible improvements in products, internal tools, and processes in a pragmatic way that puts business urgencies first.
- You are very proficient in Python, e.g. proficient enough to maintain an internal source-controlled library used by dozens of others.
- You are concise and precise in written and verbal communication. Technical documentation is your strong suit.
- You are proficient in SQL and the modern data stack (e.g. source-controlled dbt pipelines for ETL/ELT).
- You are strong at defining good product KPIs/guardrail metrics, dashboarding and analysis of raw data to derive strategic insights.
- You have experience in B2B SaaS.
- You have experience working on ranking, developing, and maintaining A/B experimentation platforms and/or ML measurement problems.
- You are passionate about using AI to improve the productivity of data teams as well as non-data professionals trying to derive more value of their company’s data.
- This role is hybrid (4 days a week in our Mountain View or San Francisco office)
By clicking “Submit Application,” I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement, and I agree to the terms.
Optimize your resume for this job
Get a match score and the keywords you're missing
About Glean
Glean is the Work AI platform connected to all your company data. Find, create, and automate anything with enterprise-grade generative AI search that respects data access governance.
Similar roles


