Product
Caret Symbol
Products
Experimentation
Product ExperimentationWeb ExperimentationLifecycle Experimentation
Feature Flagging
Release ManagementAutomated RolloutsConfig Flags
AI Personalization
Contextual Bandits
Why Eppo
Caret Symbol
WHY EPPO
By Role
Data ScientistsEngineersProduct Managers
Resources
CustomersOutperformUpdatesWhite Papers
FEATURED CASE STUDY
Coinbase Saves Millions, Reduces Experiment Analysis Time by 40%, and Restores Trust in Experimentation with Eppo
Learn more
Blog
About
Header Nav OpenHeader Nav Close
Product
Caret Symbol
Experimentation
Product ExperimentationWeb ExperimentationLifecycle Experimentation
Feature Flagging
Release ManagementAutomated RolloutsConfig Flags
AI Personalization
Contextual Bandits
Why Eppo
Caret Symbol
By Role
Data ScientistsEngineersProduct Managers
Resources
CustomersOutperformUpdatesWhite Papers
Blog
About
Docs
Offsite link icon

Outperform

The Basics | The Docs  | The Expert Tips | The Inside Scoop
The Basics
The Docs 
The Expert Tips
The Inside Scoop
Presented by Eppo
How businesses win by driving innovation and better decision-making

Outperform

The Basics | The Docs  | The Expert Tips | The Eppo Stuff
Trending now
Experimentation Protocols: Your Practical Path to Better, Faster Testing
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

0

Results

Experimentation School
Chetan Sharma On Institutional Knowledge

Read more
Wiggle Underscore SVG Animation
Culture
How We Ran Successful Experimentation Office Hours at Groupon

Ideas for training and nurturing experimenters across the company

Read more
Wiggle Underscore SVG Animation
Engineering
What’s Wrong with Feature Flags?

Engineering and Growth teams aren't speaking the same language

Read more
Wiggle Underscore SVG Animation
Strategy
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections

Read more
Wiggle Underscore SVG Animation
Statistics
Bayesian Angels and Frequentist Demons

Why do Bayesian and Frequentist claims sound so different?

Read more
Wiggle Underscore SVG Animation
Engineering
What Happened When We Replaced Airflow for DAG Orchestration?

Read more
Wiggle Underscore SVG Animation
Engineering
Why We Replaced Airflow in our Experimentation Platform

Read more
Wiggle Underscore SVG Animation
Engineering
Building a Custom DAG Orchestration System for Experimentation

Read more
Wiggle Underscore SVG Animation
A/B Testing
What is sequential testing? (with examples)

Learn about sequential testing, a method that speeds up A/B testing outcomes. Understand how it works, best practices, and the advantages it offers.

Read more
Wiggle Underscore SVG Animation
A/B Testing
A/B testing vs. split testing: Which should you use?

Discover how A/B testing and split testing differ from one another, and learn how they can help optimize your website or app and drive conversions.

Read more
Wiggle Underscore SVG Animation
A/B Testing
What is feature flag-driven development?

Learn about feature flag-driven development, its benefits, implementation, and best practices. See how Eppo simplifies feature management for data-driven releases.

Read more
Wiggle Underscore SVG Animation
A/B Testing
LaunchDarkly vs. ConfigCat vs. Eppo: Which is best?

LaunchDarkly vs. ConfigCat vs. Eppo: Which platform fits your organization best? Compare features, pricing, and pros/cons.

Read more
Wiggle Underscore SVG Animation
Tips
What is product analytics? A complete guide

Unlock the power of data-driven product development. Learn how product analytics tracks user interactions to optimize your product and boost customer satisfaction.

Read more
Wiggle Underscore SVG Animation
Tips
14 product-led growth metrics you should be tracking

Mastering product-led growth metrics is essential for SaaS success. Learn the top 14 metrics to track, why they matter, and how to improve them.

Read more
Wiggle Underscore SVG Animation
Tips
What is user story mapping? A complete guide (with examples)

Learn the essentials of user story mapping, a powerful tool that helps product teams understand user needs, prioritize features, and build successful products.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Product Usage: Metrics, Analysis, and Strategies (with Examples)

Discover how product usage data reveals valuable insights into user behavior, letting you craft better user experiences, increase retention, and foster growth.

Read more
Wiggle Underscore SVG Animation
Tips
What is Product Observability? Benefits & Best Practices

Unlock the power of product observability to gain real-time insights, improve user experiences, and make data-driven decisions that fuel your product's growth.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Adobe Target vs. Optimizely vs. Eppo: Which One is Best?

Adobe vs. Optimizely vs. Eppo: Which experimentation platform is right for your business? Compare the features, pricing, advantages, and disadvantages of each.

Read more
Wiggle Underscore SVG Animation
A/B Testing
Digital experimentation 101: A Guide to Data-Driven Decision

Learn the essentials of digital experimentation, including A/B and multivariate testing, to optimize your website, app, or marketing campaigns.

Read more
Wiggle Underscore SVG Animation
A/B Testing
VWO vs. Optimizely vs. Eppo: Which is best? | 2024

VWO vs. Optimizely vs. Eppo: Which experimentation platform is right for your team? Compare features, pricing, and pros/cons.

Read more
Wiggle Underscore SVG Animation
Lenny Rachitsky
How Startups Like Figma, Facebook, and Airbnb Found Sudden Growth Inflections
Tyler Buffington
The Bet Test: Spotting Problems in Bayesian A/B Test Analysis
Drew Harry
Make Decisions Before Experimenting
How pre-registration yields more rigorous decisions, faster decisions, and saved time
Julian Runge
Gaming Companies Run Thousands of Experiments a Year: Here’s Why and How
Introducing: Eppo Geolift
·
A/B Testing
Statistics
Engineering
Culture
Marketing

Optimizing for Real Business Impact: A Strategic Framework for Ecommerce Experimentation

Carlos Trujillo
·
February 20, 2025

Gaming Companies Run Thousands of Experiments a Year: Here’s Why and How

Julian Runge
·
February 18, 2025

Accelerate Experimentation Adoption with Protocols and Property Analysis

Eric Metelka
·
November 21, 2024

Marketing Incrementality 101

Greg Dale
·
October 25, 2024

Four Customer Characteristics That Should Change Your Experiment Runtime

Simon Jackson
·
May 16, 2024

Your Comprehensive Guide To Creating an Experiment Plan

Kristi Angel
·
March 6, 2024

Surviving the "Peeking Problem": A Self-Help Guide for Product Managers

Eric Metelka
·
February 22, 2024

Holdouts: Measuring Experiment Impact Accurately

Giorgio Martini
·
December 12, 2023

The Illusion of Safety: How Non-Informative Priors Lead to False Confidence

Tyler Buffington
·
April 29, 2025

Bayes Vs. Frequentism Can Be a Big Deal

Demetri Pananos
·
March 11, 2025

What to Do When You Encounter Sample Ratio Mismatch in A/B Testing

Allon Korem
·
March 6, 2025

The Bet Test: Spotting Problems in Bayesian A/B Test Analysis

Tyler Buffington
·
December 16, 2024

Top 3 Tips from Eppo's Geolift Launch

Elizabeth George
·
November 21, 2024

Bayesian Angels and Frequentist Demons

Sven Schmit
·
July 24, 2024

The Cult of Stat Sig

Giorgio Martini
·
May 29, 2024

Encouragement Design Experiments: When You Can't Run a True A/B Test

Sven Schmit
·
February 20, 2024

Migrating Feature Flagging Tools Is Easy, Actually

Alexey Komissarouk
·
March 7, 2025

Mobile Experimentation with Eppo: From Feature Flags to A/B Testing

Aaron Silverman
·
February 19, 2025

AB Testing 101 for Engineers

Jonathan Fulton
·
October 24, 2024

What’s Wrong with Feature Flags?

Alexey Komissarouk
·
July 24, 2024

What Happened When We Replaced Airflow for DAG Orchestration?

Lisa Huynh
·
July 23, 2024

Building a Custom DAG Orchestration System for Experimentation

Eric Petzel
·
July 22, 2024

Why We Replaced Airflow in our Experimentation Platform

Chas DeVeas
·
July 23, 2024

Incremental Pipelines: Managing State at Scale

Ryan Lucht
·
June 21, 2023

Beyond Vanity Metrics: Driving Results with Eppo’s Email A/B Testing

Greg Dale
·
April 11, 2025

Better Results, Faster: Eppo Geolift vs. CausalImpact and Matched Markets

Greg Dale
·
April 8, 2025

Mastering Experimentation Methods: From Design to Analysis

Tyler Buffington
·
March 28, 2025

The Long Game: Effective Strategies for Optimizing Delayed-Impact Metrics

Greg Dale
·
March 20, 2025

The Whole Is Less Than the Sum of Its Parts: Rethinking How We Measure Experimental Impact

Sven Schmit
·
March 18, 2025

Why You Should Stop Managing Your Experimentation Win Rate

Ryan Lucht
·
March 18, 2025

Picking Your First Incrementality Test

Greg Dale
·
February 27, 2025

Building a Data-Driven Culture Through Experimentation

Katie Petriella
·
February 24, 2025

It’s OK to See Red: The Hidden Value of Negative Experiment Results

Bennett Tulloch
·
April 2, 2025

Make Decisions Before Experimenting

Drew Harry
·
January 27, 2025

How We Ran Successful Experimentation Office Hours at Groupon

Kristi Angel
·
July 24, 2024

How to Hackathon: Where Experimentation Mindset Meets Rapid Action

Aaron Silverman
·
April 18, 2024

What to Look For in an Experimentation Platform (Beyond Features)

Ryan Lucht
·
March 18, 2024

A Simple "Build vs. Buy" Decision Framework for Experimentation

Che Sharma
·
February 5, 2024

Designing Eppo Reports

Ryan Lucht
·
October 25, 2023

From 10s to 1000s: How to Scale Experimentation Velocity

Anne Kim
·
July 26, 2023
New from Eppo
Experimentation Protocols: Your Practical Path to Better, Faster Testing
January 2025 – CJ Towle, Product Marketing Manager
Arrow
Read the Guide

Expert Tips

Unsure how to run experiments? We’ve got you covered!
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
Sven Schmit
·
January 8, 2024
Engineering
What is an Agile Release Train? Explained (with examples)
Aaron Silverman
·
May 22, 2024
Tips
The AARRR Pirate Metrics Framework Explained
Katie Petriella
·
May 22, 2024
Tips
What is The ICE Scoring Method? Explained (with Examples)
Katie Petriella
·
May 22, 2024
A/B Testing
What are Guardrail Metrics? With Examples
Ryan Lucht
·
May 22, 2024
Tips
Product vs. Marketing Analytics: What's the Difference?
Katie Petriella
·
May 22, 2024
Engineering
What are Rolling Deployments & How do They Work?
Aaron Silverman
·
May 16, 2024
A/B Testing
Four Customer Characteristics That Should Change Your Experiment Runtime
Simon Jackson
·
May 16, 2024
Tips
What is an Agile Product Roadmap? Explained (With Examples)
Eric Metelka
·
May 15, 2024
A/B Testing
What is an A/A test? Full Guide with Examples
Ryan Lucht
·
May 15, 2024
Tips
What are Weekly Active Users (WAUs)? Easy Guide
Katie Petriella
·
May 15, 2024
Tips
What is Product Stickiness? Full Guide With Examples
Anne Kim
·
May 9, 2024
Tips
What is Feature Creep? + How to Prevent It (with Examples)
Anne Kim
·
May 9, 2024
Engineering
What is an ETL Pipeline? Easy Guide with Examples
Chas DeVeas
·
May 9, 2024
Tips
What is the DAU/MAU Ratio? In Simple Terms
Katie Petriella
·
May 9, 2024
Tips
What are Daily Active Users (DAUs) Exactly?
Katie Petriella
·
May 8, 2024
A/B Testing
Top 8 Optimizely Alternatives Compared Head-to-Head (2024)
Ryan Lucht
·
April 26, 2024
A/B Testing
What is A/B/n Testing? Easy Guide with Examples
Ryan Lucht
·
April 24, 2024
Culture
How to Hackathon: Where Experimentation Mindset Meets Rapid Action
Aaron Silverman
·
April 18, 2024
A/B Testing
10 A/B Testing Metrics You Should Be Tracking & Testing
Katie Petriella
·
April 18, 2024
Engineering
What is Canary Testing? An Easy Guide (2024)
Aaron Silverman
·
April 18, 2024
Tips
What is Bucket Testing? Examples & Best Practices
Katie Petriella
·
April 16, 2024
Engineering
LaunchDarkly Pricing: Is it Worth The Cost?
Ryan Lucht
·
April 16, 2024
Engineering
Top 8 LaunchDarkly Alternatives for Feature Management & Experimentation (2024)
Ryan Lucht
·
April 10, 2024
Tips
19 SaaS Product Metrics for 2024: Track & Test for Success
Katie Petriella
·
April 5, 2024
A/B Testing
7 Best A/B Testing Tools in 2024 (Expert Review)
Ryan Lucht
·
April 5, 2024
Tips
Product Strategy Framework: The 5 Top-Performing Frameworks to Consider
Eric Metelka
·
April 5, 2024
Eppo News
Introducing: Eppo Contextual Bandits
Sven Schmit
·
April 2, 2024
A/B Testing
7 Benefits of A/B Testing | Is it Really Worth it?
Ryan Lucht
·
April 1, 2024
AI/ML
When Should I Use Contextual Bandit Algorithms vs. Recommendation Systems?
Ryan Lucht
·
March 29, 2024
Culture
What to Look For in an Experimentation Platform (Beyond Features)
Ryan Lucht
·
March 18, 2024
A/B Testing
Your Comprehensive Guide To Creating an Experiment Plan
Kristi Angel
·
March 6, 2024
A/B Testing
Surviving the "Peeking Problem": A Self-Help Guide for Product Managers
Eric Metelka
·
February 22, 2024
Statistics
Encouragement Design Experiments: When You Can't Run a True A/B Test
Sven Schmit
·
February 20, 2024
Culture
A Simple "Build vs. Buy" Decision Framework for Experimentation
Che Sharma
·
February 5, 2024
Statistics
The 4 Types of Validity in an Experiment You Need to Know
Kristi Angel
·
January 11, 2024
Statistics
Comparing Frequentist vs. Bayesian vs. Sequential Approaches to A/B Testing
Sven Schmit
·
January 8, 2024
Eppo News
Now Live: Certified Metrics
Che Sharma
·
January 3, 2024
Eppo News
Now Live: Holdouts
Eric Metelka
·
December 14, 2023
A/B Testing
Holdouts: Measuring Experiment Impact Accurately
Giorgio Martini
·
December 12, 2023
A/B Testing
Bandit vs. Experiment Testing: Which Is Right for You?
Sven Schmit
·
December 12, 2023
Statistics
What We Heard at the 2023 Conference on Digital Experimentation @ MIT
Sven Schmit
·
December 5, 2023
Culture
3 Ways To Sell Your Org on Experimentation
Ryan Lucht
·
December 4, 2023
A/B Testing
How to Run Search-Ranking Experiments
Ryan Lucht
·
November 30, 2023
A/B Testing
When Should I Use Mutually Exclusive Experiments?
Giorgio Martini
·
November 20, 2023
A/B Testing
CMS Integrations: A Better Way for Marketing Teams to Run A/B Tests
Ryan Lucht
·
November 8, 2023
AI/ML
Experimentation Gets AI to the "Real World”
Ryan Lucht
·
November 8, 2023
Statistics
CUPED and CUPED++: Bending time in experimentation
Che Sharma
·
October 30, 2023
Culture
Designing Eppo Reports
Ryan Lucht
·
October 25, 2023
Eppo News
Now Live: Eppo Reports
Sven Schmit
·
October 17, 2023
A/B Testing
How to Compare LLMs with an A/B Test
Sven Schmit
·
September 12, 2023
A/B Testing
Experimentation Metrics: Deciding What To Measure
Anne Kim
·
August 24, 2023
Statistics
Beware of the Bayesian Imposter
Sven Schmit
·
August 15, 2023
Eppo News
The Most Powerful Diagnostics Tool Just Got Even Better
Anne Kim
·
August 9, 2023
AI/ML
The "Transformative Force" of AI and Experimentation
Ryan Lucht
·
August 4, 2023
Culture
From 10s to 1000s: How to Scale Experimentation Velocity
Anne Kim
·
July 26, 2023
AI/ML
AB Experiment Infra is AI Infra
Sven Schmit
·
July 24, 2023
AI/ML
AI Enabled Creators Need AB Experiments
Sven Schmit
·
July 24, 2023
Eppo News
Eppo and Modelbit: Introducing Our Partnership
Sven Schmit
·
July 19, 2023
Engineering
Incremental Pipelines: Managing State at Scale
Ryan Lucht
·
June 21, 2023
Culture
Be Data-Informed, Not Data-Driven
Ryan Lucht
·
June 5, 2023
Eppo News
Introducing the Copy SQL Button
Anne Kim
·
May 24, 2023
Statistics
The Useful Useless p-value
Sven Schmit
·
May 17, 2023
Culture
How to Craft Compelling, Impactful Experiment Reports
Ryan Lucht
·
May 8, 2023
Eppo News
Eppo Announces Integration With Databricks
Sven Schmit
·
May 3, 2023
Product News
5 Ways to Ensure Data Quality When Running Experiments
Sven Schmit
·
April 25, 2023
Eppo News
Introducing Eppo's New Progress Bar
Anne Kim
·
March 29, 2023
Culture
Experimentation is Not a Strategy
Ryan Lucht
·
March 16, 2023
Culture
Doing Data Science in Sports, Where Experimentation Happens on the Field
Ryan Lucht
·
February 21, 2023
Product News
Architecting a Global Feature Flag Service
Ryan Lucht
·
February 16, 2023
Eppo News
Eppo partners with InvestInData to power data-driven decision making
Sven Schmit
·
January 19, 2023
Engineering
Introduction to Feature Flagging and Randomization
Anne Kim
·
January 12, 2023
Eppo News
Welcome to your unified feature flagging + experimentation platform
Sven Schmit
·
November 30, 2022
Statistics
What the heck is statistical power anyhow?
Anne Kim
·
October 25, 2022
Strategy
Introduction to Experimentation
Ryan Lucht
·
October 17, 2022
Culture
Tips for Making Experimentation Successful Across Your Organization
Anne Kim
·
September 26, 2022
AI/ML
Machine learning teams are AB experimentation teams
Sven Schmit
·
September 22, 2022
Eppo News
Eppo Obtains SOC 2 Type II Report
Sven Schmit
·
August 1, 2022
Eppo News
We raised $19.5M to bring Airbnb-caliber experimentation to all
Sven Schmit
·
June 22, 2022
Culture
The most impactful thing a data team can do is establish an experimentation program.
Sven Schmit
·
December 7, 2021
Culture
Stop Micromanaging Product Strategy
Sven Schmit
·
September 1, 2021
Eppo News
We're hiring a statistics engineer!
Sven Schmit
·
August 23, 2021
Strategy
Should you always run an experiment?
Sven Schmit
·
August 12, 2021
Culture
The Designer Gap in A/B Testing Tools
Che Sharma
·
June 28, 2021
Statistics
Reducing Experiment Durations
Che Sharma
·
June 17, 2021
Experimentation Frameworks: A Full Guide With Examples
Katie Petriella
·
A/B Testing
How to Use CRO and A/B Testing Effectively
Ryan Lucht
·
Eppo News
Measuring Experiment Impact Accurately
Holdouts help measure the cumulative, long-term impact of an experimentation program.
Read more
Wiggle Underscore SVG Animation

Not ready to talk just yet?

Take a tour and see the platform for yourself.
Get a demo
Experiment School
Ever wonder how other companies run experiments?

Expert Tips

Marketing
x
Product News
x
Experimentation School
x
Strategy
x
AI/ML
x
A/B Testing
x
Engineering
x
Statistics
x
Eppo News
x
Culture
x
Tips
x