Ronny Kohavi (@ronnyk) / X

Ronny Kohavi

1,223 posts

Ronny Kohavi

@ronnyk

Former exec at Microsoft, Airbnb, Amazon. Teaching interactive Zoom class on A/B Testing at bit.ly/ABClassTWTR Co-author of experimentguide.com

Los Altos, CA

kohavi.com

Joined September 2007

Pinned
Ronny Kohavi
@ronnyk
Jan 30, 2020
Our book, Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing, sharing learnings by Diane Tang from #Google, Ya Xu from #LinkedIn, and my own from #Amazon and #Microsoft (I'm now at #Airbnb) is available for pre-order on Amazon: bit.ly/expBookLI
Ronny Kohavi
@ronnyk
Feb 20
Lightning Lesson on Maven (free): A/B Testing Replication Crisis: Lessons from 10 Large-scale A/B tests. Register at bit.ly/ABTrustworthyP… (March 4, 2026, 10AM PST). Claims of large lifts in A/B tests are widespread, yet many are supported by small online experiments that are
Ronny Kohavi
@ronnyk
Feb 13
The Winner's Curse: 10 Large-Scale A/B Testing Replications. Here is a summary of the 10 replications completed for the Trustworthy A/B Patterns community project: bit.ly/trustworthyABP… In June 2024, @lukasvermeer, @jlinowski, and I, started a community project to replicate
drive.google.com
2026-06-24 TrustworthyABPatternsKDD_posted.pdf
Ronny Kohavi
@ronnyk
Dec 19, 2025
Want to run A/B tests you can trust—and ship faster with fewer false wins? My next Maven cohort of Accelerating Innovation with A/B Testing starts Jan 26, 2026 (5 live, interactive sessions × 2.5 hours). ✅ Start time: 12:00pm Pacific (later time for once, as requested by folks
Ronny Kohavi
@ronnyk
Nov 25, 2025
Our paper, Statistical Challenges in Online Controlled Experiments: a Review of A/B Testing Methodology, is now the 13th most read paper of all time in The American Statistician (measured by views, now over 25,000). It's open access so PDF is downloadable. - Main paper:
tandfonline.com
Statistical Challenges in Online Controlled Experiments: A Review of A/B Testing Methodology
The rise of internet-based services and products in the late 1990s brought about an unprecedented opportunity for online businesses to engage in large scale data-driven decision making. Over the pa...
See @ronnyk's full profile
Sign up
Log in

See @ronnyk's full profile

See @ronnyk's full profile