It's done Mats Stafseng Einarsen 😆

Evidence that people's attitudes towards experiments are flawed? "people often approve of untested policies or treatments (A or B) being universally implemented but disapprove of randomized experiments (A/B tests) to determine which [..] is superior." pnas.org/content/early/…

By the way, the biggest waste of our time is the waste of talent. Many bankers are way too smart to be working on Wall Street. Many coders are way too smart to be working for Uber or Amazon. They should be solving climate change, poverty, disease etc.

My order of operations when I sit down with a startup to figure out how to grow their new product. 1) first, is it working? Usually the answer is no :) I look at retention rates, DAU/MAU, session lengths, how many visits are driven via push notifs, etc etc. Lots of benchmarking

My daughter, Mia, had a visitor in today's music class. Mia: Mommy, he was from another world! Matilde (Mia's sister): Not from another world, from another country. Mia: Yes, exactly. He was from another world. Mia: He was really musical. Matilde: You mean he was a real musician

1/2 This this this! I don’t get tired of mentioning it. I think it’s the most important thing you can do to grow a culture of experimentation. And it means that every single change must be under a feature flag, and ideally an A/B test, even if ran just for a few hours.

2/2 I've seem so many bugs fixes having to be stopped not long after being started because would break the website in unexpected ways. By decoupling them, people stop being afraid of deployments and velocity in the organization increases tremendously.

Take this great opportunity to work with experimentation at great scale and with Lukas. He’s awesome!!! 😎

Nice discussion. Just last week during Arthur's presentation on the anniversary of Booking's Experiment Tool we saw this. Carolin mentioned a 10% false positive rate and yves orton corrected, asking if it wasn't 5% false positives and 5% false negatives. Both were right.

Sample Ratio Mismatch (aka SRM) made it to the top 10 of things CRO specialists need to be aware of to be run "successful" experiments. What is needed to get it to #1? ;-) #emercegauc20 #experimentation @AM_Klaassen Lukas Vermeer

Jorden Lentze @AM_Klaassen That’s awesome! Very happy to see SRM is now “met stip op nummer zeven”! I’ve tried to make the contents of the paper linked on the slide more accessible on this SRM FAQ page: lukasvermeer.nl/srm/docs/faq/ #emercegauc20

Best opportunity ever. Booking’s experimentation platform it’s a colossus.

Woah! Booking.com just won the organisation-wide lifetime achievement award at #expca2020. Such an honour to accept this award on behalf of all the amazing colleagues and teams who live and shape this culture of experimentation every day. Thank you! 🥳

"This is what experimentation is all about. It’s about how you can solve your customers’ problems, not about how fast you can roll out new features." diggintravel.com/travel-digital…

Testing WebMentions on A/B Smartly's blog. absmartly.com/blog/what-is-a…

linkedin.com/posts/activity…