際際滷

際際滷Share a Scribd company logo

Zakka Fauzan M. | Everything I Know About AB Testing | ProductTank Jakarta

P
Product Tank Jakarta

Product management are undergoing a shift where data literacy is no longer just a nice-to-have skill, but one of the most important skill of the century. Many PMs have proved that by relying on a combination of feedback and data, they can make more well-rounded product decisions and strategy. One of the very useful tool most PM used to develop better product designs and decisions is A/B testing. In this talk, Zakka will share his view and insights on A/B Testing and how he and his team implement this on Bukalapak.

1 of 15
Download to read offline
Everything I Know about AB Testing Zakka Fauzan M.
It could have more than two letters *It could have more than two variants
It should have a goal!
Its goal better be the end of a funnel
Be skeptical for too good or too bad result
Not everything should be AB tested
Don't do "stupid" AB testing e.g., AB testing to check whether the number of people buying gold increase or not by allowing/disallowing people accessing BukaEmas
However, there's no stupid AB testing in the very same case, we can also track the number of other's transaction, whether it decreases or not?
Hence, always monitor more than one metrics
Run it for at least a week *Because each day is "unique"
Don't do AB test only on simple matters
(Suggestion) Run the AB testing even after it is decided
It could hurt your SEO!
(Non-product related) Run AB testing on everything!
The End

More Related Content

Zakka Fauzan M. | Everything I Know About AB Testing | ProductTank Jakarta