Mobile A/B Test
9 likes1,096 views
This document discusses A/B testing and optimization. It provides examples of how to define metrics, understand bottlenecks, explore opportunities, and refine tests. Key points include measuring success metrics, analyzing user flows to find bottlenecks, exploring variants before refining, and letting tools handle auto-optimization on the fly.
Mobile A/B Test
- 1. Inspired Dan Siroker & Wyatt Jenkins A/B Testing
- 2. GROWTH is simply a series of experiments Wyatt Jenkins VP Product at shutterstock
- 4. Idea Generation Qualitative Wyatt Jenkins VP Product at shutterstock Validation Quantitative
- 5. You can not test what you don't meusure Define quantifiable success metrics 50% Users 50% Users Avg. Session Duration: 00:00:58 Avg. Session Duration: 00:01:28
- 6. You can not test what you don't meusure Define quantifiable success metrics 100% Users Avg. Session Duration: 00:00:58 Avg. Session Duration: 00:01:28
- 7. Great tools to use Define quantifiable success metrics
- 8. You can not test what you don't meusure Define quantifiable success metrics
- 10. 151 View Signup Page 105 Enter Email 78 Enter Password 46 Sign Up 69.54% 74.29% 58.97% User flow Understand Bottleneck
- 11. User flow Understand Bottleneck 151 View Signup Page 105 Enter Email 78 Enter Password 46 Sign Up 69.54% 74.29% 58.97%
- 12. User flow Understand Bottleneck 50% Users Repeat Password 50% Users Hide Repeat Password
- 13. User flow Understand Bottleneck 151 View Signup Page 105 Enter Email 78 Enter Password 55 Sign Up 69.54% 74.29% 70.27%
- 15. User flow Understand Oportunities Download Content Revenue Bound
- 16. User flow Understand Oportunities Download Content Revenue Bound
- 17. User flow Understand Oportunities Download Content Revenue Bound 50% Users 50% Users
- 18. User flow Understand Oportunities Download Content Revenue +6%
- 19. Explore before you refine.
- 20. Explore Combining variants Download Content Revenue +9%
- 21. Words matter. Focus on your call to action.
- 22. Explore Words Matters Download Now Free Download Save to Later
- 23. Explore Words Matters Download Now Free Download Save to Later +9%
- 24. Brand Wyatt Jenkins VP Product at shutterstock Optimization -vs-
- 29. Tools Goals
- 31. Tools On the fly