ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
UX + A/B Testing at Booking.com:
Design focused on conversion
Maria L¨ªgia
Hi!My name is
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
Maria L¨ªgia
MARIA ELIGIA
MARIA LIDIA
MARIA ELISA
MARIA OL?VIA
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
Maria
USER EXPERIENCE
UFSC ChaordicMidiatools CERTI Myreks General Assembly
AMSTERDAM
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
BABETTE
BABETTE
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
880+K
properties
174
o?ces
42
languages
50
currencies
8+K
servers
224
countries &
territories
$64.49 billion
market cap
perl + template HTML
IT languages
3rd largest e-commerce
in the world
10+K
employees
Teams from 5 to 10 people
Multidisciplinary teams (PO, Team Leader, Designer, Dev)
REALLY.
Teams are responsible for di?erent areas of the website
Semi-Agile SCRUM methodology
Everything, absolutely everything is tested
USER EXPERIENCE
DEFINE THE PROBLEM
DEFINE PERSONAS
DEFINE SCENARIOS
Short story that your persona goes through with your
product related to the problem you de?ned.
USER FLOWS
SKETCHING
WIREFRAMES
DESIGN
FRONT END
USER EXPERIENCE
De?ne the problem
De?ne Personas
De?ne Scenarios
User ?ows
Sketching
Wireframes
Design Front End
A/B TESTING
CONVERSION
What is success to you?
De?ne your metric
Avoids regression
A/B TESTING
Keep the customer at the centre of
everything you do
A/B TESTING +
+ 10 years
Highest conversion in the market
Logo
A/B TESTING +
VS.
Customer Service
Budget for negative experiments
A/B TESTING +
+ 10 years
Highest conversion in the market
Logo
TESTING +
Usability lab in-house
User Research Team
TESTING +
LOCALIZATION:
Japan
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
The Experiment tool is our user's body language. It
only tells us a percentage of what they are thinking
or wanting.
¡°
"Erin Weigel
Senior Designer @ booking.com
Photos on
the Tablet
150px x 150px 200px 300px 500px
Search Results
Photos on
the Tablet
500px
500px
150px
A
B
NEUTRAL
150px x 150px 500px
=
Search Results
Photos on
the Tablet
Increased page load time by 0.5 seconds
=
A
B
300px
A
B
300px
POSITIVE!
Good design at Booking.com isn¡¯t just about making something that
seems to be better. It¡¯s about measuring results, understanding the
impact on the full customer experience, and actually making something
better.
¡°
"Erin Weigel
Senior Designer @ booking.com
http://blog.booking.com/goldilocks-and-the-three-experiments.html
THE HAMBURGUER ICON
A
B
?
http://blog.booking.com/hamburger-menu.html
A
B
NEUTRAL
http://blog.booking.com/hamburger-menu.html
A
B
http://exisweb.net/menu-eats-hamburger
A
B
POSITIVE!
http://exisweb.net/menu-eats-hamburger
20% +
WHAT NOT TO DO IN A/B TESTS
Test A, then after a while test B
Test more than one idea at the same time
Bet with someone that your change will win
Trust me!
HiPPOs !
HiPPOs?
HiPPOs
Highest Paid Person
Design +A/B Test
You = Team Leader = PO = CEO = Founder ¡­
Design + A/B Test
Design is hard, but it¡¯s getting harder now.
BABETTE
Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion
TAKE AWAYS
UX CHANGES AFFECT
CONVERSION
NOT EVERYTHING
IS WHAT IT LOOKS LIKE
Nor how you want it to be, but that¡¯s ok.
DON¡¯T RELY
IN GURUS
DON¡¯T BELIEVE
IN HiPPOs
THE STRONGEST
WILL WIN
THE USER IS AT THE CENTER OF
EVERYTHING. AND THEY
GET TO DECIDE.
Even when they have no clue what they want.
ITERATE. ALWAYS.
Iteration is essential for a
healthy environment.
Experiment fast, fail often and believe in data.
Data never lies.
Maria L¨ªgia Klokner
@marialigiak
maria.klokner@booking.com
/marialigiak
http://grnh.se/ef54yh
Dank u wel!
Work with us!

More Related Content

Tag-it 2016 slides: UX + A/B Testing at Booking.com: Design focused on conversion