際際滷

際際滷Share a Scribd company logo
Quick and easy
                         user research
      Learn from the user and ensure your service is successful




Fr辿d辿ric Gaillard gaillard@axance.fr        UX Masterclass   Sept 20th, 2010
3 things
We want to talk to you about today




Axance      UX Master Class Sept. 20th, 2010   2
First
Why do we need user research to create new
         products and services?




    Axance      UX Master Class Sept. 20th, 2010   3
Second
What are the main pitfalls of user research?




    Axance      UX Master Class Sept. 20th, 2010   4
Third
             How can you conduct
         quick and easy user research?




Axance            UX Master Class Sept. 20th, 2010   5
Who am I?
Your presenter: Fr辿d辿ric Gaillard

 Founder and CEO of Axance user experience
design, France
 Axance: French, design consulting firm:
specialized in incorporating user-centered design
principles into online product lifecycle

   Date of creation: 1999
   Number of Employees: 35 (25 + 10 ext.)
   Total clients: 200+
   Turnover (2010): 3.9M (estim.)

 Founding member of UXalliance (with 4 others
entrepreneurs)




Axance                                              7
Part 1


Why do we need user research?
京艶界温顎壊艶




         It is dangerous to design
       for a user who doesnt exist




               http://www.walletpop.com/specials/top-25-biggest-product-flops-of-all-time

      Axance                         UX Master Class Sept. 20th, 2010                       9
Some other flops




               http://www.walletpop.com/specials/top-25-biggest-product-flops-of-all-time
axance                                                                                      10
京顎岳




                What do we really need
                 to learn from user?



       Axance          UX Master Class Sept. 20th, 2010   11
We need to understand what really motivates the user




      What does he need?
    When does he need it?
     How does he need it?


     Axance          UX Master Class Sept. 20th, 2010   12
We must understand the entire user experience


               Perception

               Cognition

               Emotion

               Action



     Axance              UX Master Class Sept. 20th, 2010   13
We must be able to build the real user journey




By focusing on user tasks
you can assure that less important functions
wont clutter the interface




        Axance                       UX Master Class Sept. 20th, 2010   14
What tools and methods can you apply?

  Observation (in context of use)
  Usage testing
  Eye Tracking
  Remote usability testing
  User feedback (e.g. through online
 surveys)




       Axance                  UX Master Class Sept. 20th, 2010   15
意鞄艶稼



                   Doing research
                 with your customer
                   helps you focus
                  on the right goals


        Axance        UX Master Class Sept. 20th, 2010   16
Part 2


Which are the main pitfalls of
user research?
Our statement is:




                 Research is usually done
                   at critical moments
                 of the product life cycle


        Axance           UX Master Class Sept. 20th, 2010   18
User research is often done for design validation
(go/no-go)

               What should we fix to                                                   What does the end user think of
         improve the global UX of our   UR                Definition           UR      our idea?
                             service?


                                       Live/                                  Conceptual
                                   Improvements                                 design
                                                      Product
        Are there any critical
    problem encountered by                            Lifecycle                               What does the end user
       the end user that we      UR                                                   UR      understand from our design?
 should fix before going live?

                                            Development                Prototyping



                                                           UR
                                        Is the end user able to use our prototype?




            Axance                               UX Master Class Sept. 20th, 2010                                           19
京顎岳



                A critical moment
              is not the best time
          to learn lessons from user
       and its often too late for designers to accept errors




        Axance             UX Master Class Sept. 20th, 2010      20
意鞄艶稼




        Its too many lessons to learn
               at the same time
                 (not just 1 lesson)




        Axance      UX Master Class Sept. 20th, 2010   21
Its a real challenge to apply all these findings from a research




                                                           A very small amount of findings is
                                                           processed

                                                           Only those:
                                                           - Easy to implement
                                                           - Easy to share among team members

                                                           Rarely the most important ones: those
                                                           that would change dramatically the
                                                           shape of a project

                     Data collection document from test

        Axance                       UX Master Class Sept. 20th, 2010                              22
A common conclusion from client is:

Research takes too much time




Axance        UX Master Class Sept. 20th, 2010   23
e.g. the minimum length of a standard research today is 15 days



                       5/7 days             2 days           5 days           1 day


                                                                                      = 15 days


  1- Preparation and recruitment
                                   2- Fieldwork
                                       3- Analysis and reporting

                                      4- Presentation of report with project team




               It takes 15 business days minimum before you get the results



         Axance                           UX Master Class Sept. 20th, 2010                        24
Then


                 When research takes time
                it is harder for the design team
                 to build, learn and rebuild


                   (to acquire a failure culture)


       Axance             UX Master Class Sept. 20th, 2010   25
Part 2


How can you conduct quick and
easy user research?
1
Test small parts
and test more often




                       27
Use cheap and fast evaluation techniques

 Short telephone interviews with user                               Duration: 1-2 day
 (using screen sharing tool to view user interface)

 Expert reviews, cognitive walkthroughs                      Duration: 2-5 days
 (if no access to users, due to lack of time or limited availability)

 Brief user research in realistic contexts                Duration: 6-8 days
  (focus on the Primary audience, organize a user panel, avoid lab and deliver
results in workshops)




         Axance                   UX Master Class Sept. 20th, 2010                       28
How to shorten the length of user research?
With a focus on the Primary audience and by delivering the results in a workshop



                                 2/3 days          2 days 1 day 1 day


                                                                             = 6/8 days


         1- Preparation and recruitment
                                          2- Fieldwork
                                                   3- Analysis
                                   4- Workshop with project team
                               (report is replaced by a workshop)




                                   Time can be divided by 2


        Axance                            UX Master Class Sept. 20th, 2010                29
Provide the project team with easy lessons to learn




               HP Version A                                      HP Version B

                   24%                                                   37%




      Axance                  UX Master Class Sept. 20th, 2010                  30
Test early with Low-Fidelity prototypes
Layouts, visuals, processes, labels, colors




                                 Early sketches (informal)




                                                                      Graphic mockup to visualize
                  Layouts with content
                                                                             The solution

        Axance                     UX Master Class Sept. 20th, 2010                                 31
2
Share the raw results with
 the whole project team
Before making any recommendations



                                    32
Share important lessons with all stakeholders

 Helps make strategic decisions


 Promotes collaboration
  (and team integration)


 Avoid low level recommendations
   (not connected to the company
strategy)                                         Castorama board of directors + design team
                                                  during a strategic workshop in nov. 2008




       Axance                      UX Master Class Sept. 20th, 2010                            33
When possible



                      3
           Bring a user researcher
           within the project team
                 as project management support




                                                 34
Embed the research in the design flow

               Now: Continuous user input
      UR        UR          UR       UR          UR       UR        UR       UR      UR       UR




           1- Prototyping and design                  2- Development              3- Optimization




    UR                                    UR                                 UR

           Before: User input was at critical steps of the project


                     Why is it cheaper?
                     - Less time needed to recruit the users
                     - No need to prepare testing material or brief the researcher
                     - Less redesign work (easy lessons provided on the fly)
                     - Customize the design team to user needs and behavior

    Axance                                UX Master Class Sept. 20th, 2010                          35
Example: fnacmusic.com

   10 months project

   27 days of testing during 8 months (214 Participants)

   No redesign during first 2 years




                                                               We built 束 in store 損 lab


     Axance                 UX Master Class Sept. 20th, 2010                         36
Some take-aways
6 tips for quick and easy user research

 1. Start with fast and cheap methods (e.g. expert reviews)

 2. Test unfinished material (e.g. dont build a prototype dedicated to testing)

 3. Break user feedback phases in small segments (as a continuous process)

 4. Test with fewer users but more often

 5. Go to participants home or office if you have time (and attend sessions when possible)

 6. Dont ask for a report or user session notes (ask for a workshop right after the sessions +

 annotated screenshots)




        Axance                        UX Master Class Sept. 20th, 2010                            38
If we have 5 more minutes
Bonus


How do you apply these methods
to international projects?
3 simple lessons
       we have learned
About doing global user research



  Axance   UX Master Class Sept. 20th, 2010   41
Lesson #1
Every member of the team must
         share the same vision



Axance        UX Master Class Sept. 20th, 2010   42
Lesson #2
Every member of the team must have
       continuous feedback
           from the user


  Axance     UX Master Class Sept. 20th, 2010   43
Lesson #3
Every member of the team must be
   willing to learn from mistakes



 Axance      UX Master Class Sept. 20th, 2010   44
Read our latest book!




             Win 5 copies of our book today!
(Leave your business card in the basket, we will draw winners later today!)

  Axance                   UX Master Class Sept. 20th, 2010                   45
Questions?
                             
         Visit our site: www.uxalliance.com

             Fr辿d辿ric Gaillard gaillard@axance.fr




Axance             UX Master Class Sept. 20th, 2010

More Related Content

Agile User research (from 2008)

  • 1. Quick and easy user research Learn from the user and ensure your service is successful Fr辿d辿ric Gaillard gaillard@axance.fr UX Masterclass Sept 20th, 2010
  • 2. 3 things We want to talk to you about today Axance UX Master Class Sept. 20th, 2010 2
  • 3. First Why do we need user research to create new products and services? Axance UX Master Class Sept. 20th, 2010 3
  • 4. Second What are the main pitfalls of user research? Axance UX Master Class Sept. 20th, 2010 4
  • 5. Third How can you conduct quick and easy user research? Axance UX Master Class Sept. 20th, 2010 5
  • 7. Your presenter: Fr辿d辿ric Gaillard Founder and CEO of Axance user experience design, France Axance: French, design consulting firm: specialized in incorporating user-centered design principles into online product lifecycle Date of creation: 1999 Number of Employees: 35 (25 + 10 ext.) Total clients: 200+ Turnover (2010): 3.9M (estim.) Founding member of UXalliance (with 4 others entrepreneurs) Axance 7
  • 8. Part 1 Why do we need user research?
  • 9. 京艶界温顎壊艶 It is dangerous to design for a user who doesnt exist http://www.walletpop.com/specials/top-25-biggest-product-flops-of-all-time Axance UX Master Class Sept. 20th, 2010 9
  • 10. Some other flops http://www.walletpop.com/specials/top-25-biggest-product-flops-of-all-time axance 10
  • 11. 京顎岳 What do we really need to learn from user? Axance UX Master Class Sept. 20th, 2010 11
  • 12. We need to understand what really motivates the user What does he need? When does he need it? How does he need it? Axance UX Master Class Sept. 20th, 2010 12
  • 13. We must understand the entire user experience Perception Cognition Emotion Action Axance UX Master Class Sept. 20th, 2010 13
  • 14. We must be able to build the real user journey By focusing on user tasks you can assure that less important functions wont clutter the interface Axance UX Master Class Sept. 20th, 2010 14
  • 15. What tools and methods can you apply? Observation (in context of use) Usage testing Eye Tracking Remote usability testing User feedback (e.g. through online surveys) Axance UX Master Class Sept. 20th, 2010 15
  • 16. 意鞄艶稼 Doing research with your customer helps you focus on the right goals Axance UX Master Class Sept. 20th, 2010 16
  • 17. Part 2 Which are the main pitfalls of user research?
  • 18. Our statement is: Research is usually done at critical moments of the product life cycle Axance UX Master Class Sept. 20th, 2010 18
  • 19. User research is often done for design validation (go/no-go) What should we fix to What does the end user think of improve the global UX of our UR Definition UR our idea? service? Live/ Conceptual Improvements design Product Are there any critical problem encountered by Lifecycle What does the end user the end user that we UR UR understand from our design? should fix before going live? Development Prototyping UR Is the end user able to use our prototype? Axance UX Master Class Sept. 20th, 2010 19
  • 20. 京顎岳 A critical moment is not the best time to learn lessons from user and its often too late for designers to accept errors Axance UX Master Class Sept. 20th, 2010 20
  • 21. 意鞄艶稼 Its too many lessons to learn at the same time (not just 1 lesson) Axance UX Master Class Sept. 20th, 2010 21
  • 22. Its a real challenge to apply all these findings from a research A very small amount of findings is processed Only those: - Easy to implement - Easy to share among team members Rarely the most important ones: those that would change dramatically the shape of a project Data collection document from test Axance UX Master Class Sept. 20th, 2010 22
  • 23. A common conclusion from client is: Research takes too much time Axance UX Master Class Sept. 20th, 2010 23
  • 24. e.g. the minimum length of a standard research today is 15 days 5/7 days 2 days 5 days 1 day = 15 days 1- Preparation and recruitment 2- Fieldwork 3- Analysis and reporting 4- Presentation of report with project team It takes 15 business days minimum before you get the results Axance UX Master Class Sept. 20th, 2010 24
  • 25. Then When research takes time it is harder for the design team to build, learn and rebuild (to acquire a failure culture) Axance UX Master Class Sept. 20th, 2010 25
  • 26. Part 2 How can you conduct quick and easy user research?
  • 27. 1 Test small parts and test more often 27
  • 28. Use cheap and fast evaluation techniques Short telephone interviews with user Duration: 1-2 day (using screen sharing tool to view user interface) Expert reviews, cognitive walkthroughs Duration: 2-5 days (if no access to users, due to lack of time or limited availability) Brief user research in realistic contexts Duration: 6-8 days (focus on the Primary audience, organize a user panel, avoid lab and deliver results in workshops) Axance UX Master Class Sept. 20th, 2010 28
  • 29. How to shorten the length of user research? With a focus on the Primary audience and by delivering the results in a workshop 2/3 days 2 days 1 day 1 day = 6/8 days 1- Preparation and recruitment 2- Fieldwork 3- Analysis 4- Workshop with project team (report is replaced by a workshop) Time can be divided by 2 Axance UX Master Class Sept. 20th, 2010 29
  • 30. Provide the project team with easy lessons to learn HP Version A HP Version B 24% 37% Axance UX Master Class Sept. 20th, 2010 30
  • 31. Test early with Low-Fidelity prototypes Layouts, visuals, processes, labels, colors Early sketches (informal) Graphic mockup to visualize Layouts with content The solution Axance UX Master Class Sept. 20th, 2010 31
  • 32. 2 Share the raw results with the whole project team Before making any recommendations 32
  • 33. Share important lessons with all stakeholders Helps make strategic decisions Promotes collaboration (and team integration) Avoid low level recommendations (not connected to the company strategy) Castorama board of directors + design team during a strategic workshop in nov. 2008 Axance UX Master Class Sept. 20th, 2010 33
  • 34. When possible 3 Bring a user researcher within the project team as project management support 34
  • 35. Embed the research in the design flow Now: Continuous user input UR UR UR UR UR UR UR UR UR UR 1- Prototyping and design 2- Development 3- Optimization UR UR UR Before: User input was at critical steps of the project Why is it cheaper? - Less time needed to recruit the users - No need to prepare testing material or brief the researcher - Less redesign work (easy lessons provided on the fly) - Customize the design team to user needs and behavior Axance UX Master Class Sept. 20th, 2010 35
  • 36. Example: fnacmusic.com 10 months project 27 days of testing during 8 months (214 Participants) No redesign during first 2 years We built 束 in store 損 lab Axance UX Master Class Sept. 20th, 2010 36
  • 38. 6 tips for quick and easy user research 1. Start with fast and cheap methods (e.g. expert reviews) 2. Test unfinished material (e.g. dont build a prototype dedicated to testing) 3. Break user feedback phases in small segments (as a continuous process) 4. Test with fewer users but more often 5. Go to participants home or office if you have time (and attend sessions when possible) 6. Dont ask for a report or user session notes (ask for a workshop right after the sessions + annotated screenshots) Axance UX Master Class Sept. 20th, 2010 38
  • 39. If we have 5 more minutes
  • 40. Bonus How do you apply these methods to international projects?
  • 41. 3 simple lessons we have learned About doing global user research Axance UX Master Class Sept. 20th, 2010 41
  • 42. Lesson #1 Every member of the team must share the same vision Axance UX Master Class Sept. 20th, 2010 42
  • 43. Lesson #2 Every member of the team must have continuous feedback from the user Axance UX Master Class Sept. 20th, 2010 43
  • 44. Lesson #3 Every member of the team must be willing to learn from mistakes Axance UX Master Class Sept. 20th, 2010 44
  • 45. Read our latest book! Win 5 copies of our book today! (Leave your business card in the basket, we will draw winners later today!) Axance UX Master Class Sept. 20th, 2010 45
  • 46. Questions? Visit our site: www.uxalliance.com Fr辿d辿ric Gaillard gaillard@axance.fr Axance UX Master Class Sept. 20th, 2010