際際滷

際際滷Share a Scribd company logo
SOCIAL GAMING AND
 MARKET RESEARCH
     Survey Analytics
    Enterprise Research Platform


            Zynga
Connecting The World Through Games


                              CONNECTING THE WORLD
                              THROUGH GAMES
Survey Analytics

Listening Systems
We help companies Listen...
Survey Analytics - Our Story
Bootstrapped
Pro鍖table (Not as much as SurveyMonkey)
Software Developers
Stumbled into the Research Business
Young (Except for Andrew Jeavons)
Zynga - Our Story




               CONNECTING THE WORLD
               THROUGH GAMES
Facebook
Developers
www.appdata.com




                  CONNECTING THE WORLD
                  THROUGH GAMES
If Facebook & Zynga were
        countries




                     CONNECTING THE WORLD
                     THROUGH GAMES
If Facebook & Zynga were
        countries




                     CONNECTING THE WORLD
                     THROUGH GAMES
Why should you listen to us?
Kevin works for Zynga?

40 question surveys as a
research tool suck?

Can gaming be used for
research?

Ratings Scale Vs. Choice!
The 35 Minute Survey
It does not WORK

Time is MONEY

140 Characters have
changed the way we
interact

10-7-140              (TPS Reports Dont Work Either)
Client-Vendor Collaboration
Why Zynga is excited about SA

Easy to use
Available anywhere
Randomization, branching,
piping
Real-time reporting
Max Diff Scaling
Facebook Integration
                       Note: Zynga uses a variety of research tools




                                             CONNECTING THE WORLD
                                             THROUGH GAMES
Voice of the Player




                 CONNECTING THE WORLD
                 THROUGH GAMES
Zynga Product Research
Usability
Surveys
Playtesting
Anonymous behavioral
aggregation
A/B Experimentation
Focus Groups




                       CONNECTING THE WORLD
                       THROUGH GAMES
My Research Philosophy
Online, Mobile or App

Reduce interruption

Use comparison

Label all options


                        CONNECTING THE WORLD
                        THROUGH GAMES
Max-Diff Scaling
Max-Diff Scaling

  Population Level Vs.
Individual Level analysis
Max-Diff Scaling
There are K features to be
tested in total

Each user gets to see N
features at a time




                             CONNECTING THE WORLD
                             THROUGH GAMES
Zynga Research - Learnings

Prioritize ideas &
鍖xes

Large Sample

Low User Investment


                      CONNECTING THE WORLD
                      THROUGH GAMES
Go where the users are




                  CONNECTING THE WORLD
                  THROUGH GAMES
Research has to be Easy
            Yet Powerful
Keys
  Rapid - Create
  surveys quickly

  Smart - Branching,
  Randomization etc.

  TimeSlicing
Gaming as a Service

Goals

Rules and obstacles

Feedback systems

Voluntary participation
Game-i鍖cation of Research

Whats the most usable
design for the checkout
process at a retail website?
1-click ordering

Whats the most usable
design for Tetris?
1-click solution?              (Challenge Is Key)


                                         CONNECTING THE WORLD
                                         THROUGH GAMES
Market Research ++

Measuring complicated emotions

Matching to business needs

Its not always about the fastest




                                 CONNECTING THE WORLD
                                 THROUGH GAMES
CONNECTING THE WORLD
THROUGH GAMES
Market Research --

Focus groups
Demographics & personality
Difficult judgments




                             CONNECTING THE WORLD
                             THROUGH GAMES
http:/www.zynga.com/
        jobs/
Marketing
Advertising Revenue Associate
Brand Manager
Director Consumer Communications
Director, Marketing Infrastructure &
Analysis
Director, Online Marketing
Email Marketing Manager
Public Relations Coordinator
Reporting Analyst


                                 CONNECTING THE WORLD
                                 THROUGH GAMES
Instant Feedback

Engage users by providing
instant visual feedback

Points, Scores, Badges

They WORK!
Share some data
with users
Great Experiences are
              Social
Use social metrics: NPS

Measure in environment




                          CONNECTING THE WORLD
                          THROUGH GAMES
Vivek & Kevins




Voting Beats Rating
      (rant...)
                    CONNECTING THE WORLD
                    THROUGH GAMES
Net鍖ix : 1MM Problem


Crowdsource the Prediction Algorithm

5Pt Rating Scale -- 4.6 Vs. 4.2

Discrete choice would have been better?




                                          CONNECTING THE WORLD
                                          THROUGH GAMES
IdeaScale, Digg & Marijuana
Reduce Cognitive Stress
KISS Principle:
  Keep it Simple
  Choice Over Rating



  TURF, Conjoint, Max
  Diff, CHAID
Conclusion

Hofmeyr (2007):

In sum: we are heuristic decision makers. We may sometimes
feel that were agonising over a decision. But mostly we decide
fast and effectively; with minimal use of energy and little
reference to multiple attributes....




    Researchers needs to think about
    Engagement
Questions / Comments



vivek.bhaskaran@surveyanalytics.com

        kkeeker@zynga.com

More Related Content

What's hot (20)

Module2
Module2Module2
Module2
mhnshree
亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)
亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)
亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)
DevGAMM Conference
Harness the Power of Games to Motivate Your Workforce - NRF 2012
Harness the Power of Games to Motivate Your Workforce - NRF 2012Harness the Power of Games to Motivate Your Workforce - NRF 2012
Harness the Power of Games to Motivate Your Workforce - NRF 2012
Stuart Silverman
Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...
Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...
Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...
ServDes
Facilitating Service Interactions with Design Games - Hatami, Mattelm辰ki
Facilitating Service Interactions with Design Games - Hatami, Mattelm辰kiFacilitating Service Interactions with Design Games - Hatami, Mattelm辰ki
Facilitating Service Interactions with Design Games - Hatami, Mattelm辰ki
ServDes
Persuasive Game Design
Persuasive Game DesignPersuasive Game Design
Persuasive Game Design
Margarita Quihuis
Gamification (Rahnema college UX course)
Gamification (Rahnema college UX course)Gamification (Rahnema college UX course)
Gamification (Rahnema college UX course)
Alireza Ranjbar SHourabi
Sharing emotions in collaborative virtual environments
Sharing emotions in collaborative virtual environmentsSharing emotions in collaborative virtual environments
Sharing emotions in collaborative virtual environments
Dr. Arindam Dey
Tenshi gamification for gamers march 2012
Tenshi gamification for gamers march 2012Tenshi gamification for gamers march 2012
Tenshi gamification for gamers march 2012
jonathannewth
A Human-Focused Design For Humans in a Utopian city
A Human-Focused Design For Humans in a Utopian cityA Human-Focused Design For Humans in a Utopian city
A Human-Focused Design For Humans in a Utopian city
Alireza Ranjbar SHourabi
5 Things we Can Learn from Games About UX
5 Things we Can Learn from Games About UX5 Things we Can Learn from Games About UX
5 Things we Can Learn from Games About UX
Dori Adar
GAMIFIN 2019 Conference Keynote: How to fail at #gamification research
GAMIFIN 2019 Conference Keynote: How to fail at #gamification researchGAMIFIN 2019 Conference Keynote: How to fail at #gamification research
GAMIFIN 2019 Conference Keynote: How to fail at #gamification research
Lennart Nacke
Rules of Engagement: How Gamification is Changing the World
Rules of Engagement: How Gamification is Changing the World Rules of Engagement: How Gamification is Changing the World
Rules of Engagement: How Gamification is Changing the World
Margaret Wallace
Games and Crowds: Now, Near, Next
Games and Crowds: Now, Near, NextGames and Crowds: Now, Near, Next
Games and Crowds: Now, Near, Next
Ben Sawyer
2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...
2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...
2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...
eMadrid network
The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...
The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...
The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...
Lennart Nacke
Evaluation of heuristics for designing believability in games gameon2013
Evaluation of heuristics for designing believability in games gameon2013Evaluation of heuristics for designing believability in games gameon2013
Evaluation of heuristics for designing believability in games gameon2013
Magnus Johansson
Presentationforwebdesign 170214213118
Presentationforwebdesign 170214213118Presentationforwebdesign 170214213118
Presentationforwebdesign 170214213118
kaikikazuki
11 Awesome Quotes About Game Design
11 Awesome Quotes About Game Design11 Awesome Quotes About Game Design
11 Awesome Quotes About Game Design
Idea to Appster
9,5 Theses on the Power and Efficacy of Gamification
9,5 Theses on the Power and Efficacy of Gamification9,5 Theses on the Power and Efficacy of Gamification
9,5 Theses on the Power and Efficacy of Gamification
Sebastian Deterding
Module2
Module2Module2
Module2
mhnshree
亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)
亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)
亠舒亳于 - 从仂仂仍! 仂亠仄 仄亳仍亳亟 舒从 仗仂仗仍仆? / 弌亠亞亠亶 磡仂于 (AdSide Media)
DevGAMM Conference
Harness the Power of Games to Motivate Your Workforce - NRF 2012
Harness the Power of Games to Motivate Your Workforce - NRF 2012Harness the Power of Games to Motivate Your Workforce - NRF 2012
Harness the Power of Games to Motivate Your Workforce - NRF 2012
Stuart Silverman
Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...
Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...
Efficiently Inefficient: Service Design Games As Innovation Tools - Hannula, ...
ServDes
Facilitating Service Interactions with Design Games - Hatami, Mattelm辰ki
Facilitating Service Interactions with Design Games - Hatami, Mattelm辰kiFacilitating Service Interactions with Design Games - Hatami, Mattelm辰ki
Facilitating Service Interactions with Design Games - Hatami, Mattelm辰ki
ServDes
Gamification (Rahnema college UX course)
Gamification (Rahnema college UX course)Gamification (Rahnema college UX course)
Gamification (Rahnema college UX course)
Alireza Ranjbar SHourabi
Sharing emotions in collaborative virtual environments
Sharing emotions in collaborative virtual environmentsSharing emotions in collaborative virtual environments
Sharing emotions in collaborative virtual environments
Dr. Arindam Dey
Tenshi gamification for gamers march 2012
Tenshi gamification for gamers march 2012Tenshi gamification for gamers march 2012
Tenshi gamification for gamers march 2012
jonathannewth
A Human-Focused Design For Humans in a Utopian city
A Human-Focused Design For Humans in a Utopian cityA Human-Focused Design For Humans in a Utopian city
A Human-Focused Design For Humans in a Utopian city
Alireza Ranjbar SHourabi
5 Things we Can Learn from Games About UX
5 Things we Can Learn from Games About UX5 Things we Can Learn from Games About UX
5 Things we Can Learn from Games About UX
Dori Adar
GAMIFIN 2019 Conference Keynote: How to fail at #gamification research
GAMIFIN 2019 Conference Keynote: How to fail at #gamification researchGAMIFIN 2019 Conference Keynote: How to fail at #gamification research
GAMIFIN 2019 Conference Keynote: How to fail at #gamification research
Lennart Nacke
Rules of Engagement: How Gamification is Changing the World
Rules of Engagement: How Gamification is Changing the World Rules of Engagement: How Gamification is Changing the World
Rules of Engagement: How Gamification is Changing the World
Margaret Wallace
Games and Crowds: Now, Near, Next
Games and Crowds: Now, Near, NextGames and Crowds: Now, Near, Next
Games and Crowds: Now, Near, Next
Ben Sawyer
2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...
2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...
2012 12 14 (ucm) emadrid aserrano ucm learning analytics vision practica apli...
eMadrid network
The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...
The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...
The 5 Gamification Languages: The secret to gameful experiences that last油(Ga...
Lennart Nacke
Evaluation of heuristics for designing believability in games gameon2013
Evaluation of heuristics for designing believability in games gameon2013Evaluation of heuristics for designing believability in games gameon2013
Evaluation of heuristics for designing believability in games gameon2013
Magnus Johansson
Presentationforwebdesign 170214213118
Presentationforwebdesign 170214213118Presentationforwebdesign 170214213118
Presentationforwebdesign 170214213118
kaikikazuki
11 Awesome Quotes About Game Design
11 Awesome Quotes About Game Design11 Awesome Quotes About Game Design
11 Awesome Quotes About Game Design
Idea to Appster
9,5 Theses on the Power and Efficacy of Gamification
9,5 Theses on the Power and Efficacy of Gamification9,5 Theses on the Power and Efficacy of Gamification
9,5 Theses on the Power and Efficacy of Gamification
Sebastian Deterding

Similar to Sa zynga-vivek-kevin-f inal (20)

Research GamesMobile Brasil 2013
Research GamesMobile Brasil 2013Research GamesMobile Brasil 2013
Research GamesMobile Brasil 2013
Moacyr Alves EPP
Empower Connect11 Trend Flash
Empower Connect11 Trend FlashEmpower Connect11 Trend Flash
Empower Connect11 Trend Flash
Empower MediaMarketing
Game Analytics SiTF (David vs Goliath)
Game Analytics SiTF (David vs Goliath)Game Analytics SiTF (David vs Goliath)
Game Analytics SiTF (David vs Goliath)
Elvin Li
Gamification LinkedIn compressed
Gamification LinkedIn compressedGamification LinkedIn compressed
Gamification LinkedIn compressed
Micha谷l Kuijs
Introduction to Gamification
Introduction to GamificationIntroduction to Gamification
Introduction to Gamification
弌仆亠亢舒仆舒 亠亢仆舒
Games for Change Methodology
Games for Change MethodologyGames for Change Methodology
Games for Change Methodology
Games for Change
How to Run Conjoint Analysis
How to Run Conjoint AnalysisHow to Run Conjoint Analysis
How to Run Conjoint Analysis
QuestionPro
How to run conjoint analysis
How to run conjoint analysisHow to run conjoint analysis
How to run conjoint analysis
QuestionPro
More Than Points: Architecting Engagement Through Game Design Thinking
More Than Points: Architecting Engagement Through Game Design ThinkingMore Than Points: Architecting Engagement Through Game Design Thinking
More Than Points: Architecting Engagement Through Game Design Thinking
Dustin DiTommaso
An introduction to funormaling business
An introduction to funormaling businessAn introduction to funormaling business
An introduction to funormaling business
Alireza Ranjbar SHourabi
Gamification: Integrating gaming into your brand strategy
Gamification: Integrating gaming into your brand strategy Gamification: Integrating gaming into your brand strategy
Gamification: Integrating gaming into your brand strategy
TP1
[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx
[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx
[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx
DataScienceConferenc1
Special Topics in Mobile
Special Topics in MobileSpecial Topics in Mobile
Special Topics in Mobile
Mindgrub Technologies
Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?
Raptivity
Fallon Brainfood: SX35W
Fallon Brainfood: SX35WFallon Brainfood: SX35W
Fallon Brainfood: SX35W
Aki Spicer
Gamification: How to Level Up Consumer Engagement
Gamification: How to Level Up Consumer EngagementGamification: How to Level Up Consumer Engagement
Gamification: How to Level Up Consumer Engagement
Shaun Quigley
Scoreloop - social discovery of mobile games
Scoreloop - social discovery of mobile gamesScoreloop - social discovery of mobile games
Scoreloop - social discovery of mobile games
Sonja ngeslev辰
How to Design a Gamified Survey
How to Design a Gamified SurveyHow to Design a Gamified Survey
How to Design a Gamified Survey
QuestionPro
Luke Hohmann's Software Guru 2009 Keynote: Innovation In Software
Luke Hohmann's Software Guru 2009 Keynote: Innovation In SoftwareLuke Hohmann's Software Guru 2009 Keynote: Innovation In Software
Luke Hohmann's Software Guru 2009 Keynote: Innovation In Software
Enthiosys Inc
CoffeeClub_Ninja Metrics 2014
CoffeeClub_Ninja Metrics 2014CoffeeClub_Ninja Metrics 2014
CoffeeClub_Ninja Metrics 2014
StartupAlliance
Research GamesMobile Brasil 2013
Research GamesMobile Brasil 2013Research GamesMobile Brasil 2013
Research GamesMobile Brasil 2013
Moacyr Alves EPP
Game Analytics SiTF (David vs Goliath)
Game Analytics SiTF (David vs Goliath)Game Analytics SiTF (David vs Goliath)
Game Analytics SiTF (David vs Goliath)
Elvin Li
Gamification LinkedIn compressed
Gamification LinkedIn compressedGamification LinkedIn compressed
Gamification LinkedIn compressed
Micha谷l Kuijs
Games for Change Methodology
Games for Change MethodologyGames for Change Methodology
Games for Change Methodology
Games for Change
How to Run Conjoint Analysis
How to Run Conjoint AnalysisHow to Run Conjoint Analysis
How to Run Conjoint Analysis
QuestionPro
How to run conjoint analysis
How to run conjoint analysisHow to run conjoint analysis
How to run conjoint analysis
QuestionPro
More Than Points: Architecting Engagement Through Game Design Thinking
More Than Points: Architecting Engagement Through Game Design ThinkingMore Than Points: Architecting Engagement Through Game Design Thinking
More Than Points: Architecting Engagement Through Game Design Thinking
Dustin DiTommaso
An introduction to funormaling business
An introduction to funormaling businessAn introduction to funormaling business
An introduction to funormaling business
Alireza Ranjbar SHourabi
Gamification: Integrating gaming into your brand strategy
Gamification: Integrating gaming into your brand strategy Gamification: Integrating gaming into your brand strategy
Gamification: Integrating gaming into your brand strategy
TP1
[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx
[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx
[DSC Europe 23][Pandora] Siyu SUN Data Science Enter The Game.pptx
DataScienceConferenc1
Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?Webinar - Elearning: Where do serious games make most sense?
Webinar - Elearning: Where do serious games make most sense?
Raptivity
Fallon Brainfood: SX35W
Fallon Brainfood: SX35WFallon Brainfood: SX35W
Fallon Brainfood: SX35W
Aki Spicer
Gamification: How to Level Up Consumer Engagement
Gamification: How to Level Up Consumer EngagementGamification: How to Level Up Consumer Engagement
Gamification: How to Level Up Consumer Engagement
Shaun Quigley
Scoreloop - social discovery of mobile games
Scoreloop - social discovery of mobile gamesScoreloop - social discovery of mobile games
Scoreloop - social discovery of mobile games
Sonja ngeslev辰
How to Design a Gamified Survey
How to Design a Gamified SurveyHow to Design a Gamified Survey
How to Design a Gamified Survey
QuestionPro
Luke Hohmann's Software Guru 2009 Keynote: Innovation In Software
Luke Hohmann's Software Guru 2009 Keynote: Innovation In SoftwareLuke Hohmann's Software Guru 2009 Keynote: Innovation In Software
Luke Hohmann's Software Guru 2009 Keynote: Innovation In Software
Enthiosys Inc
CoffeeClub_Ninja Metrics 2014
CoffeeClub_Ninja Metrics 2014CoffeeClub_Ninja Metrics 2014
CoffeeClub_Ninja Metrics 2014
StartupAlliance

Sa zynga-vivek-kevin-f inal

Editor's Notes

  • #2: Vvek & Kevin\n
  • #3: Vivek\n
  • #4: Vivek\n
  • #5: Vivek\n
  • #6: Kevin\n
  • #7: Kevin\n
  • #8: Kevin\n
  • #9: Kevin\n
  • #10: Vivek\n
  • #11: Vivek\n
  • #12: Vivek\n
  • #13: Kevin\n
  • #14: Users generally don’t make accurate judgments about shades of gray\nIt’s not meaningful to ask how much you like peanut butter, all you care about is if they love peanut butter\n
  • #15: \n
  • #16: \n
  • #17: Vivek\n
  • #18: Vivek\n
  • #19: Kevin\n
  • #20: For example, surveys show that long loading times are a big issue for many players\n
  • #21: Vivek - \n
  • #22: Vivek - \n
  • #23: Vivek\n
  • #24: Kevin\n
  • #25: Market researchers test messaging\nThe best outcome may be counterintuitive\n
  • #26: \n
  • #27: \n
  • #28: \n
  • #29: \n
  • #30: \n
  • #31: Kevin\n
  • #32: \n
  • #33: \n
  • #34: Vivek Digg - Using a simple up and down vote to determine relevance and gather insight.\n
  • #35: Kevin\n
  • #36: Kevin\n
  • #37: \n