狠狠撸

狠狠撸Share a Scribd company logo
Recommender systems
Optimizing least squares or user experience?
Kasper Van Lombeek
15 December 2018
Problem 1
Accuracy does not always give trust
1. What do these names have in common?
Wout Seppe Gust
Senne Ward Nand
Tuur Ferre Siebe
UK
Flanders
France
Miel
Bas
Matz
Gust
Finley
Bailey
Toby
Gabin
Corentin
Titouan
1. What do these names have in common?
Wout Seppe Gust
Senne Ward Nand
Tuur Ferre Siebe
So if a user clicked on:
We can recommend:
Korneel Staf Kamiel
1. What do these names have in common?
Caroline Céline Stéphanie
Virginie Sandrine Myriam
Sonia Christelle Claire
2. What do these names have in common?
2. What do these names have in common?
Caroline Céline Stéphanie
Virginie Sandrine Myriam
Sonia Christelle Claire
So if a user clicked on:
We can recommend:
Valérie Aline Karine
2. What do these names have in common?
3. What do these names have in common?
Oscar Sem Gust
Ilyas Milo Kamiel
Owen Miel Remi
3. What do these names have in common?
So if a user clicked on:
We can recommend:
Muhammed Luka Ibrahim
3. What do these names have in common?
Oscar Sem Gust
Ilyas Milo Kamiel
Owen Miel Remi
Recommender systems: optimizing least squares or user experience?
Mathematically nothing
MSE is still minimized
What went wrong?
Recommendations need to be
Relevant
Diverse
Serendipity
Robust
i.e. make the user feel like you understood him
Solution
Early stage: Business rule
If not clicked on a arabic name, do not predict one
Later: Ensemble model
Combine time series features with latent features
Intermezzo
Recommender system?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Problem 2
How do we get to know the user his taste?
Constraint: Hicks law
Learn fast
1. On what name will the user click?
Wout (Flemish)
Seppe (Flemish)
Gust (Flemish)
Ward (Flemish)
1. On what name will the user click?
How long does it took the user? - > Very long
What did you learn? - > Nothing
2. On what name will the user click?
Kiandro (not popular)
Malik (not popular)
Twan (not popular)
Leon (very popular)
2. On what name will the user click?
How long does it took the user? - > Not Long
What did you learn? - > Nothing
Ideally
4 very different names
1 name that a user likes more than the 3 others
Solution
Demo
http://www.inspectlet.com/dashboard/watchsession/263738354/1083900341?pn=1&acc
essResourceKey=396baebda5b07a992ec408246f36a4cea0a74dff
Problem 3
Who are we serving?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Recommender systems: optimizing least squares or user experience?
Feedback loop?
1. Start with the ambition to build a general bookshop
2. Your recommender system recommends mostly cook books
3. People who love cookbooks love your recommender system, they
invite other friends
4. Your measurement of satisfaction of your recommender system
starts to be biased because your users are mostly cook book
lovers
5. You end up with a cook book shop
But why?
The world is burning and I build a baby
name recommender...
There is nothing important or of great scientific
merit in this problem, they will sneer. These great
minds should have been putting their immense
brain power to something that would benefit
mankind.
Unfortunately, whatever non-scientists may think
about science and its importance, my experience
has been that most (?data-)scientists do their
research because they are interested in the
results and get intellectual excitement out of the
work. Seldom do good scientists think about the
eventual importance of their work.
Thank you
Kasper Van Lombeek
kvanlombeek

More Related Content

Similar to Recommender systems: optimizing least squares or user experience? (20)

Transform your technical workshop with these teaching tips
Transform your technical workshop with these teaching tipsTransform your technical workshop with these teaching tips
Transform your technical workshop with these teaching tips
Jamie Wittenberg
?
How To Design A Survey That Respondents Want To Answer
How To Design A Survey That Respondents Want To AnswerHow To Design A Survey That Respondents Want To Answer
How To Design A Survey That Respondents Want To Answer
Peanut Labs
?
Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS
Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS
Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS
Ed Batista
?
Core questions
Core questionsCore questions
Core questions
Not Just a Thought Project
?
Step by Step New Associate Training
Step by Step New Associate TrainingStep by Step New Associate Training
Step by Step New Associate Training
Carol Merlo, M.Ed.
?
Wood Badge - Communication
Wood Badge - CommunicationWood Badge - Communication
Wood Badge - Communication
John Green
?
Rebels at Work Edge Talk full transcript - 2 October 2015
Rebels at Work Edge Talk full transcript - 2 October 2015Rebels at Work Edge Talk full transcript - 2 October 2015
Rebels at Work Edge Talk full transcript - 2 October 2015
NHS Improving Quality
?
How to change the world handout session 2 and 3
How to change the world handout session 2 and 3How to change the world handout session 2 and 3
How to change the world handout session 2 and 3
Power2Improve
?
User Experience: Surprise And Delight Me
User Experience:   Surprise And Delight MeUser Experience:   Surprise And Delight Me
User Experience: Surprise And Delight Me
Kristin Lené Colier
?
Coaching
CoachingCoaching
Coaching
Frank Calberg
?
Power writing 3
Power writing 3Power writing 3
Power writing 3
nathalieouellet7
?
The Power of a Leader's Great Question
The Power of a Leader's Great QuestionThe Power of a Leader's Great Question
The Power of a Leader's Great Question
Paul D. Casey
?
HelloWallet Forum: Benefits & Behavior Change Part I, Steve Wendel
HelloWallet Forum: Benefits & Behavior Change Part I, Steve WendelHelloWallet Forum: Benefits & Behavior Change Part I, Steve Wendel
HelloWallet Forum: Benefits & Behavior Change Part I, Steve Wendel
HelloWallet Events
?
Liberating Structures for NICE slides.pptx
Liberating Structures for NICE slides.pptxLiberating Structures for NICE slides.pptx
Liberating Structures for NICE slides.pptx
NHS Horizons
?
25 Habits for a Disruptive World
25 Habits for a Disruptive World25 Habits for a Disruptive World
25 Habits for a Disruptive World
Bill Jensen
?
MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...
MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...
MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...
John Pisciotta
?
Wider Circle Covid 19 Training Support
Wider Circle Covid 19 Training Support Wider Circle Covid 19 Training Support
Wider Circle Covid 19 Training Support
Brett Loney
?
IS20G11 - The Reverse Appointment - Jonathan Dawson
IS20G11 - The Reverse Appointment - Jonathan DawsonIS20G11 - The Reverse Appointment - Jonathan Dawson
IS20G11 - The Reverse Appointment - Jonathan Dawson
Sean Bradley
?
Mastering the Art of Facilitation
Mastering the Art of FacilitationMastering the Art of Facilitation
Mastering the Art of Facilitation
Ilan Kirschenbaum
?
Growing Our Passion as Leaders
Growing Our Passion as LeadersGrowing Our Passion as Leaders
Growing Our Passion as Leaders
toocurly
?
Transform your technical workshop with these teaching tips
Transform your technical workshop with these teaching tipsTransform your technical workshop with these teaching tips
Transform your technical workshop with these teaching tips
Jamie Wittenberg
?
How To Design A Survey That Respondents Want To Answer
How To Design A Survey That Respondents Want To AnswerHow To Design A Survey That Respondents Want To Answer
How To Design A Survey That Respondents Want To Answer
Peanut Labs
?
Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS
Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS
Ed Batista, The Art of Self-Coaching (Public Course), Class 1: BEGINNINGS
Ed Batista
?
Step by Step New Associate Training
Step by Step New Associate TrainingStep by Step New Associate Training
Step by Step New Associate Training
Carol Merlo, M.Ed.
?
Wood Badge - Communication
Wood Badge - CommunicationWood Badge - Communication
Wood Badge - Communication
John Green
?
Rebels at Work Edge Talk full transcript - 2 October 2015
Rebels at Work Edge Talk full transcript - 2 October 2015Rebels at Work Edge Talk full transcript - 2 October 2015
Rebels at Work Edge Talk full transcript - 2 October 2015
NHS Improving Quality
?
How to change the world handout session 2 and 3
How to change the world handout session 2 and 3How to change the world handout session 2 and 3
How to change the world handout session 2 and 3
Power2Improve
?
User Experience: Surprise And Delight Me
User Experience:   Surprise And Delight MeUser Experience:   Surprise And Delight Me
User Experience: Surprise And Delight Me
Kristin Lené Colier
?
The Power of a Leader's Great Question
The Power of a Leader's Great QuestionThe Power of a Leader's Great Question
The Power of a Leader's Great Question
Paul D. Casey
?
HelloWallet Forum: Benefits & Behavior Change Part I, Steve Wendel
HelloWallet Forum: Benefits & Behavior Change Part I, Steve WendelHelloWallet Forum: Benefits & Behavior Change Part I, Steve Wendel
HelloWallet Forum: Benefits & Behavior Change Part I, Steve Wendel
HelloWallet Events
?
Liberating Structures for NICE slides.pptx
Liberating Structures for NICE slides.pptxLiberating Structures for NICE slides.pptx
Liberating Structures for NICE slides.pptx
NHS Horizons
?
25 Habits for a Disruptive World
25 Habits for a Disruptive World25 Habits for a Disruptive World
25 Habits for a Disruptive World
Bill Jensen
?
MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...
MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...
MOD 12: THE ANTIFRAGILE ARTIST: HOW TO BUILD A CAREER WITHOUT GETTING LUCKY H...
John Pisciotta
?
Wider Circle Covid 19 Training Support
Wider Circle Covid 19 Training Support Wider Circle Covid 19 Training Support
Wider Circle Covid 19 Training Support
Brett Loney
?
IS20G11 - The Reverse Appointment - Jonathan Dawson
IS20G11 - The Reverse Appointment - Jonathan DawsonIS20G11 - The Reverse Appointment - Jonathan Dawson
IS20G11 - The Reverse Appointment - Jonathan Dawson
Sean Bradley
?
Mastering the Art of Facilitation
Mastering the Art of FacilitationMastering the Art of Facilitation
Mastering the Art of Facilitation
Ilan Kirschenbaum
?
Growing Our Passion as Leaders
Growing Our Passion as LeadersGrowing Our Passion as Leaders
Growing Our Passion as Leaders
toocurly
?

Recently uploaded (20)

exampleexampleexampleexampleexampleexampleexampleexample
exampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexample
exampleexampleexampleexampleexampleexampleexampleexample
lembiczkat
?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
Christine Hemphill
?
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICESHIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
anastasiapenova16
?
2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM
2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM
2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM
Timothy Spann
?
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdfstages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
esguerramark1991
?
Cost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheetCost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheet
supreetk82004
?
Stasiun kernel pabrik kelapa sawit indonesia
Stasiun kernel pabrik kelapa sawit indonesiaStasiun kernel pabrik kelapa sawit indonesia
Stasiun kernel pabrik kelapa sawit indonesia
fikrimanurung1
?
Optimizing Common Table Expressions in Apache Hive with Calcite
Optimizing Common Table Expressions in Apache Hive with CalciteOptimizing Common Table Expressions in Apache Hive with Calcite
Optimizing Common Table Expressions in Apache Hive with Calcite
Stamatis Zampetakis
?
100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf
jacobdivina9
?
Valkey 101 - SCaLE 22x March 2025 Stokes.pdf
Valkey 101 - SCaLE 22x March 2025 Stokes.pdfValkey 101 - SCaLE 22x March 2025 Stokes.pdf
Valkey 101 - SCaLE 22x March 2025 Stokes.pdf
Dave Stokes
?
Introduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdfIntroduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdf
messagetome133
?
Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...
Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...
Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...
suchanadatta3
?
Stasiun kernel pengolahan kelapa sawit indonesia
Stasiun kernel pengolahan kelapa sawit indonesiaStasiun kernel pengolahan kelapa sawit indonesia
Stasiun kernel pengolahan kelapa sawit indonesia
fikrimanurung1
?
"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT
miao22
?
A Relative Information Gain-based Query Performance Prediction Framework with...
A Relative Information Gain-based Query Performance Prediction Framework with...A Relative Information Gain-based Query Performance Prediction Framework with...
A Relative Information Gain-based Query Performance Prediction Framework with...
suchanadatta3
?
IFRS Finance Powerpoint ppt Finance D.pptx
IFRS Finance Powerpoint  ppt Finance D.pptxIFRS Finance Powerpoint  ppt Finance D.pptx
IFRS Finance Powerpoint ppt Finance D.pptx
amantiwari2091
?
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
taqyed
?
The Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo Guru
The Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo GuruThe Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo Guru
The Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo Guru
kenyoncenteno12
?
Introduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptxIntroduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptx
nabinparajuli9
?
The Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability AnalyticsThe Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability Analytics
christophercamposus1
?
exampleexampleexampleexampleexampleexampleexampleexample
exampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexampleexample
exampleexampleexampleexampleexampleexampleexampleexample
lembiczkat
?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
Christine Hemphill
?
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICESHIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
anastasiapenova16
?
2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM
2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM
2025-03-03-Philly-AAAI-GoodData-Build Secure RAG Apps With Open LLM
Timothy Spann
?
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdfstages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
esguerramark1991
?
Cost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheetCost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheet
supreetk82004
?
Stasiun kernel pabrik kelapa sawit indonesia
Stasiun kernel pabrik kelapa sawit indonesiaStasiun kernel pabrik kelapa sawit indonesia
Stasiun kernel pabrik kelapa sawit indonesia
fikrimanurung1
?
Optimizing Common Table Expressions in Apache Hive with Calcite
Optimizing Common Table Expressions in Apache Hive with CalciteOptimizing Common Table Expressions in Apache Hive with Calcite
Optimizing Common Table Expressions in Apache Hive with Calcite
Stamatis Zampetakis
?
100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf
jacobdivina9
?
Valkey 101 - SCaLE 22x March 2025 Stokes.pdf
Valkey 101 - SCaLE 22x March 2025 Stokes.pdfValkey 101 - SCaLE 22x March 2025 Stokes.pdf
Valkey 101 - SCaLE 22x March 2025 Stokes.pdf
Dave Stokes
?
Introduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdfIntroduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdf
messagetome133
?
Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...
Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...
Deep-QPP: A Pairwise Interaction-based Deep Learning Model for Supervised Que...
suchanadatta3
?
Stasiun kernel pengolahan kelapa sawit indonesia
Stasiun kernel pengolahan kelapa sawit indonesiaStasiun kernel pengolahan kelapa sawit indonesia
Stasiun kernel pengolahan kelapa sawit indonesia
fikrimanurung1
?
"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT
miao22
?
A Relative Information Gain-based Query Performance Prediction Framework with...
A Relative Information Gain-based Query Performance Prediction Framework with...A Relative Information Gain-based Query Performance Prediction Framework with...
A Relative Information Gain-based Query Performance Prediction Framework with...
suchanadatta3
?
IFRS Finance Powerpoint ppt Finance D.pptx
IFRS Finance Powerpoint  ppt Finance D.pptxIFRS Finance Powerpoint  ppt Finance D.pptx
IFRS Finance Powerpoint ppt Finance D.pptx
amantiwari2091
?
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
taqyed
?
The Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo Guru
The Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo GuruThe Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo Guru
The Marketability of Rice Straw Yarn Among Selected Customers of Gantsilyo Guru
kenyoncenteno12
?
Introduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptxIntroduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptx
nabinparajuli9
?
The Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability AnalyticsThe Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability Analytics
christophercamposus1
?

Recommender systems: optimizing least squares or user experience?