狠狠撸

狠狠撸Share a Scribd company logo
Deep Learning,
beyond the hype!
3 mars 2017, La Paillasse
Sébastien TREGUER
Machine Learning vs Deep learning
vs A.I.
What are the different species in the
zoo?
Hype or reality?
Performances
2012: from 26% to 16% error rate in image
classification with convolutional neural nets Similar disruption observed in speech
What’s the secret sauce of Deep
Neural Nets ?
● RMSProp
● ADAM
● SGD
● Sigmoid
● Tanh
● ReLU
● Leaky ReLU
● CNN
● RNN
● LSTM
● GAN
● WaveNet
● PathNet
The more,
the cleaner
and well
distributed
the better
How does it works?
From details captured in the first layers to higher level of abstraction in deeper layers
Depth and Performances
What about creativity?
Representation
Learning
Reinforcement Learning,
Alphago learning by
playing against itself
Music improvisation
Logic operations on images
Input = “A small yellow bird with a black crown and a short black pointed beak”
Which images are real, which images are generated by the algorithm?
From classification to generation
A small yellow bird with a back crown and a short black pointed beak
From classification to generation
Answer: None of these images ever existed. They are all generated by the algorithm.
StackGAN, Han Zhang & al, paper here
GAN
Generative Adversarial Networks
Ian J. Goodfellow & al, 2014
StackGAN
Text to Photo-realistic Image Synthesis
Han Zhang & al, 2016
From classification to generation
Adversarial examples
“Panda”
57.7% Confidence
“Nematode”
8.2% Confidence
“Gibbon”
99.9% Confidence
Any Limits?
Unsurpervised learning
Reinforcement Learning
→ predict a scalar reward
→ A few bits per samples
Supervised Learning = on-sight navigation
→ Predicting human supplied data
→ 10 to 10000 bits per samples
All the rest is unsupervised Learning = offshore navigation
→ Predicting unknown parts from observation
→ Building its own representation
→ Millions of bits per samples
Ex: predicting frames in videos, generating images, music...
Any Limits?
Energy
efficiency?
VS
Brain = 20W
2.2 billion megaflops
Super Computers =
until 10 millions watts
The race for power

More Related Content

Viewers also liked (17)

How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your Niche
Leslie Samuel
?
DeepHack.Game Life Propagation team
DeepHack.Game Life Propagation teamDeepHack.Game Life Propagation team
DeepHack.Game Life Propagation team
DeepHackLab
?
DeepHack.Game Rock band team
DeepHack.Game Rock band teamDeepHack.Game Rock band team
DeepHack.Game Rock band team
DeepHackLab
?
Intro to Deep Reinforcement Learning
Intro to Deep Reinforcement LearningIntro to Deep Reinforcement Learning
Intro to Deep Reinforcement Learning
SPb_Data_Science
?
DeepHack.Game 5vision team
DeepHack.Game 5vision teamDeepHack.Game 5vision team
DeepHack.Game 5vision team
DeepHackLab
?
DeepHack.Game Skynet team
DeepHack.Game Skynet teamDeepHack.Game Skynet team
DeepHack.Game Skynet team
DeepHackLab
?
Aplicaciones de las integrales en eco nigsely romero Aplicaciones de las integrales en eco nigsely romero
Aplicaciones de las integrales en eco nigsely romero
Nigsely Romero
?
ADEX - agroexportacion 2015ADEX - agroexportacion 2015
ADEX - agroexportacion 2015
agroalimentaria.pe
?
Resume of euodia jacobs january 2017
Resume of euodia jacobs january 2017Resume of euodia jacobs january 2017
Resume of euodia jacobs january 2017
Euodia M Jacobs
?
Get back lost love spell
Get back lost love spellGet back lost love spell
Get back lost love spell
babajiAstrology
?
IJSETR8939-177
IJSETR8939-177IJSETR8939-177
IJSETR8939-177
sawan kumar
?
MINCETUR - guía alemaniaMINCETUR - guía alemania
MINCETUR - guía alemania
agroalimentaria.pe
?
Concepto de deportes extremos Concepto de deportes extremos
Concepto de deportes extremos
Juan Manuel Rojas Flores
?
狠狠撸share狠狠撸share
狠狠撸share
JHULISSA MARIA MU?OZ ONTANEDA
?
Los lápices de coloresLos lápices de colores
Los lápices de colores
Fab Betancourt
?
PO 101 Civil Liberties
PO 101 Civil Liberties PO 101 Civil Liberties
PO 101 Civil Liberties
atrantham
?
PO 101 Civil Rights
PO 101 Civil Rights PO 101 Civil Rights
PO 101 Civil Rights
atrantham
?
How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your Niche
Leslie Samuel
?
DeepHack.Game Life Propagation team
DeepHack.Game Life Propagation teamDeepHack.Game Life Propagation team
DeepHack.Game Life Propagation team
DeepHackLab
?
DeepHack.Game Rock band team
DeepHack.Game Rock band teamDeepHack.Game Rock band team
DeepHack.Game Rock band team
DeepHackLab
?
Intro to Deep Reinforcement Learning
Intro to Deep Reinforcement LearningIntro to Deep Reinforcement Learning
Intro to Deep Reinforcement Learning
SPb_Data_Science
?
DeepHack.Game 5vision team
DeepHack.Game 5vision teamDeepHack.Game 5vision team
DeepHack.Game 5vision team
DeepHackLab
?
DeepHack.Game Skynet team
DeepHack.Game Skynet teamDeepHack.Game Skynet team
DeepHack.Game Skynet team
DeepHackLab
?
Aplicaciones de las integrales en eco nigsely romero Aplicaciones de las integrales en eco nigsely romero
Aplicaciones de las integrales en eco nigsely romero
Nigsely Romero
?
ADEX - agroexportacion 2015ADEX - agroexportacion 2015
ADEX - agroexportacion 2015
agroalimentaria.pe
?
Resume of euodia jacobs january 2017
Resume of euodia jacobs january 2017Resume of euodia jacobs january 2017
Resume of euodia jacobs january 2017
Euodia M Jacobs
?
MINCETUR - guía alemaniaMINCETUR - guía alemania
MINCETUR - guía alemania
agroalimentaria.pe
?
Concepto de deportes extremos Concepto de deportes extremos
Concepto de deportes extremos
Juan Manuel Rojas Flores
?
Los lápices de coloresLos lápices de colores
Los lápices de colores
Fab Betancourt
?
PO 101 Civil Liberties
PO 101 Civil Liberties PO 101 Civil Liberties
PO 101 Civil Liberties
atrantham
?
PO 101 Civil Rights
PO 101 Civil Rights PO 101 Civil Rights
PO 101 Civil Rights
atrantham
?

Similar to Deep learning beyond_the_hype-franceia@lapaillasse (13)

Ape to API, Filip Dousek
Ape to API, Filip DousekApe to API, Filip Dousek
Ape to API, Filip Dousek
CzechDreamin
?
Smart Data Webinar: Advances in Natural Language Processing I - Understanding
Smart Data Webinar: Advances in Natural Language Processing I - UnderstandingSmart Data Webinar: Advances in Natural Language Processing I - Understanding
Smart Data Webinar: Advances in Natural Language Processing I - Understanding
DATAVERSITY
?
M4L19 Generative Models - 狠狠撸s v 3.pdf
M4L19 Generative Models - 狠狠撸s v 3.pdfM4L19 Generative Models - 狠狠撸s v 3.pdf
M4L19 Generative Models - 狠狠撸s v 3.pdf
yireme8491
?
AI - history and recent breakthroughs
AI - history and recent breakthroughs AI - history and recent breakthroughs
AI - history and recent breakthroughs
Armando Vieira
?
New Approaches at Natural Language Processing Systems
New Approaches at Natural Language Processing SystemsNew Approaches at Natural Language Processing Systems
New Approaches at Natural Language Processing Systems
Andrejkovics Zoltán
?
Generative AI and the Rise of Large Language Models
Generative AI and the Rise of Large Language ModelsGenerative AI and the Rise of Large Language Models
Generative AI and the Rise of Large Language Models
dsclaubyblos
?
Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...
Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...
Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...
Numenta
?
The Magic Behind AI
The Magic Behind AIThe Magic Behind AI
The Magic Behind AI
Othman Gacem
?
More Cat than Cute ? Interpretable Prediction of Adjective-Noun Pairs
More Cat than Cute ? Interpretable Prediction of Adjective-Noun PairsMore Cat than Cute ? Interpretable Prediction of Adjective-Noun Pairs
More Cat than Cute ? Interpretable Prediction of Adjective-Noun Pairs
Universitat Politècnica de Catalunya
?
DL Classe 0 - You can do it
DL Classe 0 - You can do itDL Classe 0 - You can do it
DL Classe 0 - You can do it
Gregory Renard
?
Deep Learning Class #0 - You Can Do It
Deep Learning Class #0 - You Can Do ItDeep Learning Class #0 - You Can Do It
Deep Learning Class #0 - You Can Do It
Holberton School
?
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
Niket Singh
?
GDC2019 - SEED - Towards Deep Generative Models in Game Development
GDC2019 - SEED - Towards Deep Generative Models in Game DevelopmentGDC2019 - SEED - Towards Deep Generative Models in Game Development
GDC2019 - SEED - Towards Deep Generative Models in Game Development
Electronic Arts / DICE
?
Ape to API, Filip Dousek
Ape to API, Filip DousekApe to API, Filip Dousek
Ape to API, Filip Dousek
CzechDreamin
?
Smart Data Webinar: Advances in Natural Language Processing I - Understanding
Smart Data Webinar: Advances in Natural Language Processing I - UnderstandingSmart Data Webinar: Advances in Natural Language Processing I - Understanding
Smart Data Webinar: Advances in Natural Language Processing I - Understanding
DATAVERSITY
?
M4L19 Generative Models - 狠狠撸s v 3.pdf
M4L19 Generative Models - 狠狠撸s v 3.pdfM4L19 Generative Models - 狠狠撸s v 3.pdf
M4L19 Generative Models - 狠狠撸s v 3.pdf
yireme8491
?
AI - history and recent breakthroughs
AI - history and recent breakthroughs AI - history and recent breakthroughs
AI - history and recent breakthroughs
Armando Vieira
?
New Approaches at Natural Language Processing Systems
New Approaches at Natural Language Processing SystemsNew Approaches at Natural Language Processing Systems
New Approaches at Natural Language Processing Systems
Andrejkovics Zoltán
?
Generative AI and the Rise of Large Language Models
Generative AI and the Rise of Large Language ModelsGenerative AI and the Rise of Large Language Models
Generative AI and the Rise of Large Language Models
dsclaubyblos
?
Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...
Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...
Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...
Numenta
?
DL Classe 0 - You can do it
DL Classe 0 - You can do itDL Classe 0 - You can do it
DL Classe 0 - You can do it
Gregory Renard
?
Deep Learning Class #0 - You Can Do It
Deep Learning Class #0 - You Can Do ItDeep Learning Class #0 - You Can Do It
Deep Learning Class #0 - You Can Do It
Holberton School
?
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
Niket Singh
?
GDC2019 - SEED - Towards Deep Generative Models in Game Development
GDC2019 - SEED - Towards Deep Generative Models in Game DevelopmentGDC2019 - SEED - Towards Deep Generative Models in Game Development
GDC2019 - SEED - Towards Deep Generative Models in Game Development
Electronic Arts / DICE
?

Recently uploaded (20)

Design Data Model Objects for Analytics, Activation, and AI
Design Data Model Objects for Analytics, Activation, and AIDesign Data Model Objects for Analytics, Activation, and AI
Design Data Model Objects for Analytics, Activation, and AI
aaronmwinters
?
Cost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheetCost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheet
supreetk82004
?
Introduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptxIntroduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptx
nabinparajuli9
?
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdfstages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
esguerramark1991
?
MLecture 1 Introduction to AI . The basics.pptx
MLecture 1 Introduction to AI . The basics.pptxMLecture 1 Introduction to AI . The basics.pptx
MLecture 1 Introduction to AI . The basics.pptx
FaizaKhan720183
?
100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf
jacobdivina9
?
Class 3-Workforce profile updated P.pptx
Class 3-Workforce profile updated P.pptxClass 3-Workforce profile updated P.pptx
Class 3-Workforce profile updated P.pptx
angelananalucky
?
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
taqyed
?
The Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability AnalyticsThe Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability Analytics
christophercamposus1
?
MTC Supply Chain Management Strategy.pptx
MTC Supply Chain Management Strategy.pptxMTC Supply Chain Management Strategy.pptx
MTC Supply Chain Management Strategy.pptx
Rakshit Porwal
?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
Christine Hemphill
?
The truth behind the numbers: spotting statistical misuse.pptx
The truth behind the numbers: spotting statistical misuse.pptxThe truth behind the numbers: spotting statistical misuse.pptx
The truth behind the numbers: spotting statistical misuse.pptx
andyprosser3
?
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICESHIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
anastasiapenova16
?
CloudMonitor - Architecture Audit Review February 2025.pdf
CloudMonitor - Architecture Audit Review February 2025.pdfCloudMonitor - Architecture Audit Review February 2025.pdf
CloudMonitor - Architecture Audit Review February 2025.pdf
Rodney Joyce
?
Boosting MySQL with Vector Search Scale22X 2025.pdf
Boosting MySQL with Vector Search Scale22X 2025.pdfBoosting MySQL with Vector Search Scale22X 2025.pdf
Boosting MySQL with Vector Search Scale22X 2025.pdf
Alkin Tezuysal
?
IFRS Finance Powerpoint ppt Finance D.pptx
IFRS Finance Powerpoint  ppt Finance D.pptxIFRS Finance Powerpoint  ppt Finance D.pptx
IFRS Finance Powerpoint ppt Finance D.pptx
amantiwari2091
?
Introduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdfIntroduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdf
messagetome133
?
"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT
miao22
?
Monitoring Imam Ririn di Pilkada Kota Depok 2024
Monitoring Imam Ririn di Pilkada Kota Depok 2024Monitoring Imam Ririn di Pilkada Kota Depok 2024
Monitoring Imam Ririn di Pilkada Kota Depok 2024
Deddy Rahman
?
Analyzing Consumer Spending Trends and Purchasing Behavior
Analyzing Consumer Spending Trends and Purchasing BehaviorAnalyzing Consumer Spending Trends and Purchasing Behavior
Analyzing Consumer Spending Trends and Purchasing Behavior
omololaokeowo1
?
Design Data Model Objects for Analytics, Activation, and AI
Design Data Model Objects for Analytics, Activation, and AIDesign Data Model Objects for Analytics, Activation, and AI
Design Data Model Objects for Analytics, Activation, and AI
aaronmwinters
?
Cost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheetCost sheet. with basics and formats of sheet
Cost sheet. with basics and formats of sheet
supreetk82004
?
Introduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptxIntroduction to database and analysis software’s suitable for.pptx
Introduction to database and analysis software’s suitable for.pptx
nabinparajuli9
?
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdfstages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
stages-of-moral-development-lawrence-kohlberg-pdf-free.pdf
esguerramark1991
?
MLecture 1 Introduction to AI . The basics.pptx
MLecture 1 Introduction to AI . The basics.pptxMLecture 1 Introduction to AI . The basics.pptx
MLecture 1 Introduction to AI . The basics.pptx
FaizaKhan720183
?
100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf100680-05-Eucharist_Orientation_Sessions.pdf
100680-05-Eucharist_Orientation_Sessions.pdf
jacobdivina9
?
Class 3-Workforce profile updated P.pptx
Class 3-Workforce profile updated P.pptxClass 3-Workforce profile updated P.pptx
Class 3-Workforce profile updated P.pptx
angelananalucky
?
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
加拿大成绩单购买原版(鲍颁毕业证书)卡尔加里大学毕业证文凭
taqyed
?
The Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability AnalyticsThe Role of Christopher Campos Orlando in Sustainability Analytics
The Role of Christopher Campos Orlando in Sustainability Analytics
christophercamposus1
?
MTC Supply Chain Management Strategy.pptx
MTC Supply Chain Management Strategy.pptxMTC Supply Chain Management Strategy.pptx
MTC Supply Chain Management Strategy.pptx
Rakshit Porwal
?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?AI + Disability. Coded Futures: Better opportunities or biased outcomes?
AI + Disability. Coded Futures: Better opportunities or biased outcomes?
Christine Hemphill
?
The truth behind the numbers: spotting statistical misuse.pptx
The truth behind the numbers: spotting statistical misuse.pptxThe truth behind the numbers: spotting statistical misuse.pptx
The truth behind the numbers: spotting statistical misuse.pptx
andyprosser3
?
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICESHIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
HIRE MUYERN TRUST HACKER FOR AUTHENTIC CYBER SERVICES
anastasiapenova16
?
CloudMonitor - Architecture Audit Review February 2025.pdf
CloudMonitor - Architecture Audit Review February 2025.pdfCloudMonitor - Architecture Audit Review February 2025.pdf
CloudMonitor - Architecture Audit Review February 2025.pdf
Rodney Joyce
?
Boosting MySQL with Vector Search Scale22X 2025.pdf
Boosting MySQL with Vector Search Scale22X 2025.pdfBoosting MySQL with Vector Search Scale22X 2025.pdf
Boosting MySQL with Vector Search Scale22X 2025.pdf
Alkin Tezuysal
?
IFRS Finance Powerpoint ppt Finance D.pptx
IFRS Finance Powerpoint  ppt Finance D.pptxIFRS Finance Powerpoint  ppt Finance D.pptx
IFRS Finance Powerpoint ppt Finance D.pptx
amantiwari2091
?
Introduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdfIntroduction Lecture 01 Data Science.pdf
Introduction Lecture 01 Data Science.pdf
messagetome133
?
"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT"MIAO Ecosystem Financial Management PPT
"MIAO Ecosystem Financial Management PPT
miao22
?
Monitoring Imam Ririn di Pilkada Kota Depok 2024
Monitoring Imam Ririn di Pilkada Kota Depok 2024Monitoring Imam Ririn di Pilkada Kota Depok 2024
Monitoring Imam Ririn di Pilkada Kota Depok 2024
Deddy Rahman
?
Analyzing Consumer Spending Trends and Purchasing Behavior
Analyzing Consumer Spending Trends and Purchasing BehaviorAnalyzing Consumer Spending Trends and Purchasing Behavior
Analyzing Consumer Spending Trends and Purchasing Behavior
omololaokeowo1
?

Deep learning beyond_the_hype-franceia@lapaillasse