狠狠撸

???? ???
Deep Learning ?? ????
OSIA ??? ??
2017. 6. 29 (?)
????? ????????
? ? ? ???
bhkim@bi.snu.ac.kr

??
? Part 1: ????? ??? ??
? Part 2: ???? ??? ?? ?? ??
? Deep Learning + Image ??
? Deep Learning + Sequence ??
? Deep Learning + Image & Sequence ??
? Deep Learning ?? ??
? ???? & ??? ?? ? ??
? ??
? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 2

Intro
狠狠撸 by Jiqiong Qiu at DevFest 2016
http://www.slideshare.net/SfeirGroup/first-step-deep-learning-by-jiqiong-qiu-devfest-2016
????
????
(????)
???

Image source: https://blogs.nvidia.com/blog/2016/07/29/whats-difference-artificial-intelligence-machine-learning-deep-learning-ai/

????(AI)
? “???? ???? ???? ???? ??”(???, SW)? ??
? ??? ???? ? ?? ?? ??? ? ? ??? ?? ??
? ??? ??? ?? ?? ??? ? ? ??? ?? ??
? 1950: Turing’s Paper, 1956: “Artificial Intelligence (AI)”
5(KIPS 2016 Conference Keynote by Byoung-Tak Zhang)? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr

???? ??? ??: ??
? AI ??? ??? ‘???‘ ???/??? ??? ?
? ???? ??? ????(intelligent), ??? ?? ???
???(adaptive), ???(robust)?? ??
? ??? ??? ????? ???? ?? ???
? ??? ????? ??? ??? ??? ?? ????,
??? ????? ????? ??!
? ??? AI ?? ?? ? ‘??(learning)‘ ??
cat car
(Sam Roweis, MLSS’05 Lecture Note)

??? ??? ??? ???? ?? ????
? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 7(CIKM 2013 Keynote by Jeff Dean)
??(world)? ???? ??? ??? ??
???? ?? ? ?? ??
?? ??
?? ??
…

?? ??? ???? ???? ???? S/W
???? ??? ???? ‘Hound’ by Soundhound

(Figure from ICML 2014 tutorial by Li Deng)
???, ?? ??? ??? ? ?? ???
?? ?? ??
??? ??
?? ?? ??
??? ??
? ?????? ?? ??
??(switchboard)?? 99? ??
10?? ?? ?? ??
? Microsoft Research: 2010?
??? ??? ?? ??
???? ~23% ?? <15% ?
??(Rick Rashid’s? ?????
7% ??)!
? Google: 2012??? ??? ??.
2015? RNN ???? ?? ??
??
? IBM Watson ?? switchboard ?
?? 2015? ??? 8%, 2017?
5.5%? ?? (??: 5.1%)

Intelligent Personal Assistant Program
https://www.yahoo.com/tech/inside-look-
microsofts-cortana-163814879.html (2:20)
24me quip
voice-enabled AI

Personal Assistant/Robot at Home
Pepper
Amazon Echo “Alexa”
Google Home
Jibo

???? ??? (Autonomous Car)
Grand Challenge
2005
Urban Challenge
2007
Self-driving Cars
2009 ~

???? ??? (Autonomous Car)
Image from http://www.novatel.com/industries/autonomous-vehicles/#technology
?? ?? ?? ?? (???, ??/??, ?? ???, …)

???, ?? ?? ??? ? ?? ???
? ImageNet: 3? ?? ??? ????,
1?5??? ?? ?? DB
? ????? ?? ???? ??
? 2012??: Alex Krizhevsky ??
computer vision (CV) ??? ?
??? ??, ?? CV ?????
? ??? 1? ??(AlexNet)
? 2015??: ???? ??? ??.
?? ??? ?? ??? ??

??? ??? ??? ???? ?? ????
??(world)? ???? ??? ??? ??
???? ?? ? ?? ??
?? ??
?? ??
??? ??
Computer Vision
???? ??/??
Natural Language
Processing / Understanding
?? ??
Speech Recognition
+ ???? ??? ?? ?? ??? ????
Intelligent Agent

16
??? ????(Intelligent Agents)
Autonomous Agents
Biological Agents Robotic Agents Computational Agents
Software Agents Artificial Life
Agents
Entertainment
Agents
Task-specific
Agents
Viruses
(KIPS 2016 Conference Keynote by Byoung-Tak Zhang)
? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr

??, ??, ?? (Perception, Action and Cognition)
????(Agent)
??(Environment)
What is the world
like now
Action
to be done
Perception
Actuators
Action
Cognition
? An agent is anything that can
? Perceive its environment through sensors, and
? Act upon that environment through actuators
17(KIPS 2016 Conference Keynote by Byoung-Tak Zhang)? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr

?? ????
IBM Watson
IBM Deep Blue? ?? ?????
G. Kasparov? ?? (1997)
IBM Watson? ????(Jeopardy)??
? ?? ???? ??? ?? (2011)
??? ?? ??? ??? ?? ?? ?? ??
??? ??
???? ??
? ???? ????? ??? ????
???? ?? ??? ??? ??.
? ???? ??? ?? ??? ?? ??
Half-Life 2

???, ??? ???? ?????
?? Atari ?? ?
???? ?? ???
????(2015)
???? ?? ??? ????
??? ???(2016)
?) ????
??? ?? ??

AI? ??? ??(electricity, ???)
?????
??? ??(???)??,
????
??? ??(??)???.
- Juliette Powell, 2016
(Founder at Turing AI and WeTheData.com)

????? ??? ??? ????

???? (Machine Learning, ML)
Q. If the season is dry and the pavement is slippery, did it rain?
A. Unlikely, it is more likely that the sprinkler was ON
??? ????
??? ?????
??? ??? ??? ????
????, ?? ?? ???? ??
?? ??
?? ??
??, ????
?? ?? ??
?? ?? ??
?? ?? ?? ??

????? ? ?? ?? ?? ??
? Supervised Learning (????, ????, ????)
? ???(?? ???? ??) ?? ??? ????
? ??? ?? ?? ?? ???? ??? ????
? ?) ??(classification): ???? ????(discrete) ??.
? ?) ??(regression): ???? ??? ?? ??? ??
? Unsupervised Learning (?????, ?????, ?????)
? ???? ??? ??, ??, ??? ??? ?? ??. ???? ????
??
? ?? ???? ??? ?? ?? ????? ??? D={(x)}
? ?: ?? ??(dimension reduction), ???(clustering)
? Reinforcement Learning (????)
? ???? ??? ???(right/wrong)? ?? ???? ?? ??
? ????? ?????, ??(environment) ??? ??(rewards)? ???
?? ??? ??(action)? ????? ???? ??
? ??? ??, ????? ??, ?? ?? ?? ? ??, ?? ??? ???
??
? Action selection, planning, policy learning
? → ?
?
?(?)

Supervised Learning
? Mapping from A to B
? Learning from data on (A, B) pairs
? ??
??? ??? ??? ? ?? ???? ??
?? ? ??? AI ?????? ??? ??? ?? ?? ??
A B
Email ?? ?? (0 or 1)
Image (??) object (1, 2, …, 1000)
Audio (??) Text (?)
?? ?? ??? ??
Text (?) Audio (??)
Ad/user click ? (0 or 1)
(contents from Andrew Ng’s Lecture at Stanford MSx Future Forum, 2017-01-25)

????(connectionism)
? ????, ???? ??? ???? ?? ?? ??(neural
information processing)? ?? ??? ?? ? ??
? ??? ??? ??? ?(network)?? ?? ??? ??? ???
??
? ?????(artificial neural networks)
? ????(??)? ??? ??? ?? ???? ?? ??? ??
?? ??
??? ??(feedforward)

???(Deep Learning)
(??: Y. Bengio, Deep Learning Summer School 2015)
? ??: ??? ??, ?? ??: ???? ???? ??
GoogLeNet
DeepFace
Convolutional NN
Stacked RBM
Neural
Machine Translator
? ?? ??? ?? ? ?? ??/??, ?? ??, ???? ??? ??,
?? ?? ? ????? ???? ???? ?? ??? ??? ??.
? (?? ??)?????? ?? ??? ??? ????
? ?? ??? ?? ??? ???? ????
?? ???? ????? ??
Deep Q Network

???(Deep Learning)
? ??? ?? ?? ??
? Input: ?? ??
? Output: ?? ??
(??: Y. Bengio, Deep Learning Summer School 2015)
? ??: ??? ??, ?? ??: ???? ???? ??
https://computervisionblog.wordpress.com/category/computer-vision/
http://blog.csdn.net/u010025211/article/details/49995035

??? ??? ??
? ?? ??(multi layer, deep)
? ?? ???? ?? ??
? ?? ??? ??? ?? ???? ‘???‘ ??
???? ???? ??? ??? ??(bottom-up,
learning through layers)
? ?? ?? ??? ??? ?? ??? ???
(end-to-end)
? ?? ‘???’? ??? ??? ???? ??
raw input? output ??? ?? ??? ????
? ???? ?? ??
? ?? ??/????(distributed
representation)
? ??? ? ?? ??? ?? ??
? ?? ??? ???? ?? ??/??
? Compositionality
? ??? ???? ??? ?? ??
? ??? ‘??’?? ????? ?? ? ?? ??
?? ?? ? ??? ??
??? ?? ??(Baidu)

???? ?? ?? ??: ?? ??
? ?????(fully-connected)
? ? ? ??? ?? ??? ??
? ?????(convolutional)
? ?? ??? ??? ??
? Max pooling?? ???
? ???(recurrent)
? ??? ???? ?? ??? ??
???
? ? ??? ???, ???? ???
??? ??
? ??? ????(memory)? ???
??

? ??? ???? ? ??
? ?????(fully-connected)
? Deep Belief Net (DBN): RBM?
??? ? ??
? ?????? Contrastive
divergence (CD) ??
? DBN (deep belief network)
(2006)
? ?????(convolutional)
? LeNet: ???? + Max pooling
?? (1989)
? CNN (convolutional neural
network)
? ???(recurrent)
? RNN (recurrent neural network)
? Long Short-Term Memory
(LSTM) (1997)

?? ?? ?? ??? ??:
Baidu DeepSpeech 2 (2015.12)
https://www.youtube.com/watch?v=IFPwMKbdQnI
Baidu, DeepSpeech2 (2015)
??? ??? ???, ??? ???? ?? ??

(contents from Andrew Ng’s Lecture on Machine Learning)

DEEP DREAM & DEEP ART ??
??: Deep Learning + Image

Deep Dream & Deep Art ????
? Deep Dream
? http://deepdreamgenerator.com/
? 1??: ?? ???
? 2??: ????? ?? ?? ??
? 3??: ?? ?? ??, dream
control?? ??? ?? ????
? Deep Art
? https://deepart.io/
? 1??: ?? ???
? 2??: ???? ?? ?? ???
? 3??: e-mail? ?? ??
? For Videos

DeepDream
? neural networks that were
trained to discriminate between
different kinds of images have
quite a bit of the information
needed to generate images too
? feed the network an arbitrary
image or photo and let the
network analyze the picture
? pick a layer and ask the network
to enhance whatever it detected
35
???? ????? ?? ??? ? ? ??
– a new way to remix visual concepts
https://github.com/google/deepdream
http://deepdreamgenerator.com/
From lower layer
From higher layer

DeepDream
36
Dog
Cat
Bird
Images from slides by H. Nobuta from http://www.slideshare.net/HarumitsuNobuta/deep-dream
Original image Inception from 3a Inception from 3b Inception from 4a Inception from 5a
1
2
3
4
0
‘inception’ (pattern)
generation
Backpropagation
(image modified)
Deep neural net that classify images
(example: GoogLeNet trained with ImageNet)
Update pattern with
the modified image
backpropagation
(image modified)

DeepArt: A Neural Algorithm of Artistic Style
37
Figure from (H. Katoaka, K. Iwata, Y. Satoh, 2015)
http://arxiv.org/pdf/1508.06576v2.pdf
? ?????? ?????
??? ???? ?? ??
? ??? ??(contents)?
???(style)? ????
????? ??? ????
???

DeepArt: A Neural Algorithm of Artistic Style
38? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr

Artistic Style Image Generation

?? ??, ?? ??, ??? ??
??
??: Deep Learning + Sequence

?? ?? ?? Deep Learning ??
? ????
? RNN?? ?? ?? ??? ??
? Google Magenta
? Deepmind WaveNet (???? ??)
? ?? ??
? http://peltarion.com/creative-ai
? RNN ??? DL? ?? ??
? ??? ??
? http://www.cs.toronto.edu/~graves/
handwriting.html
? ?? ??? ??? ??? ???
?? ???

LSTM Realbook: Generation Jazz chord
progressions
42
https://keunwoochoi.wordpress.com/2016/02/19/lstm-realbook/
Char-RNN / Word-RNN
Character(word)-level language models
an LSTM cell
Preprocess into text-format scores
Keras and Theano codes
(https://github.com/keunwoochoi/lstm_real_book)
Dataset configuration
Results (click to hear)? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr

RNN ?? ?? ??: ?? ????
Neural Machine Translation (NMT)
??? ?? RNN? ??? ?? RNN? ???? ??
https://translate.google.co.kr/

??? ?? ?? ?? ??
??: Deep Learning + Image & Sequence

??? ??? ??
(Y. Lecun, Y. Bengio, and G. Hinton, 2015) http://www.nature.com/nature/journal/v521/n7553/fig_tab/nature14539_F3.html
CNN? RNN? ???? ???? ??? ???? ??

??? ?? ?? ??
46? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr

??? ?? ?? ??
??? ??? ??? ??? ????(??), ??? ??? ??? ??(??)

??, ??, ??, ??
??: Deep Learning + ??

??? ?? : Paypal
?? ??
? ???? ?????? ??
????? ebay? ??
? 3000? ?? ??? ???
??? ???
? ??? ???? ??
? ?? ??? ????? ??
85%? ???? ??/?? ?? ??
? 2015? ???? ebay?? ??
? ???? ???-????? ??
?? ?? ???

Binatix: ??? ?? ?? ??? ?? ??
? ???? ??? ?????? ?? (proprietary trading company) (2011~)
? Side ????? ?? ??? ??
? ?? ??? ?? ??? ??? ???? ????? ??
? “?? 3?? ?? ????????. ??? ??? ?? ?? ?? ??? ??
??? ?????.” (Itamar Arel, CTO, 2014? 9? ???)
? ???? ??
? ?? ?? ?? ?? ??: ?, ?, ?, ??, ?, …
? ??? ?? ?? ?? ??
? ????? ??? ‘? ?? ?? ??’? ???? ?? ??? ???
Ben-Efraim (CEO)? Itamar Arel (CTO) ????? 1?? ?? ?

Kensho WallStreet ???? ???? AI
? Warren: S/W solution on Big Data, Natural Language, Actionable Insights
- ???? ??? ?? ? ?? ?? ??? ?? ??? ??? ??? ??, ???
(visualization), ??? ?? ??
- Google ??? ??: ???? ???? ??? ??
- 9?? ?? ??/?? ?? (???? ??, ?? ??, ?????, …)
- 1? ?? ??? ?? ?? ??? ?? ?? (quant army? ??)
- ?) 3?? ????? ????? ??? ? ?? ??? ??? ?? ????
- ????? ? CNBC? ??. CIA? ??
(vs. Bloomberg, Thomson Reuters, Bridgewater Associates)
CNBC - ‘Kensho STATS Box’
2016-4-22, Apple ??? 1? ?? 1% ??
CNBC, ‘Ask Kensho’

Deep Learning ?? – ??, ??
??? ???? ?? ?? ?? ??? ???
? Facebook DeepFace
? 2D+3D: ?? ???? ?? ??
? Google FaceNet
? ??? ??, ?? ???? ??
?? ?? ??? / ??
? Google DeepDream
? ???? ??? ???, ? ? ??
? Google DeepStereo
? ??? ??, ?? ??? ?? ??
???? ? ?? ???
Baidu DeepSpeech
??
??
??
??
??
??
??
??
??
(?? ???? 3:02~)

Deep Learning ?? – ??, ??
?? ??
? PayPal
? 0xdata ?? H2O ???? ??? ??
??/??
? Binatix
? ????? ?? ??? ?? ?? ??
? ??????, ????
? Kensho
? ????, ?? ?? ?? ?? ??,
?? ? ??, ???? ??
??? ??? ??
? YouTube
? ???? ??? ?? ?? ??/??
? ??? ?? ?? Amazon? ??
(item-to-item ?????)
?? ???
? Netflix ?? ??
? All-in cloud strategy: AWS + GPU
? ?? ??
? Google, Spotify, Pandora: ????
?? ?????? ?????? ??
??
??

???? & ??? ?? ? ??

? ??

???? ?? ??? ??? ??
? 2017, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 56http://insights.venturescanner.com/tag/artificial-intelligence/
???? ?? ?? ??? ???? ?? ??
http://insights.venturescanner.com/2015/01/29/going-deep-on-deep-learning-technology/
http://www.siemens.com/innovation/en/home/pictures-of-the-future/digitalization-and-software/artificial-intelligence-facts-and-forecasts.htmlFacts and Forecasts: Boom for Learning Systems
The global market for smart
machines is growing by almost
20 percent annually.
‘??? ??’? ??? ??
??? ?? 20%? ????
??.

???? ???? ??? ??
57
??: https://www.cbinsights.com/blog/deep-learning-ai-startups-market-map-company-list/

?? ??
? Google, Microsoft, Facebook,
Amazon ?? ?? ???? ???
?? ???? ?? ??
? ???? ??? ??? ?? + ?? ??
??(?? ??? ?? ???? ?)
? ?? ?? AI ???? ??
? ??? AI ???? ??: PAI, AIAI, OpenAI
(by Elon Musk)
? ?? ??? ??? ??
? NIPS: Neural Information Processing
Systems (1986~)
? ICML: International Conference on
Machine Learning
? ECML, ACML
? AAAI: AAAI Conference on Artificial
Intelligence
? 2016??? ??? ??? ?? ???
?? 5,000 ??? ???
? 2016?? ???? ??? ????, ?
?? ?? ???? ???? ??
2002~2015? ?? ?? ??? ?? ????? ??

???? ?? ??? ??? ??????? ???? ??
(Google ??? ?? ???, ? ???? ???? ??)

Combining Awesome Models
? Kyunghyun Cho, Deep learning, where are you going?, 2017

Combining Awesome Models
? https://research.googleblog.com/2017/06/multimodel-multi-task-machine-learning.html

Smart Machine? ??
Siri
Pepper Google CarMIT Jibo
Amazon PrimeAirIBM Watson
? ????????, ?????, ???? ?? Smart Machine? IT ???
?? ???? ??? ? ??? ?? (Gartner, 2014)
? ???? ?? ??? 10? ? 70? ??? ??? ??? ?? (YTN, 2015)

The Coming Age of Smart Machines

????

DEEP LEARNING ????
????

?????? 1: ?? ??? ??
??
? Alex Graves? ?? ??? ??
? http://www.cs.toronto.edu/~graves/handwriting.html
????
? ??? 100???? ‘Text’?? ??
? ????? ??? ??? ?????.
???
? ??? ??? ??: Style
? ??? ???? ?? ?? ?? ??: bias (????? ? ?? ???? ???)
??
? ? ?? ???? ???? ??
? ? ??? jpg ??? ???? ??
There’s no place like home.
Let’s count: 1, 2, 3

?????? 2: ?? ?? ?? ??
1. Google AI Experiment ????? Quick, Draw! ???? ??
https://aiexperiments.withgoogle.com/quick-draw
3. ???? ????? ??? ????
4. ???(20? ???) ????
???? ??? ? ???? ?????
2. ?? ?? ???

?????? 3: ???? ??? ??
1. Google AI Experiment ??? ? Google Magenta ???? ?? ?? ??
https://aiexperiments.withgoogle.com/ai-duet
2. ?? ?? ??? 3. AI? ??? ???? ?????
(??? ???? ?? ???
?? ?????.)

?????? 4: ???? ?? ??
69
http://cs.stanford.edu/people/karpathy/deepimagesent/rankingdemo/
2. ?? ??? ??????
?) A city street corner from a park view
[?? ??? ?]
- ??: ???? ?? ??
- ??: ??? ??
- ??: top 5? ???? ?? ?? ??
3. ??? ??? ???? ?? ?
?? ??????
1. Andrej Karpathy? ?? ????? ??

??? ? ??? ??? ??
?? Word2Vec: ??-??+??=???
(http://w.elnn.kr/search/)
Eyescream Project: ???? ???? ?? ??
(http://soumith.ch/eyescream/)
??? ?? ?? ??
(http://www.cs.toronto.edu/~graves/handwriting.html )
Deep Dream: ??? ???? ???
(http://deepdreamgenerator.com/)

Hot Trends & Frontier
? Learning to Learn and Compositionality
? Generative Models
? VAE, GAN, …
? Reasoning with Deep Learning, Schema Networks

Neural Network ??
http://playground.tensorflow.org/
??, ??? ??: https://cloud.google.com/blog/big-data/2016/07/understanding-neural-networks-with-tensorflow-playground

??: ?????? ??? ??? ??
Neural Network Activation Functions
(A. Graves, 2012)
???? ? = max(?, 0)
Rectified Linear Unit
[??]
? Hidden unit? sparsity? ????
? Gradient vanishing ??? ??
? ??? ???? ??? ????
?? ???? ??
- ???? ???? ON ?? OFF ??. ?? ???? ?, ??? ?? ?
- ?????? ‘?? ???’ smooth? S? ?? ??? ??
- ?? ??? ????? ReLU? ??
- ????? ????? sigmoid? tanh ??? ???

DEEP LEARNING ?? ????? ???
? ?? ???? ?? ?????

? ?? ???
Computing Power
(?? GPU ??
?? ??)
Big Data
????
????
????
?? ???
??

??? 1: Computing Power
Andrew Ng.
??? ?? ??? ???? GPU? ????
??? ?? ???? ??
(DBN ????? ?? 70?)
???? ?? ?? ???? ??? ?? ?? ??
??, Graphics Processing Unit?? CPU?? ??? ?? ?? ??

??? 2: ????
??? ??? ??? ??? ??? ???? ???? ????
??(text) ?? ??(visual) ?? ??(audio)
??? ??
(activity)
?? ??
(knowledge graph)
?? ??
(sensor)
??
???
??, ??, …

??? 2: ????
??? ?? ??? AI? ?? ????? ??? ? ?? ??? ?? ??.
?????
??? ?? ??
(web cookies, online footprints, …)
??? ? ?? ???
??? ?? ??
??? DB
??? ?? ??
Wikipedia ?? ?? ????????
???? ???

??? 3: ???? ????
??? ??? ?? ??? ??? ML/DL ?? AI ??? ???? ??.
Convolutional NN
Stacked RBM
DeepFace
GoogLeNet
Neural
Machine Translator
Deep Q Network

??? 3: ???? ????
??? ??? ?? ??? ??? ML/DL ?? AI ??? ???? ??.

??? 4: ?? ??? ??
[???? + ML/DL] [?? ?????: ??, ??, ??]
https://github.com/Microsoft/CNTK
https://github.com/tensorflow/tensorflow
https://github.com/Theano/Theano
https://github.com/torch/torch7
https://github.com/BVLC/caffe

???? ?? ???? ??
????(Cloud) ???? ????(Bid Data)? ???? ????(Machine
Learning) ??? ??? ???/???? ?? ???? ???? ??.
https://cloud.google.com/prediction/docs
http://azure.microsoft.com/ko-kr/services/machine-learning/
https://aws.amazon.com/ko/blogs/aws/amazon-machine-learning-make-data-
driven-decisions-at-scale/
http://www.ibm.com/cloud-computing/bluemix/

?? Deep Learning ???? ??
?????
Core
language
Library type
Auto. gradient
computation
CPU GPU
Multi-G
PU ??
????
??
??? ???
Theano Python
Numerical comp
utation
Flexible ? ? x BSD ? ??? ??
Google
TensorFlow
Python
Numerical
computation,
deep learning
models
Flexible ? ? ? Apache 2.0
? ??? ??, ???? ??
??
Microsoft
CNTK
C++
Numerical
Computation
Flexible ? ? ? MIT
? ??? ??, ???? ??
??
Samsung
Veles
Python
Deep learning
models
Restricted ? ?
Not spec
ified
Apache 2.0
? ??? ??, ???? ??
??
Caffe C++
Deep learning
models
Restricted ? ? ? BSD ? ??? ??
Torch Lua
Numerical
computation,
deep learning
models
Flexible ? ? ? BSD ? ??? ??
Keras
Python (usin
g Theano or
Tensorflow)
Deep learning
models
Restricted ? ? ? MIT
? ??? ??, ???? ??
??
Blocks
Python (usin
g Theano)
Deep learning
models
Restricted ? ? x MIT
? ??? ??, ???? ??
??
Lasagne
Python (usin
g Theano)
Deep learning
models
Restricted ? ? x MIT
? ??? ??, ???? ??
??

DEEP LEARNING ???
????

?? ?? ???? – ????(H/W)
? ?? PC?? ??
? ???(??) GPU? ??? ????
? GTX Titan X
? GTX 960~980
? ???? ??? ??
? ???? ??/???? ?? ?? ????
??? ??

?? ?? ???? – ?????(S/W)
? ?? ??: C++, Python, Lua, …
? ????: Windows, Linux, OSX
? ????? ??
? ?? ?? ?? ? ??
? ???? ????

?? ??? ?? ????.
? Summer School
? Deep Learning Summer School 2015 (video)
? Machine Learning Summer School
? Free online media
? Stanford? “CS231n: Convolutional Neural Networks for Visual Recognition” ??
(http://cs231n.stanford.edu/) (??!)
? ??? ??(http://neuralnetworksanddeeplearning.com/) (??!)
? Videoletcures.net, techtalks.tv ??? summer school ?? ? ??
? 狠狠撸share.net?? ???? ??
? Deeplearning.net?? ??? ?? ?? ??
? MOOC (Massive open online course) ??? ??
? Deep Learning @ Udacity: https://www.udacity.com/course/deep-learning--ud730
? Google Brain ?? ???? ??. TensorFlow? ??? ???? ??
? Deep Learning Courses @ NVIDIA Developer: https://developer.nvidia.com/deep-learning-
courses
? ???? ?? ??? ?? ?? ?? ??? ??? ? ?? ?? ??
? Caffe, Theano, Torch? ?? ??? ?? ? ??.
? NYU Course on Deep Learning by Yann Lecun:
http://techtalks.tv/deep_learning_nyu_spring_2014/

???, ???? ???
For developers and engineersFor researchers (and students)

???? ??? ??? ??
? ??? ?? ??
? ? ?? ???? ??(??: ??? ?) http://deeplearning4j.org/kr-neuralnet-
overview.html
? ???? ????(??: ??? ?) http://deeplearning4j.org/kr-
convolutionnets
? SNS?? ??
? Facebook AI Korea (Deep Learning)
https://www.facebook.com/groups/AIKoreaOpen/
? ???? ???/????? ??
? https://keunwoochoi.wordpress.com/ (???, Queen Mary University of London)
? http://t-robotics.blogspot.kr/ (???, ??? Waterloo ??? ????)
? http://hunkim.github.io/ml/ ?? ?? ??? ??(Sung Kim(???) ??, ?????)
? http://khanrc.tistory.com/category/DataScience/Deep%20Learning
? ?? Community ?? ??
? Team AI Korea http://aikorea.org/ (???, SK T Brain)
? https://www.facebook.com/awesomeai/

狠狠撸

???? ??? - Deep Learning ?? ????

More Related Content

???? ??? - Deep Learning ?? ????