狠狠撸

狠狠撸Share a Scribd company logo
Graph Neural Network
2019.03.24
Jungwon Kim
???? ?...
● GCN(Graph Convolutional Network)? ?? ???? ????
○ ??? ? ??…
● GNN? ?? ??? ???? ????
Graph Neural Network??
● Graph ??? ??? ?? Neural Network
○ ??: Graph
○ ??: Label
■ ??(0.95, 0.81, 0.4, …)
■ ??? (Protein, Carbon-dioxide, etc.)
■ ?? (Drug/Not Drug, etc.)
? Graph Neural Network?
● ??? ??? ?? ??? ?? ??
○ RNN? ?? Cell?? Recursive? ??? ??
● ????? ???? ??
○ ?? ??? ?? Connection
○ ????? ??? ?? ???? ?? ??? ??
Euclidean Space (???? ??)
???? ?? (x, y, z)??? ??
= ??? ?? ??? ?? ?? ??? ??
Non-Euclidean Space (? ???? ??)
????? ?? ?? ~ ????? ???
● Euclidean ????? ??? ?? ??
○ ??? ?? ???? ??
● Non-Euclidean ????? ??? ???
??
https://deepmind.com/blog/alphafold/
Euclidean Space vs Non-Euclidean Space
When to use GNN?
● ??
○ ????/???? (??? ?? ??)
● Program ??
○ Expression Statement
○ ?????? ?? ??
○ RNN ???? ??? ? ??
● Etc.
For example...
For example...
RNN (Recurrent Neural Network)
● RNN??? ? Cell? ?? Cell???? ???? ???? ??? ????
○ ??? ??? ??? ????...
■ Time Series
■ ?? ??
■ ??? ???
■ Etc.
RNN (Recurrent Neural Network)
GNN (Graph Neural Network)
GNN (Graph Neural Network)
GNN (Graph Neural Network)
Adjacency = 1
GNN (Graph Neural Network)
Adjacency Matrix
● ?? ??? ???
Adjacency Matrix
DeepMind: AlphaFold (https://deepmind.com/blog/alphafold/#image-33420)
GCN (Graph Convolutional Network)
● (l): Layer
● H: Input from Layer (l)
● W: Weights (Trainable)
● A: Adjacency Matrix
● D: Degree Matrix
○ Number of connections
attached to each node
● Hat notations
○ Normalized with
standard Identity matrix
● Activation Function: Sigmoid
GCN (Graph Convolutional Network)
GNN (Graph Neural Network)
● RNN
○ ?? Cell? ?? Cell? ??? ???? ???? propagate
● GNN
○ ‘Adjacency’? ?? ??
■ Adjacency = 1? ?? ??
■ Adjacency = 2? ?? ??
■ Adjacency = 3? ?? ??
■ …
■ Adjacency = n(?? ??)? ?? ?? ??
GNN Variations
● Graph Neural Network (2005)
● Spectral Networks (2014)
● Neural Message Passing (2017)
○ Gated Graph Neural Network (2016)
○ ChebyNets (2016)
○ Graph Convolution Network (2017)
● Async. Neural Message Passing (2018)
● AMPNet (2018)
● Programs As Graphs (2018)
GNN Variations
● Graph AutoEncoder (2016)
● GraphGAN (2017)
● GraphSAGE (2017)
● Graph Attention Networks (ICRL 2018)
● GraphRNN (2018)
● Splitter (2019)
Types of GNN
Datasets for GNN
https://github.com/shiruipan/graph_datasets
** Not listed in link, but ‘Zachary’s karate
club’ is a commonly used social network. **
(https://towardsdatascience.com/how-to-do-
deep-learning-on-graphs-with-graph-
convolutional-networks-7d2250723780)
Graph Nets Library (DeepMind)
https://github.com/deepmind/graph_nets
● DeepMind?? ??? ?????
● Doc? ???? ???? ??
● Tensorflow-based
DGL (Deep Graph Library)
https://www.dgl.ai/
● ?? ??? (2018)
● NYU, NYU-???, Amazon
?? ??
PyTorch Geometric
https://github.com/rusty1s/pytorch_geometric
● PyTorch Extension
○ ?? ?? X
● DGL?? ?? 15? ?? ?
??? ??? ??
Geometric Deep Learning
http://geometricdeeplearning.com/
● Not a Framework
● Many references for GNN
(Not a lot of descriptions)
References
Microsoft - Graph Neural Networks: Variations and Applications
(https://www.youtube.com/watch?v=cWIeTMklzNg)
Graph Theory - Adjacency Matrices
(https://www.ebi.ac.uk/training/online/course/network-analysis-protein-interaction-data-
introduction/introduction-graph-theory/graph-0)
DeepMind - AlphaFold
(https://deepmind.com/blog/alphafold/)
Ad

Recommended

[????] Graph Convolutional Network (GCN)
[????] Graph Convolutional Network (GCN)
Donghyeon Kim
?
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Preferred Networks
?
??? - ??? ??? ??
??? - ??? ??? ??
Hyungsoo Ryoo
?
?????? ??? ???
?????? ??? ???
?? ?
?
Graph Neural Network - Introduction
Graph Neural Network - Introduction
Jungwon Kim
?
Wasserstein GAN ?? ???? I
Wasserstein GAN ?? ???? I
Sungbin Lim
?
Introduction to Graph neural networks @ Vienna Deep Learning meetup
Introduction to Graph neural networks @ Vienna Deep Learning meetup
Liad Magen
?
Graph neural networks overview
Graph neural networks overview
Rodion Kiryukhin
?
1???? GAN(Generative Adversarial Network) ?? ????
1???? GAN(Generative Adversarial Network) ?? ????
NAVER Engineering
?
?????? ?? ?
?????? ?? ?
NAVER Engineering
?
rnn BASICS
rnn BASICS
Priyanka Reddy
?
Tips for data science competitions
Tips for data science competitions
Owen Zhang
?
Graph Neural Network in practice
Graph Neural Network in practice
tuxette
?
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
SOYEON KIM
?
Brief intro : Invariance and Equivariance
Brief intro : Invariance and Equivariance
?? ?
?
RoFormer: Enhanced Transformer with Rotary Position Embedding
RoFormer: Enhanced Transformer with Rotary Position Embedding
taeseon ryu
?
Normalization ??
Normalization ??
?? ?
?
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
Hansol Kang
?
グラフデータ分析 入門編
グラフデータ分析 入門編
順也 山口
?
Convolutional neural network from VGG to DenseNet
Convolutional neural network from VGG to DenseNet
SungminYou
?
Introduction to multiple object tracking
Introduction to multiple object tracking
Fan Yang
?
CNN ???? ??? ??? ??? (VGG ?? ??)
CNN ???? ??? ??? ??? (VGG ?? ??)
Lee Seungeun
?
Winning Kaggle 101: Introduction to Stacking
Winning Kaggle 101: Introduction to Stacking
Ted Xiao
?
グラフデータの机械学习における特徴表现の设计と学习
グラフデータの机械学习における特徴表现の设计と学习
Ichigaku Takigawa
?
Graph convolution (スペクトルアプローチ)
Graph convolution (スペクトルアプローチ)
yukihiro domae
?
GAN - Generative Adversarial Nets
GAN - Generative Adversarial Nets
KyeongUkJang
?
[DL輪読会]Energy-based generative adversarial networks
[DL輪読会]Energy-based generative adversarial networks
Deep Learning JP
?
Graph Convolutional Neural Networks
Graph Convolutional Neural Networks
?? ?
?

More Related Content

What's hot (20)

1???? GAN(Generative Adversarial Network) ?? ????
1???? GAN(Generative Adversarial Network) ?? ????
NAVER Engineering
?
?????? ?? ?
?????? ?? ?
NAVER Engineering
?
rnn BASICS
rnn BASICS
Priyanka Reddy
?
Tips for data science competitions
Tips for data science competitions
Owen Zhang
?
Graph Neural Network in practice
Graph Neural Network in practice
tuxette
?
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
SOYEON KIM
?
Brief intro : Invariance and Equivariance
Brief intro : Invariance and Equivariance
?? ?
?
RoFormer: Enhanced Transformer with Rotary Position Embedding
RoFormer: Enhanced Transformer with Rotary Position Embedding
taeseon ryu
?
Normalization ??
Normalization ??
?? ?
?
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
Hansol Kang
?
グラフデータ分析 入門編
グラフデータ分析 入門編
順也 山口
?
Convolutional neural network from VGG to DenseNet
Convolutional neural network from VGG to DenseNet
SungminYou
?
Introduction to multiple object tracking
Introduction to multiple object tracking
Fan Yang
?
CNN ???? ??? ??? ??? (VGG ?? ??)
CNN ???? ??? ??? ??? (VGG ?? ??)
Lee Seungeun
?
Winning Kaggle 101: Introduction to Stacking
Winning Kaggle 101: Introduction to Stacking
Ted Xiao
?
グラフデータの机械学习における特徴表现の设计と学习
グラフデータの机械学习における特徴表现の设计と学习
Ichigaku Takigawa
?
Graph convolution (スペクトルアプローチ)
Graph convolution (スペクトルアプローチ)
yukihiro domae
?
GAN - Generative Adversarial Nets
GAN - Generative Adversarial Nets
KyeongUkJang
?
[DL輪読会]Energy-based generative adversarial networks
[DL輪読会]Energy-based generative adversarial networks
Deep Learning JP
?
Graph Convolutional Neural Networks
Graph Convolutional Neural Networks
?? ?
?
1???? GAN(Generative Adversarial Network) ?? ????
1???? GAN(Generative Adversarial Network) ?? ????
NAVER Engineering
?
Tips for data science competitions
Tips for data science competitions
Owen Zhang
?
Graph Neural Network in practice
Graph Neural Network in practice
tuxette
?
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
SOYEON KIM
?
Brief intro : Invariance and Equivariance
Brief intro : Invariance and Equivariance
?? ?
?
RoFormer: Enhanced Transformer with Rotary Position Embedding
RoFormer: Enhanced Transformer with Rotary Position Embedding
taeseon ryu
?
Normalization ??
Normalization ??
?? ?
?
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
Hansol Kang
?
グラフデータ分析 入門編
グラフデータ分析 入門編
順也 山口
?
Convolutional neural network from VGG to DenseNet
Convolutional neural network from VGG to DenseNet
SungminYou
?
Introduction to multiple object tracking
Introduction to multiple object tracking
Fan Yang
?
CNN ???? ??? ??? ??? (VGG ?? ??)
CNN ???? ??? ??? ??? (VGG ?? ??)
Lee Seungeun
?
Winning Kaggle 101: Introduction to Stacking
Winning Kaggle 101: Introduction to Stacking
Ted Xiao
?
グラフデータの机械学习における特徴表现の设计と学习
グラフデータの机械学习における特徴表现の设计と学习
Ichigaku Takigawa
?
Graph convolution (スペクトルアプローチ)
Graph convolution (スペクトルアプローチ)
yukihiro domae
?
GAN - Generative Adversarial Nets
GAN - Generative Adversarial Nets
KyeongUkJang
?
[DL輪読会]Energy-based generative adversarial networks
[DL輪読会]Energy-based generative adversarial networks
Deep Learning JP
?
Graph Convolutional Neural Networks
Graph Convolutional Neural Networks
?? ?
?

Graph Neural Network (???)