際際滷

際際滷Share a Scribd company logo
Generative modeling
beyond creepy GIFs in Twitter
Alexandr Honchar
 AI architect @ Mawi Solutions
 AI consultant @ CIS, EU
 Masters in maths candidate @
University of Verona
 Blogger @ Medium
Why GANs today?
https://twitter.com/goodfellow_ian/status/969776035649675265
https://medium
.com/@LeonFe
dden/learning-
london-dating-
profiles-
8f13403af1d9
https://blog.openai.com/glow/
Random artists from Twitter, Telegram
https://njustesen.
com/2018/11/13/a
n-exploring-of-
biggans-
truncation-
threshold-to-
create-artistic-
horrific-images-
of-masks/
https://twitter.
com/_joelsim
on/status/106
824357076584
8581
https://www.chri
sties.com/featur
es/A-
collaboration-
between-two-
artists-one-
human-one-a-
machine-9332-
1.aspx
But I dont need all that!
I am serious guy who needs data science to earn money, not Twitter likes
Generative vs discriminative ML
A bit of scary mathematics (no)
Space of cats and dogs
A very deep neural network
already created some nice
embedding space for us from
initial pixel space
Discriminative modeling:
A function f(x, w) telling us where
new x belongs to from {cat, dog}
Generative modeling:
A modeled distribution P(x|y),
where x - our data point and y
belongs to {cat, dog}
So, we can or create new cat from
P(x|y=cat), or check if some x_i
belongs to P(x_i|y=dog) using
well known maths
Generative modeling:
A modeled distribution P(x|y),
where x - our data point and y
belongs to {cat, dog}
So, we can or create new cat from
P(x|y=cat), or check if some x_i
belongs to P(x_i|y=dog) using
well known maths
Natural manifold hypothesis:
real-world high dimensional data
(such as images) lie on low-
dimensional manifolds embedded
in the high-dimensional space
Short tails, a little fur
Long tails, a lot of fur
Not only images!
Video game level generation
Text generation
Drug molecule generation, Insilico
Music generation, Google Magenta
P(X)
What value has generation of objects?
GAN for business value @ Data Science Milan
The RAPIDD Ebola
forecasting challenge: Model
description and synthetic
data generation
GAN-based Synthetic Medical Image Augmentation for
increased CNN Performance in Liver Lesion
Classification
IoT data generation, aidrome
Short tails, a little fur
Long tails, a lot of fur
TL-GAN: transparent latent-space GAN
Medical Image Synthesis for Data
Augmentation and Anonymization using
Generative Adversarial Networks
Numerai / Erasure for financial data
prediction
~P(X)
What are all other objects?
GAN for business value @ Data Science Milan
https://skymind.ai/wiki/deep-autoencoder
https://www.researchgate.net/figure/Gene
rative-Adversarial-Network-
GAN_fig1_317061929
P(X) -> P(Y)
What value has turning some objects to another ones?
https://docs.neptune.ml/get-started/style-transfer/
X Y
P(X) ->
P(Y)
CycleGAN
https://cari-gan.github.io
Everybody Dance Now
Short tails, a little fur
Long tails, a lot of fur
 Voice from the phone <-> Voice from HQ mic, SEGAN
 ECG from hospital <-> ECG from a wristband, Mawi
 Official text <-> Funny text, MaskGAN
 Dressed person <-> Naked person, DeepFakes
 CCTV camera <-> HD camera
8x8 to 128x128 Super Resolution with Adversarial Autoencoders
Takeaways
 Generative modeling >= Discriminative modeling
 I do not understand things which I cannot create
 We need to share data to third parties
 We need to manipulate our data with simple factors
 We need anomaly detectors and reject options
 We need to adapt our data for some conditions
FACEBOOK: @rachnogstyle
MEDIUM / TWITTER: @alexrachnog
alex@mawi.band

More Related Content

GAN for business value @ Data Science Milan