際際滷

際際滷Share a Scribd company logo
New Project Meteos :
Machine Learning as a Service
Hiroyuki Eguchi @NEC
Digambar Patil @Persistent Systems
Sharat Sharma @NEC
2 息 NEC Corporation 2017 NEC Group Internal Use Only
What is Machine Learning ?
3 息 NEC Corporation 2017 NEC Group Internal Use Only
What Does a Machine Learning Do?
Learning
Evaluation
Prediction
3 steps in Machine Learning
Learn from amount of data
and create Prediction Model
Evaluate accuracy of
Prediction Model
Input value to Prediction
Model and retrieve
predicted Data
4 息 NEC Corporation 2017 NEC Group Internal Use Only
Step 1 : Learning
Prediction Model
Training Dataset
(Past Email Data)
Example : Predict incoming mail is spam or not

Ham/Spam Body of Mail
Ham
I would like to set up a meeting by
below schedule. ...
Ham
Please send your bill to the followong
address. ...
Spam
SIX chances to win CASH! From 100
to 20,000 ...
Ham
Due to the Boston summit, we will skip
the IRC meetings ..
Spam
URGENT! You have won a 1 week
FREE membership in our ...
Ham Sorry, I'll call later in meeting. ..
5 息 NEC Corporation 2017 NEC Group Internal Use Only
Step 2 : Evaluation
Prediction Model
(Created at the previous step)
Test Dataset
(Past Email Data)
Model Evaluation
Accuracy ??%
Comparison
Ham/Spam Body of Mail
Hum
I want to have them by one week
earlier day/month ...
Spam
Here is your discount code
RP176781. To stop further ...
Hum
I would like to place an order for
the following. ...
Ham/Spam Body of Mail
Predicted
Result
Hum
I want to have them by one
week earlier day/month ...
Hum
Spam
Here is your discount code
RP176781. To stop further
...
Spam
Hum
I would like to place an order
for the following. ...
Spam
6 息 NEC Corporation 2017 NEC Group Internal Use Only
Step 3 : Prediction
Prediction Model
(Evaluated at the previous step)Input Value
(Incoming Mail)
Body of Mail
You have WON a guaranteed 1000 cash
or a 2000 prize. To claim ...
Body of Mail
Predicted
Result
You have WON a guaranteed 1000
cash or a 2000 prize. To claim ...
Spam
7 息 NEC Corporation 2017 NEC Group Internal Use Only
Machine Learning Algorithms
Classification Algorithm
(e.g) Spam Mail Detection, Predict weather it will rain or not
Regression Algorithm
(e.g) Predict Stock Price, Predict sales figures
Anomaly Detection Algorithm
(e.g) Credit card fraud detection
Clustering Algorithm
(e.g) Classify users by skill
Recommendation Algorithm
(e.g) Recommend Movie by similar user's preference
8 息 NEC Corporation 2017 NEC Group Internal Use Only
Architecture
Raw
Data
Input Data
Dataset
Experiment
meteos-ui
meteos-engine
Swift
Nova
Sahara
Glance Neutron
RabbitMQ
meteos-api
Upload
Raw Data
Create
Experiment Download
& Parse
DataSet
Create
& Evaluate
Model
Input Data Retrieve
Predicted
Data
Output
Data
Prediction Model
9 息 NEC Corporation 2017 NEC Group Internal Use Only
Demo1
(Spam Mail Detection)
10 息 NEC Corporation 2017 NEC Group Internal Use Only
Demo2
(Movie Recommendation)
11 息 NEC Corporation 2017 NEC Group Internal Use Only
Recommend Movie using Recommendation Model
User
Movie
1
Movie
2
Movie
3
Movie
4
1 -
2
3 -
4
5 -
6
Prediction Model
(Predict a rating of movie)
Training Dataset
(Movie Ratings Data)
User
Movie
1
Movie
2
Movie
3
Movie
4
6 ?
12 息 NEC Corporation 2017 NEC Group Internal Use Only
Current Status
Development Plan
13 息 NEC Corporation 2017 NEC Group Internal Use Only
Current Status
Preparing first stable release
Support Apache Spark ver 1.6 as a first target
14 息 NEC Corporation 2017 NEC Group Internal Use Only
Development Plan
Add Plugins
Apache Spark ver 2.0
Tensorflow
汲
Add Documentations
Envision to be a Big Tent Project in R release cycle
15 息 NEC Corporation 2017 NEC Group Internal Use Only
Conclusion
OpenStack Meteos Wiki
https://wiki.openstack.org/wiki/Meteos
Getting Started with Meteos
https://wiki.openstack.org/wiki/Meteos/Devstack
IRC
#openstack-meteos
Etherpad
https://etherpad.openstack.org/p/openstack-meteos

More Related Content

OpenStack Meteos (Machine Learning as a Service)

  • 1. New Project Meteos : Machine Learning as a Service Hiroyuki Eguchi @NEC Digambar Patil @Persistent Systems Sharat Sharma @NEC
  • 2. 2 息 NEC Corporation 2017 NEC Group Internal Use Only What is Machine Learning ?
  • 3. 3 息 NEC Corporation 2017 NEC Group Internal Use Only What Does a Machine Learning Do? Learning Evaluation Prediction 3 steps in Machine Learning Learn from amount of data and create Prediction Model Evaluate accuracy of Prediction Model Input value to Prediction Model and retrieve predicted Data
  • 4. 4 息 NEC Corporation 2017 NEC Group Internal Use Only Step 1 : Learning Prediction Model Training Dataset (Past Email Data) Example : Predict incoming mail is spam or not Ham/Spam Body of Mail Ham I would like to set up a meeting by below schedule. ... Ham Please send your bill to the followong address. ... Spam SIX chances to win CASH! From 100 to 20,000 ... Ham Due to the Boston summit, we will skip the IRC meetings .. Spam URGENT! You have won a 1 week FREE membership in our ... Ham Sorry, I'll call later in meeting. ..
  • 5. 5 息 NEC Corporation 2017 NEC Group Internal Use Only Step 2 : Evaluation Prediction Model (Created at the previous step) Test Dataset (Past Email Data) Model Evaluation Accuracy ??% Comparison Ham/Spam Body of Mail Hum I want to have them by one week earlier day/month ... Spam Here is your discount code RP176781. To stop further ... Hum I would like to place an order for the following. ... Ham/Spam Body of Mail Predicted Result Hum I want to have them by one week earlier day/month ... Hum Spam Here is your discount code RP176781. To stop further ... Spam Hum I would like to place an order for the following. ... Spam
  • 6. 6 息 NEC Corporation 2017 NEC Group Internal Use Only Step 3 : Prediction Prediction Model (Evaluated at the previous step)Input Value (Incoming Mail) Body of Mail You have WON a guaranteed 1000 cash or a 2000 prize. To claim ... Body of Mail Predicted Result You have WON a guaranteed 1000 cash or a 2000 prize. To claim ... Spam
  • 7. 7 息 NEC Corporation 2017 NEC Group Internal Use Only Machine Learning Algorithms Classification Algorithm (e.g) Spam Mail Detection, Predict weather it will rain or not Regression Algorithm (e.g) Predict Stock Price, Predict sales figures Anomaly Detection Algorithm (e.g) Credit card fraud detection Clustering Algorithm (e.g) Classify users by skill Recommendation Algorithm (e.g) Recommend Movie by similar user's preference
  • 8. 8 息 NEC Corporation 2017 NEC Group Internal Use Only Architecture Raw Data Input Data Dataset Experiment meteos-ui meteos-engine Swift Nova Sahara Glance Neutron RabbitMQ meteos-api Upload Raw Data Create Experiment Download & Parse DataSet Create & Evaluate Model Input Data Retrieve Predicted Data Output Data Prediction Model
  • 9. 9 息 NEC Corporation 2017 NEC Group Internal Use Only Demo1 (Spam Mail Detection)
  • 10. 10 息 NEC Corporation 2017 NEC Group Internal Use Only Demo2 (Movie Recommendation)
  • 11. 11 息 NEC Corporation 2017 NEC Group Internal Use Only Recommend Movie using Recommendation Model User Movie 1 Movie 2 Movie 3 Movie 4 1 - 2 3 - 4 5 - 6 Prediction Model (Predict a rating of movie) Training Dataset (Movie Ratings Data) User Movie 1 Movie 2 Movie 3 Movie 4 6 ?
  • 12. 12 息 NEC Corporation 2017 NEC Group Internal Use Only Current Status Development Plan
  • 13. 13 息 NEC Corporation 2017 NEC Group Internal Use Only Current Status Preparing first stable release Support Apache Spark ver 1.6 as a first target
  • 14. 14 息 NEC Corporation 2017 NEC Group Internal Use Only Development Plan Add Plugins Apache Spark ver 2.0 Tensorflow 汲 Add Documentations Envision to be a Big Tent Project in R release cycle
  • 15. 15 息 NEC Corporation 2017 NEC Group Internal Use Only Conclusion OpenStack Meteos Wiki https://wiki.openstack.org/wiki/Meteos Getting Started with Meteos https://wiki.openstack.org/wiki/Meteos/Devstack IRC #openstack-meteos Etherpad https://etherpad.openstack.org/p/openstack-meteos

Editor's Notes