際際滷

際際滷Share a Scribd company logo
Cluster as a Service: dodai


                          2012.10.16

                          Xiaohua Guan
                          NTT DATA INTELLILINK
At the beginning

 etherpad
   
     http://etherpad.openstack.org/grizzly-dodai


    slideshare
     




                                                   2
Agenda

 dodai

 dodai-deploy

 dodai-compute

 Demo of install as a service




                                 3
Whats dodai

 Its CaaS(Cluster as a Service)

 dodai = dodai-deploy + dodai-compute




                                         4
CaaS : Cluster as a Service

                        Clusters for each private cloud
Elastic         Private cloud - A    Private cloud - B   Private cloud - C
Private
Cloud                                              Return servers
                                                   to server pool
          Allocate servers
          from server pool




                                    Server pool

                                                                             5
dodai = dodai-deploy + dodai-compute




                                       6
Whats dodai-deploy?

 A software     management tool for
  distributed environment
 With license Apache2
 Please visit
 http://github.com/nii-cloud/dodai-deploy




                                            7
History of dodai-deploy




                          8
Whats the features

 Its a Framework
 Its Fast
 Its Scalable
 Its Easy to use




                      9
Its a Framework

 Provide templates for various softwares
   Openstack
   Hadoop
   SGE
   Eucalyptus

 Templates are customizable by user

 Templates can be added by user




                                            10
Its Fast

 Deploy parallelly in distributed environment
   Considering dependencies of components
     nova-api depends on mysql server.

                           hadoop installation time

                   70

                   60

                   50

                   40
    time(second)
                   30

                   20

                   10

                   0
                       0   1   2     3      4       5    6   7   8

                                   number of data node




                                                                     11
Its Scalable

 dodai-deploy server can be scaled such as 




                                                12
Its easy to use

 Web UI




 CLI commands
  script/cli.rb SERVER RESOURCE ACTION [PARAM1 PARAM2 ]

 REST APIs
  Provide REST APIs simulator in WEB UI. Enjoy it.




                                                            13
How does dodai-deploy work?




                                      MCollective

                dodai-deploy server   puppet
Ruby on Rails



                dodai-deploy nodes


                                                    14
More details




               15
Whats new today

 Install as a Service

 Support for Multi-OSes

 Support for Folsom




                           16
Install as a Service

 Provide installation of softwares as a service

 No longer installation of dodai-deploy server
   Global dodai-deploy server

 Add nodes belongs to user

 User defined proposals(templates)




                                                   17
Install as a Service




                       18
Install as a Service




                       19
Multi-OSes

 Support for CentOS
  With same UI, but different set up scripts for dodai-deploy
  setup-env.centos/setup.sh 

 Support OpenStack Essex CentOS now




                                                                 20
Support for Folsom

 Folsom Release
  Compute
     Nova
     Horizon
     Quantum
     Cinder
  Glance
  Keystone




                     21
What's the next of dodai-deploy

 Construct a global server to provide "Install as a Service"

 Provide more templates for popular softwares

 Add function to upload the template of new software




                                                                22
Whats dodai-compute?


    Bare metal version of nova(diablo)
 With license Apache2

 Please visit
    http://github.com/nii-cloud/dodai-compute




                                                23
Whats features?

 Provide the same interface with nova to operate on
  physical machines.

 Prepare installed machines in resource pool.

 Separate network logically with OpenFlow switch.




                                                       24
Whats inside dodai-compute



                                OpenFlow
modified nova                   controller




         cobbler
                                OpenFlow
                                switch

                                         25
Whats the next of dodai-compute

 Shorten the time of installation
   With kexec to bypass BIOS, shorten the time from
    10'15 to 1'30

 Provide console of physical machine to users
   Implement with SOL(Serial on LAN)            of
   IPMI

 Start machine with Wake on LAN




                                                       26
Demo: Install as a Service

 Construct a multiple compute nodes openstack folsom
  cloud on EC2
  nova-compute node X 3
  others X 1
 Steps
  1. register a new user
  2. create instances on EC2 and add as nodes
  3. create a proposal
  4. install
  5. test
  6. use dashboard




                                                        27
Summary

 dodai
  CaaS

 dodai-deploy
  http://github.com/nii/dodai-deploy
  Multiple OSes supported (Ubuntu, CentOS)
  Install as a Service
  Folsom supported

 dodai-compute
  http://github.com/nii/dodai-compute
  Bare metal version of nova
  Minimize installation time with kexec
  Provide console of machine to user with IPMI's SOL



                                                        28
Questions?




             29
Thank you very much!




                       30

More Related Content

dodai grizzly

  • 1. Cluster as a Service: dodai 2012.10.16 Xiaohua Guan NTT DATA INTELLILINK
  • 2. At the beginning etherpad http://etherpad.openstack.org/grizzly-dodai slideshare 2
  • 3. Agenda dodai dodai-deploy dodai-compute Demo of install as a service 3
  • 4. Whats dodai Its CaaS(Cluster as a Service) dodai = dodai-deploy + dodai-compute 4
  • 5. CaaS : Cluster as a Service Clusters for each private cloud Elastic Private cloud - A Private cloud - B Private cloud - C Private Cloud Return servers to server pool Allocate servers from server pool Server pool 5
  • 6. dodai = dodai-deploy + dodai-compute 6
  • 7. Whats dodai-deploy? A software management tool for distributed environment With license Apache2 Please visit http://github.com/nii-cloud/dodai-deploy 7
  • 9. Whats the features Its a Framework Its Fast Its Scalable Its Easy to use 9
  • 10. Its a Framework Provide templates for various softwares Openstack Hadoop SGE Eucalyptus Templates are customizable by user Templates can be added by user 10
  • 11. Its Fast Deploy parallelly in distributed environment Considering dependencies of components nova-api depends on mysql server. hadoop installation time 70 60 50 40 time(second) 30 20 10 0 0 1 2 3 4 5 6 7 8 number of data node 11
  • 12. Its Scalable dodai-deploy server can be scaled such as 12
  • 13. Its easy to use Web UI CLI commands script/cli.rb SERVER RESOURCE ACTION [PARAM1 PARAM2 ] REST APIs Provide REST APIs simulator in WEB UI. Enjoy it. 13
  • 14. How does dodai-deploy work? MCollective dodai-deploy server puppet Ruby on Rails dodai-deploy nodes 14
  • 16. Whats new today Install as a Service Support for Multi-OSes Support for Folsom 16
  • 17. Install as a Service Provide installation of softwares as a service No longer installation of dodai-deploy server Global dodai-deploy server Add nodes belongs to user User defined proposals(templates) 17
  • 18. Install as a Service 18
  • 19. Install as a Service 19
  • 20. Multi-OSes Support for CentOS With same UI, but different set up scripts for dodai-deploy setup-env.centos/setup.sh Support OpenStack Essex CentOS now 20
  • 21. Support for Folsom Folsom Release Compute Nova Horizon Quantum Cinder Glance Keystone 21
  • 22. What's the next of dodai-deploy Construct a global server to provide "Install as a Service" Provide more templates for popular softwares Add function to upload the template of new software 22
  • 23. Whats dodai-compute? Bare metal version of nova(diablo) With license Apache2 Please visit http://github.com/nii-cloud/dodai-compute 23
  • 24. Whats features? Provide the same interface with nova to operate on physical machines. Prepare installed machines in resource pool. Separate network logically with OpenFlow switch. 24
  • 25. Whats inside dodai-compute OpenFlow modified nova controller cobbler OpenFlow switch 25
  • 26. Whats the next of dodai-compute Shorten the time of installation With kexec to bypass BIOS, shorten the time from 10'15 to 1'30 Provide console of physical machine to users Implement with SOL(Serial on LAN) of IPMI Start machine with Wake on LAN 26
  • 27. Demo: Install as a Service Construct a multiple compute nodes openstack folsom cloud on EC2 nova-compute node X 3 others X 1 Steps 1. register a new user 2. create instances on EC2 and add as nodes 3. create a proposal 4. install 5. test 6. use dashboard 27
  • 28. Summary dodai CaaS dodai-deploy http://github.com/nii/dodai-deploy Multiple OSes supported (Ubuntu, CentOS) Install as a Service Folsom supported dodai-compute http://github.com/nii/dodai-compute Bare metal version of nova Minimize installation time with kexec Provide console of machine to user with IPMI's SOL 28
  • 30. Thank you very much! 30