際際滷

際際滷Share a Scribd company logo

OSIS19_Cloud : Performance and power management in virtualized data centers, by Alain Tchana

P担le Systematic Paris-Region
P担le Systematic Paris-Region

My research is in virtualized infrastructure domain. I aim at minimizing electricity consumption while improving application performance. To achieve the first goal, I work both at the entire datacenter level (by providing better VM placement strategies) and at the physical machine level (by providing better power management policies). Concerning the second goal, I work both at the VM monitor level (for minimizing its overhead) and at the VM's operating system (OS) level (for making it aware of the fact that it is virtualized). In this talk I present two contributions of my research team, one for each objective. The first contribution presents Drowsy-DC, a novel way to reduce data center power consumption inspired by smartphones. The second contribution presents XPV (eXtended Para-Virtualization), a new principle for well virtualizing NUMA machines.

1 of 27
Download to read offline
Drowsy-DC: Power management in datacenters inspired by smartphones Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!) Professeur des Universit辿s Universit辿 de Nice Sophia Antipolis (alain.tchana@unice.fr) Joint work with EPFL 1 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
La pr辿vision est une chose di鍖cile surtout lorsquil sagit de lavenir. Winston Churchill 2 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Energy consumption Electricity cost +50% of TCO [Computer11, HP report] Eolas (Grenoble): 5 employees to manage the data center Basic approach: ACPI ACPI de鍖nes both the performance level and the sleep modes of the whole server and its internal components S-, P-, C-, D-states Thus, power management (PM) policies adapt the power consumed by the server according to its utilization rate (e.g. DVFS on CPUs) 3 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Current situation on servers with ACPI 0 20 40 60 80 100 0 50 100 S5 S4S3 S0idle Utilization rate Consumedenergy(%) S5: O鍖; S4: suspend to disk; S3: suspend to RAM; S0: idle. 4 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Current situation on servers with ACPI Reasons Not all server components are individually manageable PM policies are not easy to implement by sysadmins Relation between utilization and energy consumption 5 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Virtualization Almost everywhere (data centers, SDN, NFV, IoT, phones, 5G devices, etc.) Allows optimal resource utilization (colocation) quick deployment (packaging) maintenance with zero downtime (live migration) fault tolerance (checkpointing, live migration) scalability (dynamic resource management) ...(time, square, sta鍖, money) saving 6 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Resource utilization Observation Machines are under-used -20% (e.g., Twitter [ASPLOS14], Amazon [EuroSys10], Microsoft Azure [SOSP17], Eolas, etc.) Because of Resource oversizing Workload variation ACPI limitations 7 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Resource utilization importance Figure: M. Fontoura [SOSP17] 8 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
VM Consolidation 1 Exploit the variability of the workload 2 Dynamically relocate VMs (using migration) 3 Turn-o鍖 empty machines 4 e.g., OpenStack Neat, VMware DRS/DPM 9 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
VM Consolidation Limitations Memory is the most demanded resource type Working set size estimation and prediction is very hard task Thus machines are still under-used (Alibaba traces in 2018, Microsoft Azure [SOSP17]) 10 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
1 (Energy) Drowsy-DC: power mgt. inspired by smartphones [IPDPS19] Collaboration with EPFL 11 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Observation Emergence of Long-Lived, Mostly Idle (LLMI) VMs Always available services [EuroSys16] Very small audience or clear periodicity in usage ski resort web servers, weekly report generation... 1 2 3 4 5 6 10 20 Days Activity(%) Figure: IBM clusters traces 12 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Drowsy Data Center (Drowsy-DC): a new consolidation paradigm Basic idea Instead of consolidating to put empty servers to sleep, consolidate to maximize idle servers and put them to sleep. 13 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Drowsy-DC: basic idea Classic consolidation Drowsy-DC consolidation Goal Put unused hosts to sleep Suspend idle hosts Method Gather workload to Gather workload to maximize unused hosts maximize idle periods 14 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Architecture and prototype (open source) 15 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Idleness-aware VM consolidation Idleness Probability (IP) is computed from the Idleness Model (IM) Consolidate VMs with similar IPs during the next hour how likely is the VM to be idle the nex hour? 16 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Idleness-aware VM consolidation Idleness Model (by studying 308 clusters from Nutanix) Di鍖erent time scales hour in the day (e.g., morning) day in the week (e.g., weekend) day in the month (e.g., end of the month) month in the year (e.g., winter) Example a national diploma results website is mostly used at some speci鍖c hours (2 p.m., 3 p.m.) of a speci鍖c day (20th) of one month (July), every year 17 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Idleness-aware VM consolidation IM is composed of Synthesized Idlenesses and Weights Synthesized Idlenesses (SI): (24 SId , 24 7 SIw , 24 31 SIm, 24 365 SIy ) SId (h): synthesized idleness during h regarding its position in the day SIw (h, dw ): synthesized idleness depending on h and the day of the week dw SIm(h, dm): synthesized idleness depending on h and the day of the month dm SIy (h, dm, m): synthesized idleness depending on h, dm and the month m of the year 18 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Idleness-aware VM consolidation IM is composed of Synthesized Idlenesses and Weights Synthesized Idlenesses (SI): (24 SId , 24 7 SIw , 24 31 SIm, 24 365 SIy ) Weight (wd , ww , wm, and wy ) the importance of the time scale in the IM e.g., a national diploma results website is mostly used at some speci鍖c hours (2 p.m., 3 p.m.) of a speci鍖c day (20th) of one month (July), every year 19 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Idleness-aware VM consolidation IM is composed of Synthesized Idlenesses and Weights Synthesized Idlenesses (SI): (24 SId , 24 7 SIw , 24 31 SIm, 24 365 SIy ) Weight (wd , ww , wm, and wy ) IP(h, dw , dm, m) = wd 揃 SId (h) + ww 揃 SIw (h, dw ) + wm 揃 SIm(h, dm) + wy 揃 SIy (h, dm, m) (1) 20 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Idleness-aware VM consolidation Computation of w and other details in [IPDPS19] 21 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Server wakeup optimizations Envoi ordre r辿veil R辿ception ordre r辿veil R辿veil mat辿riel R辿veil OS Firmware (470ms) R辿veil CPU R辿veil p辿riph辿riques D辿but r辿initialisation carte r辿seau OS op辿rationnel Noyau (190ms) Lien Ethernet 辿tabli Reset carte r辿seau (1,3s) R辿seau op辿rationnel Processus ordonnanc辿 50ms Latence de r辿veil totale du service (~2s) Optimizations Kernel select only needed drivers and CPUs Network device use "critical section" to eliminate reset 22 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Low scale experiments 5 HP machines, consume about 10% energy in S3 6 LLMI VMs (VM3-8), initially spread 2 LLMU VMs (VM1-2), initially spread 1 2 3 4 5 6 10 20 Days Activity(%) VM3, VM4 VM6 Figure: IBM clusters traces 23 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Low scale experiments: Results Figure: Colocation percentage of each VM black cells: V1 and V2 were LLMU VMs; dark gray cells: V3 and V4 received the same workload. Last column is the number of migrations a VM experienced. 24 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Low scale experiments: Results Algorithm P2 P3 P4 P5 Global Drowsy-DC 0 94 79 91 66 OpenStack Neat 89 7 8 93 49 Table: Fraction of time (percent) spent by hosts in suspended power state, with Drowsy-DC and with Neat 25 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Large scale experiments: Energy saving on Google traces ( 12.000 machines) 10 20 30 40 50 60 70 80 90 2 4 6 8 揃103 LLMI VM proportion in the datacenter (%) Powerconsumption(kWh) Neat Neat+S3 Oasis Drowsy-DC Figure: Drowsy-DC: 76% - 81% energy savings compared to OpenStack Neat 26 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
Ceux qui ne savent pas o湛 ils vont , sont surpris darriver ailleurs. Pierre Dac 27 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)

More Related Content

OSIS19_Cloud : Performance and power management in virtualized data centers, by Alain Tchana

  • 1. Drowsy-DC: Power management in datacenters inspired by smartphones Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!) Professeur des Universit辿s Universit辿 de Nice Sophia Antipolis (alain.tchana@unice.fr) Joint work with EPFL 1 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 2. La pr辿vision est une chose di鍖cile surtout lorsquil sagit de lavenir. Winston Churchill 2 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 3. Energy consumption Electricity cost +50% of TCO [Computer11, HP report] Eolas (Grenoble): 5 employees to manage the data center Basic approach: ACPI ACPI de鍖nes both the performance level and the sleep modes of the whole server and its internal components S-, P-, C-, D-states Thus, power management (PM) policies adapt the power consumed by the server according to its utilization rate (e.g. DVFS on CPUs) 3 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 4. Current situation on servers with ACPI 0 20 40 60 80 100 0 50 100 S5 S4S3 S0idle Utilization rate Consumedenergy(%) S5: O鍖; S4: suspend to disk; S3: suspend to RAM; S0: idle. 4 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 5. Current situation on servers with ACPI Reasons Not all server components are individually manageable PM policies are not easy to implement by sysadmins Relation between utilization and energy consumption 5 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 6. Virtualization Almost everywhere (data centers, SDN, NFV, IoT, phones, 5G devices, etc.) Allows optimal resource utilization (colocation) quick deployment (packaging) maintenance with zero downtime (live migration) fault tolerance (checkpointing, live migration) scalability (dynamic resource management) ...(time, square, sta鍖, money) saving 6 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 7. Resource utilization Observation Machines are under-used -20% (e.g., Twitter [ASPLOS14], Amazon [EuroSys10], Microsoft Azure [SOSP17], Eolas, etc.) Because of Resource oversizing Workload variation ACPI limitations 7 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 8. Resource utilization importance Figure: M. Fontoura [SOSP17] 8 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 9. VM Consolidation 1 Exploit the variability of the workload 2 Dynamically relocate VMs (using migration) 3 Turn-o鍖 empty machines 4 e.g., OpenStack Neat, VMware DRS/DPM 9 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 10. VM Consolidation Limitations Memory is the most demanded resource type Working set size estimation and prediction is very hard task Thus machines are still under-used (Alibaba traces in 2018, Microsoft Azure [SOSP17]) 10 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 11. 1 (Energy) Drowsy-DC: power mgt. inspired by smartphones [IPDPS19] Collaboration with EPFL 11 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 12. Observation Emergence of Long-Lived, Mostly Idle (LLMI) VMs Always available services [EuroSys16] Very small audience or clear periodicity in usage ski resort web servers, weekly report generation... 1 2 3 4 5 6 10 20 Days Activity(%) Figure: IBM clusters traces 12 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 13. Drowsy Data Center (Drowsy-DC): a new consolidation paradigm Basic idea Instead of consolidating to put empty servers to sleep, consolidate to maximize idle servers and put them to sleep. 13 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 14. Drowsy-DC: basic idea Classic consolidation Drowsy-DC consolidation Goal Put unused hosts to sleep Suspend idle hosts Method Gather workload to Gather workload to maximize unused hosts maximize idle periods 14 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 15. Architecture and prototype (open source) 15 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 16. Idleness-aware VM consolidation Idleness Probability (IP) is computed from the Idleness Model (IM) Consolidate VMs with similar IPs during the next hour how likely is the VM to be idle the nex hour? 16 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 17. Idleness-aware VM consolidation Idleness Model (by studying 308 clusters from Nutanix) Di鍖erent time scales hour in the day (e.g., morning) day in the week (e.g., weekend) day in the month (e.g., end of the month) month in the year (e.g., winter) Example a national diploma results website is mostly used at some speci鍖c hours (2 p.m., 3 p.m.) of a speci鍖c day (20th) of one month (July), every year 17 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 18. Idleness-aware VM consolidation IM is composed of Synthesized Idlenesses and Weights Synthesized Idlenesses (SI): (24 SId , 24 7 SIw , 24 31 SIm, 24 365 SIy ) SId (h): synthesized idleness during h regarding its position in the day SIw (h, dw ): synthesized idleness depending on h and the day of the week dw SIm(h, dm): synthesized idleness depending on h and the day of the month dm SIy (h, dm, m): synthesized idleness depending on h, dm and the month m of the year 18 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 19. Idleness-aware VM consolidation IM is composed of Synthesized Idlenesses and Weights Synthesized Idlenesses (SI): (24 SId , 24 7 SIw , 24 31 SIm, 24 365 SIy ) Weight (wd , ww , wm, and wy ) the importance of the time scale in the IM e.g., a national diploma results website is mostly used at some speci鍖c hours (2 p.m., 3 p.m.) of a speci鍖c day (20th) of one month (July), every year 19 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 20. Idleness-aware VM consolidation IM is composed of Synthesized Idlenesses and Weights Synthesized Idlenesses (SI): (24 SId , 24 7 SIw , 24 31 SIm, 24 365 SIy ) Weight (wd , ww , wm, and wy ) IP(h, dw , dm, m) = wd 揃 SId (h) + ww 揃 SIw (h, dw ) + wm 揃 SIm(h, dm) + wy 揃 SIy (h, dm, m) (1) 20 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 21. Idleness-aware VM consolidation Computation of w and other details in [IPDPS19] 21 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 22. Server wakeup optimizations Envoi ordre r辿veil R辿ception ordre r辿veil R辿veil mat辿riel R辿veil OS Firmware (470ms) R辿veil CPU R辿veil p辿riph辿riques D辿but r辿initialisation carte r辿seau OS op辿rationnel Noyau (190ms) Lien Ethernet 辿tabli Reset carte r辿seau (1,3s) R辿seau op辿rationnel Processus ordonnanc辿 50ms Latence de r辿veil totale du service (~2s) Optimizations Kernel select only needed drivers and CPUs Network device use "critical section" to eliminate reset 22 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 23. Low scale experiments 5 HP machines, consume about 10% energy in S3 6 LLMI VMs (VM3-8), initially spread 2 LLMU VMs (VM1-2), initially spread 1 2 3 4 5 6 10 20 Days Activity(%) VM3, VM4 VM6 Figure: IBM clusters traces 23 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 24. Low scale experiments: Results Figure: Colocation percentage of each VM black cells: V1 and V2 were LLMU VMs; dark gray cells: V3 and V4 received the same workload. Last column is the number of migrations a VM experienced. 24 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 25. Low scale experiments: Results Algorithm P2 P3 P4 P5 Global Drowsy-DC 0 94 79 91 66 OpenStack Neat 89 7 8 93 49 Table: Fraction of time (percent) spent by hosts in suspended power state, with Drowsy-DC and with Neat 25 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 26. Large scale experiments: Energy saving on Google traces ( 12.000 machines) 10 20 30 40 50 60 70 80 90 2 4 6 8 揃103 LLMI VM proportion in the datacenter (%) Powerconsumption(kWh) Neat Neat+S3 Oasis Drowsy-DC Figure: Drowsy-DC: 76% - 81% energy savings compared to OpenStack Neat 26 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)
  • 27. Ceux qui ne savent pas o湛 ils vont , sont surpris darriver ailleurs. Pierre Dac 27 / 27 Alain Tchana (Ne fais pas dIA et ne souhaite pas en faire!)