Abstract
One of the main driving forces of the growing adoption of virtualization is its dramatic simplification of the provisioning and dynamic management of IT resources. By decoupling running entities from the underlying physical resources, and by providing easy-to-use controls to allocate, deallocate and migrate virtual machines (VMs) across physical boundaries, virtualization opens up new opportunities for improving overall system resource use and power efficiency. While a range of techniques for dynamic, distributed resource management of virtualized systems have been proposed and have seen their widespread adoption in enterprise systems, similar techniques for dynamic power management have seen limited acceptance. The main barrier to dynamic, power-aware virtualization management stems not from the limitations of virtualization, but rather from the underlying physical systems; and in particular, the high latency and energy cost of power state change actions suited for virtualization power management.
In this work, we first explore the feasibility of low-latency power states for enterprise server systems and demonstrate, with real prototypes, their quantitative energy-performance trade offs compared to traditional server power states. Then, we demonstrate an end-to-end power-aware virtualization management solution leveraging these states, and evaluate the dramatically-favorable power-performance characteristics achievable with such systems. We present, via both real system implementations and scale-out simulations, that virtualization power management with low-latency server power states can achieve comparable overheads as base distributed resource management in virtualized systems, and thus can benefit from the same level of adoption, while delivering close to energy-proportional power efficiency.
- M. Annavaram, E. Grochowski, and J. Shen. Mitigating Amdahl's Law Through EPI Throttling. In Proceedings of the 32nd International Symposium on Computer Architecture (ISCA-32), 2005. Google ScholarDigital Library
- Arch Linux. Pm-utils. https://wiki.archlinux.org/index.php/Pm-utils, 2012.Google Scholar
- L. A. Barroso. The Price of Performance. ACM Queue, 3(7):48--53, Sept. 2005. Google ScholarDigital Library
- R. Bianchini, I. Goiri, K. Le, and T. Nguyen. Parasol: A solar-powered datacenter. In ACM European Conference on Computer Systems (Eurosys), 2012.Google Scholar
- N. Bila, E. de Lara, K. Joshi, H. A. Lagar-Cavilla, M. Hiltunen, and M. Satyanarayanan. Jettison: Efficient Idle Desktop Consolidation with Partial VM Migration. In European Conference on Computer Systems (Eurosys), 2012. Google ScholarDigital Library
- T. Brey, B. Bigelow, J. Bolan, H. Cheselka, Z. Dayar, J. Franke, D. Johnson, R. Kantesaria, E. Klodnicki, S. Kochar, et al. Blade-Center Chassis Management. IBM Journal of Research and Development, 49(6):941--961, 2005. Google ScholarDigital Library
- L. Brown, A. Keshavamurthy, D. S. Li, R. Moore, V. Pallipadi, and L. Yu. ACPI in Linux. In Linux Symposium (OLS), 2005.Google Scholar
- M. Cardosa, M. Korupolu, and A. Singh. Shares and Utilities based Power Consolidation in Virtualized Server Environments. In IFIP/IEEE International Symposium on Integrated Network Management (IM), 2009. Google ScholarDigital Library
- J. S. Chase, D. C. Anderson, P. N. Thakar, A. N. Vahdat, and R. P. Doyle. Managing energy and server resources in hosting centers. In Proc. 18th Symposium on Operating Systems Principles (SOSP), 2001. Google ScholarDigital Library
- T. Das, P. Padala, V. Padmanabhan, R. Ramjee, and K. Shin. LiteGreen: Saving energy in networked desktops using virtualization. In USENIX ATC, 2010. Google ScholarDigital Library
- A. Gandhi, M. Harchol-Balter, R. Das, J. Kephart, and C. Lefurgy. Power Capping via Forced Idleness. In Workshop on Energy-Efficient Design (WEED), 2009.Google Scholar
- A. Gandhi, M. Harchol-Balter, and M. Kozuch. The Case for Sleep States in Servers. In SOSP 4th Workshop on Power-Aware Computing and Systems (HotPower 2011), 2011. Google ScholarDigital Library
- A. Gandhi, M. Harchol-Balter, and M. Kozuch. Are sleep states effective in data centers? In 2012 International Green Computing Conference (IGCC), 2012. Google ScholarDigital Library
- A. Gandhi, M. Harchol-Balter, R. Raghunathan, and M. Kozuch. AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers. Transactions on Computer Systems, 30(4), 2012. Google ScholarDigital Library
- I. Goiri, K. Le, M. Haque, R. Beauchea, T. Nguyen, J. Guitart, J. Torres, and R. Bianchini. GreenSlot: Scheduling Energy Consumption in Green Datacenters. In 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2011), 2011. Google ScholarDigital Library
- J. Hanson, I. Whalley, M. Steinder, and J. Kephart. Multi-aspect Hardware Management in Enterprise Server Consolidation. In IEEE/IFIP Network Operations and Management Symposium (NOMS), 2010.Google Scholar
- Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba. Advanced configuration and power interface specification. http://www.acpi.info, September 2004.Google Scholar
- C. Isci, G. Contreras, and M. Martonosi. Live, Runtime Phase Monitoring and Prediction on Real Systems with Application to Dynamic Power Management. In Proceedings of the 39th ACM/IEEE International Symposium on Microarchitecture (MICRO-39), 2006. Google ScholarDigital Library
- C. Isci, J. Hanson, I. Whalley, M. Steinder, and J. Kephart. Run-time Demand Estimation for Effective Dynamic Resource Management. In IEEE/IFIP Network Operations and Management Symposium (NOMS), 2010.Google Scholar
- C. Isci, J. Liu, B. Abali, J. Kephart, and J. Kouloheris. Improving Server Utilization Using Fast Virtual Machine Migration. IBM Journal of Research and Development, 55(6), 2011. Google ScholarDigital Library
- Jeffrey Nowicki and Andy Arhelger. Optimizing Virtual Infrastructure with PowerVM and the IBM Systems Director VMControl. Whitepaper, IBM Systems and Technology Group, 2010.Google Scholar
- H. Jiang, M. Marek-Sadowska, and S. R. Nassif. Benefits and Costs of Power-Gating Technique. In IEEE International Conference on Computer Design (ICCD), 2005. Google ScholarDigital Library
- A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: the linux virtual machine monitor. In Ottawa Linux Symposium (OLS), 2007.Google Scholar
- J. G. Koomey. Estimating total power consumption by servers in the U.S. and the world, 2007.Google Scholar
- D. Kusic, J. O. Kephart, J. E. Hanson, N. Kandasamy, and G. Jiang. Power and Performance Management of Virtualized Computing Environments Via Lookahead Control. In Proceedings of the International Conference on Autonomic Computing, 2008. Google ScholarDigital Library
- E. Le Sueur and G. Heiser. Slow Down or Sleep, That is the Question. In USENIX Annual Technical Conference, 2011. Google ScholarDigital Library
- J. Lee and N. Kim. Optimizing Throughput of Power and thermal Constrained Multicore Processors Using DVFS and Per-core Power Gating. In Design Automation Conference (DAC), 2009. Google ScholarDigital Library
- D. Meisner, B. T. Gold, and T. F. Wenisch. PowerNap: Eliminating Server Idle Power. In International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2009. Google ScholarDigital Library
- D. Meisner and T. Wenisch. DreamWeaver: Architectural Support for Deep Sleep. In International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2012. Google ScholarDigital Library
- X. Meng, C. Isci, J. Kephart, L. Zhang, E. Bouillet, and D. Pen-darakis. Efficient resource provisioning in compute clouds via vm multiplexing. In IEEE International Conference on Autonomic Computing (ICAC), 2010. Google ScholarDigital Library
- J. Moore, J. Chase, and P. Ranganathan. Making scheduling "cool": Temperature-aware workload placement in data centers. In Proc. 2005 USENIX Annual Technical Conference (USENIX '05), 2005. Google ScholarDigital Library
- R. Muralidhar, H. Seshadri, V. Bhimarao, V. Rudramuni, I. Mansoor, S. Thomas, B. Veera, Y. Singh, and S. Ramachandra. Experiences with Power Management Enabling on the Intel Medfield Phone. In Linux Symposium (OLS), 2012.Google Scholar
- A. Naveh, E. Rotem, A. Mendelson, S. Gochman, R. Chabukswar, K. Krishnan, and A. Kumar. Power and thermal management in the intel core duo processor. Intel Technology Journal, 10(2):109--122, 2006.Google ScholarCross Ref
- D. Snowdon, E. Le Sueur, S. Petters, and G. Heiser. Koala: A platform for OS-level Power Management. In 4th ACM European Conference on Computer Systems (Eurosys), 2009. Google ScholarDigital Library
- S. Srikantaiah, A. Kansal, and F. Zhao. Energy Aware Consolidation for Cloud Computing. In USENIX Conference on Power Aware Computing and Systems (PACS), 2008. Google ScholarDigital Library
- M. Steinder, I. Whalley, J. Hanson, and J. Kephart. Coordinated management of power usage and runtime performance. In Proceedings of the Network Operations and Management Symposium (NOMS), 2008.Google ScholarCross Ref
- K. Tian, K. Yu, J. Nakajima, and W. Wang. How Virtualization Makes Power Management Different. In Linux Symposium (OLS), 2007.Google Scholar
- N. Tolia, Z. Wang, M. Marwah, C. Bash, P. Ranganathan, and X. Zhu. Delivering Energy Proportionality with Non Energy-proportional Systems--Optimizing the Ensemble. In HotPower, 2008. Google ScholarDigital Library
- B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In the 5th symposium on Operating systems design and implementation (OSDI), 2002. Google ScholarDigital Library
- R. Urgaonkar, U. Kozat, K. Igarashi, and M. J. Neely. Dynamic Resource Allocation and Power Management in Virtualized Data Centers. In IEEE/IFIP Network Operations and Management Symposium (NOMS), 2010.Google Scholar
- U.S. Environmental Protection Agency ENERGY STAR Program. Report to congress on server and data center energy efficiency, 2007.Google Scholar
- A. Verma, P. Ahuja, and A. Neogi. pMapper: Power and Migration Cost Aware Placement of Applications in Virtualized Systems. In Proceedings of the ACM Middleware Conference, 2008. Google ScholarDigital Library
- VMware Inc. VMware Capacity Planner, http://www.vmware.com/products/capacity-planner/.Google Scholar
- VMware Inc. VMWare vCenter CapacityIQ, http://www.vmware.com/products/vcenter-capacityiq/.Google Scholar
- VMware Inc. Resource Management with VMware DRS. Whitepaper, VMware Inc., 2006.Google Scholar
- VMware Inc. VMware Distributed Power Management: Concepts and Use. Whitepaper, VMware Inc., 2010.Google Scholar
- M. S. Ware, K. Rajamani, M. S. Floyd, B. Brock, J. C. Rubio, F. L. R. III, and J. B. Carter. Architecting for Power Management: The IBM POWER Approach. In Proceedings of the 12th International Symposium on High-Performance Computer Architecture (HPCA-16), 2010.Google Scholar
Recommendations
Agile, efficient virtualization power management with low-latency server power states
ISCA '13: Proceedings of the 40th Annual International Symposium on Computer ArchitectureOne of the main driving forces of the growing adoption of virtualization is its dramatic simplification of the provisioning and dynamic management of IT resources. By decoupling running entities from the underlying physical resources, and by providing ...
Efficient virtualization on embedded power architecture® platforms
ASPLOS '13Power Architecture® processors are popular and widespread on embedded systems, and such platforms are increasingly being used to run virtual machines. While the Power Architecture meets the Popek-and-Goldberg virtualization requirements for traditional ...
Efficient virtualization on embedded power architecture® platforms
ASPLOS '13Power Architecture® processors are popular and widespread on embedded systems, and such platforms are increasingly being used to run virtual machines. While the Power Architecture meets the Popek-and-Goldberg virtualization requirements for traditional ...
Comments