skip to main content
research-article

Agile, efficient virtualization power management with low-latency server power states

Authors Info & Claims
Published:23 June 2013Publication History
Skip Abstract Section

Abstract

One of the main driving forces of the growing adoption of virtualization is its dramatic simplification of the provisioning and dynamic management of IT resources. By decoupling running entities from the underlying physical resources, and by providing easy-to-use controls to allocate, deallocate and migrate virtual machines (VMs) across physical boundaries, virtualization opens up new opportunities for improving overall system resource use and power efficiency. While a range of techniques for dynamic, distributed resource management of virtualized systems have been proposed and have seen their widespread adoption in enterprise systems, similar techniques for dynamic power management have seen limited acceptance. The main barrier to dynamic, power-aware virtualization management stems not from the limitations of virtualization, but rather from the underlying physical systems; and in particular, the high latency and energy cost of power state change actions suited for virtualization power management.

In this work, we first explore the feasibility of low-latency power states for enterprise server systems and demonstrate, with real prototypes, their quantitative energy-performance trade offs compared to traditional server power states. Then, we demonstrate an end-to-end power-aware virtualization management solution leveraging these states, and evaluate the dramatically-favorable power-performance characteristics achievable with such systems. We present, via both real system implementations and scale-out simulations, that virtualization power management with low-latency server power states can achieve comparable overheads as base distributed resource management in virtualized systems, and thus can benefit from the same level of adoption, while delivering close to energy-proportional power efficiency.

References

  1. M. Annavaram, E. Grochowski, and J. Shen. Mitigating Amdahl's Law Through EPI Throttling. In Proceedings of the 32nd International Symposium on Computer Architecture (ISCA-32), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Arch Linux. Pm-utils. https://wiki.archlinux.org/index.php/Pm-utils, 2012.Google ScholarGoogle Scholar
  3. L. A. Barroso. The Price of Performance. ACM Queue, 3(7):48--53, Sept. 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. R. Bianchini, I. Goiri, K. Le, and T. Nguyen. Parasol: A solar-powered datacenter. In ACM European Conference on Computer Systems (Eurosys), 2012.Google ScholarGoogle Scholar
  5. N. Bila, E. de Lara, K. Joshi, H. A. Lagar-Cavilla, M. Hiltunen, and M. Satyanarayanan. Jettison: Efficient Idle Desktop Consolidation with Partial VM Migration. In European Conference on Computer Systems (Eurosys), 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. T. Brey, B. Bigelow, J. Bolan, H. Cheselka, Z. Dayar, J. Franke, D. Johnson, R. Kantesaria, E. Klodnicki, S. Kochar, et al. Blade-Center Chassis Management. IBM Journal of Research and Development, 49(6):941--961, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. L. Brown, A. Keshavamurthy, D. S. Li, R. Moore, V. Pallipadi, and L. Yu. ACPI in Linux. In Linux Symposium (OLS), 2005.Google ScholarGoogle Scholar
  8. M. Cardosa, M. Korupolu, and A. Singh. Shares and Utilities based Power Consolidation in Virtualized Server Environments. In IFIP/IEEE International Symposium on Integrated Network Management (IM), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. S. Chase, D. C. Anderson, P. N. Thakar, A. N. Vahdat, and R. P. Doyle. Managing energy and server resources in hosting centers. In Proc. 18th Symposium on Operating Systems Principles (SOSP), 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. T. Das, P. Padala, V. Padmanabhan, R. Ramjee, and K. Shin. LiteGreen: Saving energy in networked desktops using virtualization. In USENIX ATC, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. Gandhi, M. Harchol-Balter, R. Das, J. Kephart, and C. Lefurgy. Power Capping via Forced Idleness. In Workshop on Energy-Efficient Design (WEED), 2009.Google ScholarGoogle Scholar
  12. A. Gandhi, M. Harchol-Balter, and M. Kozuch. The Case for Sleep States in Servers. In SOSP 4th Workshop on Power-Aware Computing and Systems (HotPower 2011), 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Gandhi, M. Harchol-Balter, and M. Kozuch. Are sleep states effective in data centers? In 2012 International Green Computing Conference (IGCC), 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. A. Gandhi, M. Harchol-Balter, R. Raghunathan, and M. Kozuch. AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers. Transactions on Computer Systems, 30(4), 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. I. Goiri, K. Le, M. Haque, R. Beauchea, T. Nguyen, J. Guitart, J. Torres, and R. Bianchini. GreenSlot: Scheduling Energy Consumption in Green Datacenters. In 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2011), 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. Hanson, I. Whalley, M. Steinder, and J. Kephart. Multi-aspect Hardware Management in Enterprise Server Consolidation. In IEEE/IFIP Network Operations and Management Symposium (NOMS), 2010.Google ScholarGoogle Scholar
  17. Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba. Advanced configuration and power interface specification. http://www.acpi.info, September 2004.Google ScholarGoogle Scholar
  18. C. Isci, G. Contreras, and M. Martonosi. Live, Runtime Phase Monitoring and Prediction on Real Systems with Application to Dynamic Power Management. In Proceedings of the 39th ACM/IEEE International Symposium on Microarchitecture (MICRO-39), 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. C. Isci, J. Hanson, I. Whalley, M. Steinder, and J. Kephart. Run-time Demand Estimation for Effective Dynamic Resource Management. In IEEE/IFIP Network Operations and Management Symposium (NOMS), 2010.Google ScholarGoogle Scholar
  20. C. Isci, J. Liu, B. Abali, J. Kephart, and J. Kouloheris. Improving Server Utilization Using Fast Virtual Machine Migration. IBM Journal of Research and Development, 55(6), 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jeffrey Nowicki and Andy Arhelger. Optimizing Virtual Infrastructure with PowerVM and the IBM Systems Director VMControl. Whitepaper, IBM Systems and Technology Group, 2010.Google ScholarGoogle Scholar
  22. H. Jiang, M. Marek-Sadowska, and S. R. Nassif. Benefits and Costs of Power-Gating Technique. In IEEE International Conference on Computer Design (ICCD), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: the linux virtual machine monitor. In Ottawa Linux Symposium (OLS), 2007.Google ScholarGoogle Scholar
  24. J. G. Koomey. Estimating total power consumption by servers in the U.S. and the world, 2007.Google ScholarGoogle Scholar
  25. D. Kusic, J. O. Kephart, J. E. Hanson, N. Kandasamy, and G. Jiang. Power and Performance Management of Virtualized Computing Environments Via Lookahead Control. In Proceedings of the International Conference on Autonomic Computing, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. E. Le Sueur and G. Heiser. Slow Down or Sleep, That is the Question. In USENIX Annual Technical Conference, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. J. Lee and N. Kim. Optimizing Throughput of Power and thermal Constrained Multicore Processors Using DVFS and Per-core Power Gating. In Design Automation Conference (DAC), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. D. Meisner, B. T. Gold, and T. F. Wenisch. PowerNap: Eliminating Server Idle Power. In International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. D. Meisner and T. Wenisch. DreamWeaver: Architectural Support for Deep Sleep. In International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. X. Meng, C. Isci, J. Kephart, L. Zhang, E. Bouillet, and D. Pen-darakis. Efficient resource provisioning in compute clouds via vm multiplexing. In IEEE International Conference on Autonomic Computing (ICAC), 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. J. Moore, J. Chase, and P. Ranganathan. Making scheduling "cool": Temperature-aware workload placement in data centers. In Proc. 2005 USENIX Annual Technical Conference (USENIX '05), 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. R. Muralidhar, H. Seshadri, V. Bhimarao, V. Rudramuni, I. Mansoor, S. Thomas, B. Veera, Y. Singh, and S. Ramachandra. Experiences with Power Management Enabling on the Intel Medfield Phone. In Linux Symposium (OLS), 2012.Google ScholarGoogle Scholar
  33. A. Naveh, E. Rotem, A. Mendelson, S. Gochman, R. Chabukswar, K. Krishnan, and A. Kumar. Power and thermal management in the intel core duo processor. Intel Technology Journal, 10(2):109--122, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  34. D. Snowdon, E. Le Sueur, S. Petters, and G. Heiser. Koala: A platform for OS-level Power Management. In 4th ACM European Conference on Computer Systems (Eurosys), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. S. Srikantaiah, A. Kansal, and F. Zhao. Energy Aware Consolidation for Cloud Computing. In USENIX Conference on Power Aware Computing and Systems (PACS), 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. M. Steinder, I. Whalley, J. Hanson, and J. Kephart. Coordinated management of power usage and runtime performance. In Proceedings of the Network Operations and Management Symposium (NOMS), 2008.Google ScholarGoogle ScholarCross RefCross Ref
  37. K. Tian, K. Yu, J. Nakajima, and W. Wang. How Virtualization Makes Power Management Different. In Linux Symposium (OLS), 2007.Google ScholarGoogle Scholar
  38. N. Tolia, Z. Wang, M. Marwah, C. Bash, P. Ranganathan, and X. Zhu. Delivering Energy Proportionality with Non Energy-proportional Systems--Optimizing the Ensemble. In HotPower, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In the 5th symposium on Operating systems design and implementation (OSDI), 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. R. Urgaonkar, U. Kozat, K. Igarashi, and M. J. Neely. Dynamic Resource Allocation and Power Management in Virtualized Data Centers. In IEEE/IFIP Network Operations and Management Symposium (NOMS), 2010.Google ScholarGoogle Scholar
  41. U.S. Environmental Protection Agency ENERGY STAR Program. Report to congress on server and data center energy efficiency, 2007.Google ScholarGoogle Scholar
  42. A. Verma, P. Ahuja, and A. Neogi. pMapper: Power and Migration Cost Aware Placement of Applications in Virtualized Systems. In Proceedings of the ACM Middleware Conference, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. VMware Inc. VMware Capacity Planner, http://www.vmware.com/products/capacity-planner/.Google ScholarGoogle Scholar
  44. VMware Inc. VMWare vCenter CapacityIQ, http://www.vmware.com/products/vcenter-capacityiq/.Google ScholarGoogle Scholar
  45. VMware Inc. Resource Management with VMware DRS. Whitepaper, VMware Inc., 2006.Google ScholarGoogle Scholar
  46. VMware Inc. VMware Distributed Power Management: Concepts and Use. Whitepaper, VMware Inc., 2010.Google ScholarGoogle Scholar
  47. M. S. Ware, K. Rajamani, M. S. Floyd, B. Brock, J. C. Rubio, F. L. R. III, and J. B. Carter. Architecting for Power Management: The IBM POWER Approach. In Proceedings of the 12th International Symposium on High-Performance Computer Architecture (HPCA-16), 2010.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGARCH Computer Architecture News
    ACM SIGARCH Computer Architecture News  Volume 41, Issue 3
    ICSA '13
    June 2013
    666 pages
    ISSN:0163-5964
    DOI:10.1145/2508148
    Issue’s Table of Contents
    • cover image ACM Other conferences
      ISCA '13: Proceedings of the 40th Annual International Symposium on Computer Architecture
      June 2013
      686 pages
      ISBN:9781450320795
      DOI:10.1145/2485922

    Copyright © 2013 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 23 June 2013

    Check for updates

    Qualifiers

    • research-article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader