Standard Performance Evaluation Corporation
SPECvirt_sc2010 is SPEC's first benchmark addressing performance evaluation of datacenter servers used in virtualized server consolidation. SPECvirt_sc2010 measures the end-to-end performance of all system components including the hardware, virtualization platform, and the virtualized guest operating system and application software. The benchmark supports hardware virtualization, operating system virtualization, and hardware partitioning schemes.
SPECvirt_sc2010 is being retired in favor of its successor, SPECvirt_sc2013. The last date for submitting benchmark results to SPEC for publication on its website is February 26, 2014. On February 26, 2014, the product will no longer be actively supported by SPEC.
Results for SPECvirt_sc2010 are not allowed to be published unless they are reviewed by SPEC. After the February 26, 2014 review cycle, SPEC will no longer be reviewing results; therefore, no publication may be done of alleged rule-compliant results after March 12th (close of final review cycle). See http://www.spec.org/fairuse.html#Retired for more information.
The benchmark utilizes several SPEC workloads representing applications that are common targets of virtualization and server consolidation. We modified each of these standard workloads to match a typical server consolidation scenario of CPU resource requirements, memory, disk I/O, and network utilization for each workload. These workloads are modified versions of SPECweb2005, SPECjAppServer2004, and SPECmail2008. The client-side SPECvirt_sc2010 harness controls the workloads. Scaling is achieved by running additional sets of virtual machines, called "tiles", until overall throughput reaches a peak. All VMs must continue to meet required quality of service (QoS) criteria.
The benchmark also includes options for measuring power consumption and power/performance relationships. Based on SPECpower methodology, power measurement requires the use one of the accepted power analyzers. The benchmarker has the option of running with power monitoring enabled and can submit results to any of three categories:
The benchmark is targeted for use by hardware vendors, virtualization software vendors, application software vendors, datacenter managers, and academic researchers.
For more information please refer to the FAQ, design and user documentation, and Run and Reporting Rules listed below.
SPECvirt_sc2010 Benchmark Documentation