Standard Performance Evaluation Corporation
SPECvirt_sc2010 is SPEC's first benchmark addressing performance evaluation of datacenter servers used in virtualized server consolidation. SPECvirt_sc2010 measures the end-to-end performance of all system components including the hardware, virtualization platform, and the virtualized guest operating system and application software. The benchmark supports hardware virtualization, operating system virtualization, and hardware partitioning schemes.
The benchmark utilizes several SPEC workloads representing applications that are common targets of virtualization and server consolidation. We modified each of these standard workloads to match a typical server consolidation scenario of CPU resource requirements, memory, disk I/O, and network utilization for each workload. These workloads are modified versions of SPECweb2005, SPECjAppServer2004, and SPECmail2008. The client-side SPECvirt_sc2010 harness controls the workloads. Scaling is achieved by running additional sets of virtual machines, called "tiles", until overall throughput reaches a peak. All VMs must continue to meet required quality of service (QoS) criteria.
The benchmark also includes options for measuring power consumption and power/performance relationships. Based on SPECpower methodology, power measurement requires the use one of the accepted power analyzers. The benchmarker has the option of running with power monitoring enabled and can submit results to any of three categories:
The benchmark is targeted for use by hardware vendors, virtualization software vendors, application software vendors, datacenter managers, and academic researchers.
For more information please refer to the FAQ, design and user documentation, and Run and Reporting Rules listed below.
SPECvirt_sc2010 Benchmark Documentation