Standard Performance Evaluation Corporation
The SPEC VIRT® benchmark suites are used to measure performance of virtualized platforms. These benchmark suites are targeted for use by hardware vendors, virtualization software vendors, application software vendors, datacenter managers, and academic researchers.
The SPEC virt_sc® 2013 benchmark addresses performance evaluation of datacenter servers used in virtualized server consolidation (sc).
The SPEC virt_sc® 2013 benchmark is available for purchase via the SPEC Order Form.
SPEC virt_sc® 2013 benchmark measures the end-to-end performance of all system components including the hardware, virtualization platform, and the virtualized guest operating system and application software. The benchmark supports hardware virtualization, operating system virtualization, and hardware.
The benchmark utilizes several SPEC workloads representing applications that are common targets of virtualization and server consolidation. We modified each of these standard workloads to match a typical server consolidation scenario of CPU resource requirements, memory, disk I/O, and network utilization for each workload. These workloads are modified versions of SPECweb® 2005, SPECjAppServer® 2004, SPECmail® 2008, and SPEC INT® 2006 benchmarks. The client-side SPEC virt_sc® 2013 harness controls the workloads. Scaling is achieved by running additional sets of virtual machines, called "tiles", until overall throughput reaches a peak. All VMs must continue to meet required quality of service (QoS) criteria.
The benchmark also includes options for measuring power consumption and power/performance relationships. Based on SPEC Power® methodology, power measurement requires the use one of the accepted power analyzers. The benchmarker has the option of running with power monitoring enabled and can submit results to any of three categories:
Changes from SPEC virt_sc® 2010:
SPEC virt_sc® 2013 benchmark shares the general benchmark architecture from SPEC virt_sc® 2010 benchmark, including the benchmark harness and most of the application workloads and VM types. However, since the SPEC virt_sc® 2010 benchmark was developed, many companies are virtualizing significantly heavier workloads than those in the first generation benchmark. In the SPEC virt_sc® 2013 benchmark, we are providing heavier and more bursty workloads that require virtual machines with more memory and vCPUs and further stress the system's ability to meet the benchmark's quality of service requirements. The list below summarizes some of the key changes:
Search SPEC virt_sc® 2013 results in SPEC's online result database.
Benchmark Technical Support