|
Benchmarks
Tools
Order Benchmarks
SPEC
Mirror Sites
Resources
|
SPEC's Benchmarks and Published Results
CPU
- SPEC CPU2006
[benchmark info] [published
results] [support] [order
benchmark]
Designed to provide performance measurements that can be used
to compare compute-intensive workloads on different computer
systems, SPEC CPU2006 contains two benchmark suites: CINT2006
for measuring and comparing compute-intensive integer performance,
and CFP2006 for measuring and comparing compute-intensive floating
point performance.
- SPEC CPUv6
[info]
The CPU Search Program seeks to to encourage those outside of
SPEC to assist us in locating applications that could be used in
the next CPU-intensive benchmark suite, currently designated as
SPEC CPUv6.
- SPEC CPU2000
[Retired]
- SPEC CPU95
[Retired]
- SPEC CPU92
[Retired]
Graphics and Workstation
Performance
High Performance Computing,
OpenMP, MPI
- SPEC MPI2007
[benchmark info] [published
results] [support] [order
benchmark]
MPI2007 is SPEC's benchmark suite for evaluating MPI-parallel,
floating point, compute intensive performance across a wide range
of cluster and SMP hardware. The suite consists of the intial MPIM2007
suite and MPIL2007, which contains larger working sets and longer run times
than MPIM2007.
- SPEC OMP2012
[benchmark info] [published
results] [support] [order
benchmark]
The successor to the OMP2001, designed for measuring performance using
applications based on the OpenMP 3.1 standard for shared-memory parallel processing.
OMP2012 also includes an optional metric for measuring energy consumption.
- SPEC OMP2001
[benchmark info] [published
results] [support] [order
benchmark]
SPEC's benchmark suite that measures performance using applications
based on the OpenMP standard for shared-memory parallel processing.
The suite consists of OMPM2001 and OMPL2001, which contains larger
working sets and longer run times than OMPM2001.
- SPEC HPC2002
[Retired]
- SPEC HPC96
[Retired]
Java Client/Server
- SPECjAppServer2004
[Retired]
- SPECjAppServer2002
[Retired]
- SPECjAppServer2001
[Retired]
- SPECjbb2013
[benchmark info] [published
results] [support] [order
benchmark]
The SPECjbb2013 benchmark has been developed from the ground up to measure performance
based on the latest Java application features. It is relevant to all audiences who are
interested in Java server performance, including JVM vendors, hardware developers,
Java application developers, researchers and members of the academic community.
- SPECjbb2005
[benchmark info] [published
results] [support] [order
benchmark]
A benchmark for evaluating the performance of servers running
typical Java business applications, JBB2005 represents an order
processing application for a wholesale supplier. The benchmark
can be used to evaluate performance of hardware and software
aspects of Java Virtual Machine (JVM) servers.
- SPECjbb2000
[Retired]
- SPECjEnterprise2010
[benchmark info] [published
results] [support]
[order benchmark]
SPECjEnterprise2010 measures full-system performance for Java Enterprise Edition (Java EE)
5 or later application servers, databases and supporting infrastructure and expands the scope of
the SPECjAppServer2004 benchmark.
- SPECjms2007
[benchmark info] [published
results] [support] [order
benchmark]
SPECjms2007 is the first industry-standard benchmark for evaluating
the performance of enterprise message-oriented middleware servers
based on JMS (Java Message Service). It provides a standard workload
and performance metrics for competitive product comparisons,
as well as a framework for indepth performance analysis of enterprise
messaging platforms.
- SPECjvm2008
[benchmark info] [published
results] [support]
[download benchmark]
SPECjvm2008 is a benchmark suite for measuring the performance
of a Java Runtime Environment (JRE), containing several real
life applications and benchmarks focusing on core java functionality.
The SPECjvm2008 workload mimics a variety of common general purpose
application computations.
- SPEC JVM98
[Retired]
Mail Servers
Network File System
Power
- SPECpower_ssj2008
[benchmark info] [published
results] [support]
[order benchmark]
SPECpower_ssj2008 is the first industry-standard SPEC benchmark
that evaluates the power and performance characteristics of volume
server class computers. The initial benchmark addresses the performance
of server-side Java, and additional workloads are planned.
- Server Efficiency Rating Tool (SERT)
[benchmark info]
[support]
[order benchmark]
The Server Efficiency Rating Tool (SERT) was created by Standard Performance
Evaluation Corporation (SPEC) at the request of the US Environmental Protection Agency.
It is intended to measure server energy efficiency, initially as part of the second
generation of the US Environmental Protection Agency (EPA) ENERGY STAR for Computer
Servers program. Designed to be simple to configure and use via a comprehensive graphical
user interface, the SERT uses a set of synthetic worklets to test discrete system components
such as memory and storage, providing detailed power consumption data at different load levels.
- Other SPEC benchmarks incorporating power measurement
SIP
- SPECsip_infrastructure2011
[benchmark info] [published
results] [support] [order benchmark]
SPEC's benchmark designed to evaluate a system's ability to act as a SIP server
supporting a particular SIP application. The application modeled is a VoIP
deployment for an enterprise, telco, or service provider, where the SIP server
performs proxying and registration.
SOA
- SOA
[info]
SPEC has formed a new subcommittee to develop standard methods of
measuring performance for typical middleware, database and hardware
deployments of applications based on the Service Oriented Architecture (SOA).
Virtualization
- SPECvirt_sc2010
[benchmark info] [published
results] [support] [order
benchmark]
SPEC's first benchmark addressing performance evaluation of datacenter
servers used in virtualized server consolidation. SPECvirt_sc2010 measures
the end-to-end performance of all system components including the hardware,
virtualization platform, and the virtualized guest operating system and
application software. The benchmark supports hardware virtualization,
operating system virtualization, and hardware partitioning schemes.
Web Servers
|
