Skip navigation
 
 

SPEC's Benchmarks and Published Results

CPU

  • SPEC CPU2006
    [benchmark info] [published results] [support] [order benchmark]
    Designed to provide performance measurements that can be used to compare compute-intensive workloads on different computer systems, SPEC CPU2006 contains two benchmark suites: CINT2006 for measuring and comparing compute-intensive integer performance, and CFP2006 for measuring and comparing compute-intensive floating point performance.

  • SPEC CPUv6
    [info]
    The CPU Search Program seeks to to encourage those outside of SPEC to assist us in locating applications that could be used in the next CPU-intensive benchmark suite, currently designated as SPEC CPUv6.

  • SPEC CPU2000
    [Retired]

  • SPEC CPU95
    [Retired]

  • SPEC CPU92
    [Retired]

Graphics and Workstation Performance

High Performance Computing, OpenMP, MPI

  • SPEC MPI2007
    [benchmark info] [published results] [support] [order benchmark]
    MPI2007 is SPEC's benchmark suite for evaluating MPI-parallel, floating point, compute intensive performance across a wide range of cluster and SMP hardware. The suite consists of the intial MPIM2007 suite and MPIL2007, which contains larger working sets and longer run times than MPIM2007.

  • SPEC OMP2001
    [benchmark info] [published results] [support] [order benchmark]
    SPEC's benchmark suite that measures performance using applications based on the OpenMP standard for shared-memory parallel processing. The suite consists of OMPM2001 and OMPL2001, which contains larger working sets and longer run times than OMPM2001.

  • SPEC HPC2002
    [Retired]

  • SPEC HPC96
    [Retired]

Java Client/Server

  • SPECjAppServer2004
    [benchmark info] [published results] [support] [order benchmark]
    SPECjAppServer2004 is designed to measure the performance of J2EE 1.3 application servers. This benchmark includes an enhanced workload by adding a web tier, JMS, and other changes to SPECjAppServer2002.

  • SPECjAppServer2002
    [Retired]

  • SPECjAppServer2001
    [Retired]

  • SPECjbb2005
    [benchmark info] [published results] [support] [order benchmark]
    A benchmark for evaluating the performance of servers running typical Java business applications, JBB2005 represents an order processing application for a wholesale supplier. The benchmark can be used to evaluate performance of hardware and software aspects of Java Virtual Machine (JVM) servers.

  • SPECjbb2000
    [Retired]

  • SPECjEnterprise2010
    [benchmark info] [published results] [support] [order benchmark]
    SPECjEnterprise2010 measures full-system performance for Java Enterprise Edition (Java EE) 5 or later application servers, databases and supporting infrastructure and expands the scope of the SPECjAppServer2004 benchmark.

  • SPECjms2007
    [benchmark info] [published results] [support] [order benchmark]
    SPECjms2007 is the first industry-standard benchmark for evaluating the performance of enterprise message-oriented middleware servers based on JMS (Java Message Service). It provides a standard workload and performance metrics for competitive product comparisons, as well as a framework for indepth performance analysis of enterprise messaging platforms.

  • SPECjvm2008
    [benchmark info] [published results] [support] [download benchmark]
    SPECjvm2008 is a benchmark suite for measuring the performance of a Java Runtime Environment (JRE), containing several real life applications and benchmarks focusing on core java functionality. The SPECjvm2008 workload mimics a variety of common general purpose application computations.

  • SPEC JVM98
    [Retired]

Mail Servers

  • SPECmail2009
    [benchmark info] [published results] [support] [order benchmark]
    SPECmail2009 measures performance of enterprise mail servers compliant with SMTP and IMAP4 protocols. The benchmark features a new workload derived from a 40,000-user corporate mail store and support for SSL/TLS encryption.

  • SPECmail2008
    [Retired]

  • SPECmail2001
    [benchmark info] [published results] [support] [order benchmark]
    A standardized mail server benchmark designed to measure a system's ability to act as a mail server servicing email requests, based on the Internet standard protocols SMTP and POP3. The benchmark characterizes throughput and response time of a mail server system under test with realistic network connections, disk storage, and client workloads.

Network File System

Power

  • SPECpower_ssj2008
    [benchmark info] [published results] [support] [order benchmark]
    SPECpower_ssj2008 is the first industry-standard SPEC benchmark that evaluates the power and performance characteristics of volume server class computers. The initial benchmark addresses the performance of server-side Java, and additional workloads are planned.

SIP

  • SPECsip
    [info]
    SPEC has formed a new subcommittee to develop standard methods of comparing performance for servers using the Session Initiation Protocol (SIP).

SOA

  • SOA
    [info]
    SPEC has formed a new subcommittee to develop standard methods of measuring performance for typical middleware, database and hardware deployments of applications based on the Service Oriented Architecture (SOA).

Virtualization

  • Virtualization
    [info]
    SPEC has formed a new subcommittee to develop standard methods of comparing virtualization performance for data center servers. The group is investigating the use of heterogeneous workloads that are spread across multiple virtual machines on a single server, and the methods and metrics used by the benchmark will be defined as part of the working group's efforts.

Web Servers

  • SPECweb2009
    [benchmark info] [published results] [support] [order benchmark]
    SPECweb2009 emulates users sending browser requests over broadband Internet connections to a web server using both HTTP and HTTPS. It provides banking, e-commerce, and support workloads, along with a new power workload based on the e-commerce workload. Dynamic content is implemented in PHP, JSP, and ASPX.

  • SPECweb2005
    [benchmark info] [published results] [support] [order benchmark]
    SPECweb2005 emulates users sending browser requests over broadband Internet connections to a web server. It provides three new workloads: a banking site (HTTPS), an e-commerce site (HTTP/HTTPS mix), and a support site (HTTP). Dynamic content is implemented in PHP, JSP, and ASPX. The current version is 1.30.

  • SPECweb96
    [Retired]

  • SPECweb99
    [Retired]

  • SPECweb99_SSL
    [Retired]