SPEC
Benchmarks and Tools

SPEC offers a wide variety of benchmarks and tools to aid comparisons across many aspects of computer performance.

With over 50 different products in many different areas, it can seem a bit daunting to find the ones that best meet your interests. As a first step to help, we provide different indices of our products, each with a different view across our products.

  • By Categories
    Browse our products grouped into categories.
  • By Features
    View our products grouped by features that they share.
  • By Time
    The display below covers all of our current products, ordered by the date of the product's announcement, starting with the most recent.
    • Retired Products
      We do keep a separate listing of all our products that have been retired and hence are no longer included in the list below.

Our Benchmark Products

SPECworkstation

The SPECworkstation benchmark measures all key aspects of workstation performance based on diverse professional applications.

ADASMark

ADASMark focuses benchmarking a typical vision pipeline that may be used in advanced driver-assistance systems (ADAS) platforms. Built on OpenCL, the pipeline may be distributed among CPUs, GPUs and DSPs.

AudioMark

A modern audio pipeline with multiple datatypes, larger code size, DSP, and machine learning.

AutoBench

The algorithms in the benchmark analyze processor performance in automotive, industrial, and general-purpose applications. Version 2.0 includes more workloads concentrating on aggregated tasks (combinations of AutoBench-1.1 kernels) that reflect the increase in compute demand of automotive electronic control units (ECU).

BrowsingBench

Measure browser performance with BrowsingBench, a collection of webpages loaded using a local Nginx server over a wired LAN connection.

CoreMark

A simple, yet sophisticated test of the functionality of a processor core; it produces a single-number score allowing users to make quick comparisons between processors.

CoreMark-Pro

CoreMark-Pro builds on the original CoreMark benchmark by adding context-level parallelism and 7 new workloads which cover integer and floating-point performance.

DENBench

This benchmark addresses digital entertainment products such as smartphones, MP3 players, digital cameras, TV set-top boxes, and in-car entertainment systems.

FPMark

FPMark focuses entirely on single- and double-precision floating-point workloads. From Gauss-Jordan Elimination to Black Schols computation, FPMark covers a broad range of intense floating point analysis.

IoTMark

IoTMark builds on ULPMark by adding a sensor emulation module (the IO Manager) and a radio gateway emulator (the Radio Manager).

MLMark

This benchmark strives to categorize and analyze several broad classes of popular ML neural networks on embedded edge-compute platforms.

MultiBench

To analyze worker-level parallelism in addition to context-level, MultiBench contains integer workloads that scale in both directions.

Networking

Routers and switches can benefit from this benchmark’s analysis of performance associated with moving packets in networking applications.

OABench

This benchmark approximates office automation tasks performed by processors in printers, plotters, and other office automation systems that handle text and image processing tasks.

SecureMark

SecureMark provides security-specific profiles to assist in this analysis. SecureMark-TLS provides a method to account for the cost of a TLS handshake using elliptic curve key exchange and signing, as well as AES128 CCM & ECB for a ciphers and SHA256 for hashing.

TeleBench

The telecommunications suite approximates performance of processors in modem, xDSL, and related fixed-telecom applications.

ULPMark

ULPMark benchmark quantifies the many aspects of ultra-low power MCUs. It does this constructing several behavioral profiles that capture device operation better than a single synthetic number as found in a datasheet. By defining a concise methodology, ULPMark reliably and equitably measures the multiple aspects of MCU energy efficiency.

SPEC SERT Suite Version 3

The SERT 3 Suite is an under development standardized benchmark that welcomes industry and regulatory body engagement and feedback. Like the SERT 2 Suite it will provide a first order of approximation of server efficiency across a broad range of application environments and extending coverage for requested areas of AI/ML, HPC, and storage.

SPECapc for Maya

The SPECapc for Maya benchmark is performance evaluation software for systems running Autodesk Maya 2023 3D animation and visual effects software.

SPECaccel 2023

The SPECaccel 2023 benchmark suite tests performance with computationally intensive parallel applications running under the OpenACC and OpenMP target offloading APIs. The suite exercises the performance of the accelerator, host CPU, memory transfer between host and accelerator, support libraries and drivers, and compilers.

SPECapc for Creo

The SPECapc for Creo benchmark is the worldwide standard for measuring the performance of computing systems running PTC Creo 9, a popular 3D CAD solution that now includes support for generative design, real-time simulation, advanced manufacturing, industrial IoT and augmented reality.

SPECapc for Solidworks

The SPECapc for Solidworks benchmark is performance evaluation software for vendors and users of computing systems running Solidworks CAD/CAM software.

SPECviewperf

The SPECviewperf benchmark is the worldwide standard for measuring graphics performance based on professional applications.

SPECapc for 3ds Max

The SPECapc for 3ds Max benchmark is performance evaluation software for vendors and users of computing systems running Autodesk 3ds Max.

SPEChpc 2021

SPEChpc 2021 is a set of application benchmark suites using a comprehensive measure of real-world performance for the state-of-the-art HPC systems. They offer well-selected science and engineering codes that are representative of HPC workloads and are portable across CPU and accelerators, along with certain fair comparative performance metrics.

SPECstorage Solution 2020

The SPECstorage Solution 2020 benchmark is the latest version of SPEC’s benchmark suite measuring file server throughput and response time, providing a standardized method for comparing performance across different vendor platforms. The suite is the successor to the SPEC SFS® 2014 benchmark.

SPEC Cloud IaaS 2018

The SPEC Cloud IaaS 2018 benchmark is SPEC’s second benchmark suite to measure cloud performance. The SPEC Cloud IaaS 2018 benchmark addresses the performance of infrastructure-as-a-service (IaaS) cloud platforms.

SPEC CPU 2017

The SPEC CPU 2017 benchmark package contains SPEC’s next-generation, industry-standardized, CPU intensive suites for measuring and comparing compute intensive performance, stressing a system’s processor, memory subsystem and compiler.

SPECjEnterprise 2018 Web Profile

SPECjEnterprise 2018 Web Profile measures full-system performance for Java Enterprise Edition (Java EE) Web Profile Version 7 or later application servers, databases and supporting infrastructure.

SPEC Chauffeur WDK

The Chauffeur WDK (Worklet Development Kit) Tool was designed to simplify the development of workloads for measuring both performance and energy efficiency. The Chauffeur WDK tool workload framework contains functionality that is common to most workloads, enabling developers to focus on the actual business logic of the application, and take advantage of the Chauffeur WDK framework’s capabilities for configuration, execution, data collection, validation, and reporting.

SPEC Accel

The SPEC ACCEL benchmark suite tests performance with computationally intensive parallel applications running under the OpenCL, OpenACC, and OpenMP 4 target offloading APIs. The suite exercises the performance of the accelerator, host CPU, memory transfer between host and accelerator, support libraries and drivers, and compilers.

SPEC SERT Suite Version 2

The SPEC SERT Suite provides a first-order approximation of server efficiency across a broad range of application environments, updated to be economical and easier to use.

SPECvirt Datacenter 2021

The SPECvirt Datacenter 2021 benchmark is the third generation SPEC benchmark for evaluating the performance of virtualized environments and the first for measuring the performance of multiple hosts in virtualized datacenters.

SPECjbb2015

The SPECjbb 2015 benchmark measures performance based on the latest Java application features. Exercising new Java 7 features and other important performance elements, including the latest data formats (XML), communication using compression, and messaging with security.

SPEC virt_sc 2013

The SPEC virt_sc 2013 benchmark suites are used to measure performance of virtualized platforms. The SPEC virt_sc 2013 benchmark addresses performance evaluation of datacenter servers used in virtualized server consolidation.

SPEC SERT Suite Version 1.x

The SERT Suite is intended to measure server energy efficiency, initially as part of the second generation of the US Environmental Protection Agency (EPA) ENERGY STAR for Computer Servers program.

SPEC OMP 2012

The successor to the SPEC OMP 2001 suite, designed for measuring performance using applications based on the OpenMP 3.1 standard for shared-memory parallel processing.

SPECjEnterprise 2010

SPECjEnterprise 2010 measures full-system performance for Java Enterprise Edition (Java EE) 5 or later application servers, databases and supporting infrastructure.

SPECjvm 2008

The SPECjvm 2008 benchmark is a suite for measuring the performance of a Java Runtime Environment (JRE). It contains several real-life applications and benchmarks focusing on core java functionality and the performance of the JRE executing a single application.

SPECpower_ssj2008

The SPEC Power benchmark is the first industry-standard benchmark that evaluates the power and performance characteristics of single server and multi-node servers.

SPEC MPI 2007

SPEC MPI 2007 is SPEC’s benchmark suite for evaluating MPI-parallel, floating point, compute intensive performance across a wide range of cluster and SMP hardware. The suite consists of the intial MPIM2007 suite and MPIL2007, which contains larger working sets and longer run times than MPIM2007.