The SPEC Cloud Committee is currently developing a novel system-level benchmark for datacenters that mimics emerging cloud use-cases and exercises all the relevant components of the modern infrastructure. The primary objective of the benchmark is to establish a comprehensive suite of real-world, cloud-enabled workloads and key performance indicators that adequately capture the performance of modern datacenter systems at scale. The benchmark will also provide valuable insights that will help in the design of future generations of computing platforms. Beyond performance characterization, the benchmark is expected to model portability, reproducibility, transparency and observability, with the help of integrated telemetry and detailed reporting, thereby fostering broad industry-wide adoption.
In 2020, regulatory changes from the U.S. government inadvertently affected SPEC’s efforts to establish and promote global standardized benchmarks related to energy efficiency. The changes also had the unintended consequence of impacting U.S.-based computing system manufacturers. However, a dedicated group of internationally based SPEC International Standards Group (ISG) members worked tirelessly – and successfully – to clarify the U.S. government’s position, consequently, ensuring SPEC could continue enabling governments and businesses to more effectively achieve sustainable development and carbon emission reduction goals.
We are delighted to share highlights from the recently concluded 16th annual ACM/SPEC International Conference on Performance Engineering (ICPE) 2025, held May 5-9 in Toronto, Canada. ICPE has been the flagship conference in the area of performance engineering over the years and has a tradition of bringing together both academic scholars and industrial practitioners to discuss recent advances in the area.
One of the difficulties in processor simulation is finding workloads that are based on real applications. The gem5 simulator, combined with SPEC CPU 2017, has recently helped to highlight complex areas of processor design related to moving data more efficiently.