SPECstorage™ Solution 2020_vda Result: Oracle - Oracle ZFS Storage ZS11-2 Eight Drive Enclosure Hybrid Storage System

Oracle	SPECstorage Solution 2020_vda = 1725 Streams
Oracle ZFS Storage ZS11-2 Eight Drive Enclosure Hybrid Storage System	Overall Response Time = 19.02 msec

Business Metric (Streams)	Average Latency (msec)	Streams Ops/Sec	Streams MB/Sec
75	2.539	750	342
150	4.096	1501	684
225	5.571	2251	1026
300	6.673	3001	1371
375	8.452	3752	1713
450	10.353	4502	2058
525	12.478	5253	2401
600	10.838	6004	2743
675	17.710	6754	3080
750	15.560	7504	3427
825	22.036	8255	3774
900	16.583	9005	4114
975	17.133	9756	4454
1050	20.140	10507	4795
1125	19.824	11257	5139
1200	21.665	12007	5484
1275	27.428	12758	5830
1350	28.239	13508	6169
1425	25.562	14259	6513
1500	31.155	14976	6844
1575	32.034	15760	7199
1650	38.389	16483	7530
1725	58.248	17147	7831

Product and Test Information

Oracle ZFS Storage ZS11-2 Eight Drive Enclosure Hybrid Storage System
Tested by	Oracle
Hardware Available	June 12, 2025
Software Available	June 12, 2025
Date Tested	April 2025
License Number	00073
Licensee Locations	Redwood Shores, CA, USA

The Oracle ZFS Storage ZS11-2 system is a cost-effective, unified storage system that is ideal for performance-intensive, dynamic workloads. This enterprise-class storage system offers both NAS and SAN capabilities with industry-leading Oracle Database integration, in a highly available, clustered configuration. The Oracle ZFS Storage ZS11-2 provides simplified configuration, management, and industry-leading storage Analytics. The performance-optimized platform leverages specialized read and write flash caching devices in the hybrid storage pool configuration, optimizing high-performance throughput and latency. The clustered Oracle ZFS Storage ZS11-2 system scales to 2.0TB Memory per controller, includes 32 CPU cores per controller and 20 PB of disk storage. The Oracle ZFS Storage Appliance delivers excellent value with integrated data services for file and block-level protocols with connectivity over 32GB FC, 200GbE, 100GbE, 40GbE, 25GbE, 10GbE and 1GbE. Data services include 5 levels of compression, deduplication, encryption, snapshots, and replication. An advanced data integrity architecture and four RAID redundancy options optimized for different workloads provide a strong data protection foundation

Solution Under Test Bill of Materials

Item No	Qty	Type	Vendor	Model/Name	Description
1	2	Storage Controller	Oracle	Oracle ZFS Storage ZS11-2	Oracle ZFS Storage ZS11-2 , 2 x 32-Core 2 x 2.95GHz AMD EPYC 9J15 CPU. 98304 MB DDR5-6400 DIMM. 2 x 3.84TB NVME Sansung boot drives.
2	48	Memory	Oracle	Oracle ZFS Storage ZS11-2	Oracle ZFS Storage ZS11-2, 24 x 96000 MB DDR5-6400 RDIMM. Memory is order configurable, a total of 2304GB was installed in each storage controller.
3	8	Storage Drive Enclosure	Oracle	Oracle Storage Drive Enclosure DE3-24C	24 drive slot enclosure, SAS3 connected, 20 x 14TB Western Digital 7200 RPM - SAS-3 Disk Drive, 2 x Samsung 200GB - SAS-3 SSD, 2 x Samsung 7.68TB - SAS-3 SSD. Dual PSU.
4	160	SAS3 HDD	Oracle	WDC W7214A520ORA014T	14TB Western Digital 7200 RPM - SAS-3 Disk Drive. Drive selection is order configurable. A total of 160 x 14TB Western Digital 7200 RPM - SAS-3 Disk Drive drives were installed across eight Oracle Storage Drive Enclosure DE3-24C.
5	16	SAS3 SSD	Oracle	Samsung MZILT960HBHQ	Samsung 200GB - SAS-3 Solid State Disk. Drive selection is order configurable, a total of 16 x Samsung 200GB - SAS-3 Solid State Disk drives were installed across eight Oracle Storage Drive Enclosure DE3-24C. These Drives are used for write accelerators.
6	16	SAS3 SSD	Oracle	Samsung MZILT6HALA	Samsung 7.68TB - SAS-3 Solid State Disk. Drive selection is order configurable, a total of 16 x Samsung 7.68TB - SAS-3 Solid State Disk drives were installed across eight Oracle Storage Drive Enclosure DE3-24C. These drives are used for ZFS L2 Adaptive Replacement Cache.
7	4	Client	Oracle	Oracle x9-2	Oracle x9-2 Client Node, 2 x Intel Xeon Gold-5318Y 24-Core, 2.1GHz processors. 512GB RAM. 2 x (2 x 100GbE). Used for benchmark load generation. One is used for the prime client.
8	8	OS Drive	Oracle	Micron 5300 MTFD 240GB	Micron 5300 MTFD - Solid State Disk Drive. 2 x 240GB - Solid State Disk Drive M.2, one each of the disk drives in the Oracle x9-2 Client Node was installed for OS boot drive.
9	1	Switch	Arista	Arista DCS-7060CX-32S	Arista DCS-7060CX-32S, high-performance, low-latency 100/40/10/25/50 Gb/sec Ethernet switch.
10	8	Network Interface Card	Oracle	Dual 100-Gigabit SFP28 Ethernet	Mellanox ConnectX-5 VPI Dual Port QSFP28 100GbE Ethernet HBA, two in each x9-2 Client (Oracle Part Number 7364127).
11	4	Network Interface Card	Oracle	Dual 200-Gigabit SFP28 Ethernet	Mellanox ConnectX-7 VPI Dual Port QSFP28 200GbE Ethernet HBA, two in each ZS11-2 controller (Oracle Part Number 7603663). Can be ordered at the same time when ordering the Oracle ZS11-2 controllers.
12	1	Switch	CDW	Netgear Gigabit Switch GS724Tv4	Netgear Gigabit Switch GS724Tv4 switch is used for the management and configuration network only.

Configuration Diagrams

Component Software

Hardware Configuration and Tuning - Physical

Software Configuration and Tuning - Physical

Item No	Component	Type	Name and Version	Description
1	Oracle ZFS Storage	Storage Controller OS	8.8.81	Oracle ZFS Storage OS Firmware.
2	Solaris	Workload Client OS	Solaris (11.4-11.4.37.0.1.101.1 )	Workload Client Operating System

Oracle x9-2 Client Nodes
Parameter Name	Value	Description
vers	3	NFS mount option set to version 3
rsize, wsize	1048576	NFS mount option for the read and write buffer size.
forcedirectio	forcedirectio	NFS mount option set to forcedirectio

Software Configuration and Tuning Notes

Best practices settings for network and NFS client and the Oracle ZFS Storage using the 100GbE Ethernet for optimized performance includes setting the workload client NFS mounts of the Oracle to use forcedirectio, and read and write NFS buffer sizes to 1048576 bytes each. Oracle ZFS Storage controllers software configuration and tuning are set to factory defaults.

Service SLA Notes

None

Storage and Filesystems

Item No	Description	Data Protection	Stable Storage	Qty
1	160 x 14TB HDD Oracle ZFS Storage ZS11-2 Data Pool Drives	RAID-10	Yes	160
2	16 x 200GB SSD Oracle ZFS Storage ZS11-2 Log Drives	None	Yes	16
3	Samsung 7.68TB - SAS-3 Solid State Disk ZS11-2 Read Cache Drives	None	Yes	16
4	3.84TB NVME Samsung SSD Oracle ZFS Storage ZS11-2 OS Drives	Mirrored	No	4
5	223GB Micron 5300 SSD x9-2 Client Node OS Drives	None	No	4

Number of Filesystems	2
Total Capacity	930 TiB
Filesystem Type	ZFS

Filesystem Creation Notes

Two ZFS storage pools are created overall in the System Under Test (one storage pool and ZFS filesystem per Oracle ZFS Storage ZS11-2 controller). Each storage pool is configured with 76 HDD drives, 8 write accelerator SSDs (log devices), 8 L2 Adaptive Replacement Cache SSDs (read cache), and 4 hot spare HDDs. The storage pools are configured via the administrative browser interface. Each storage controller assigns half the disk drives, log devices, and cache devices to be used. Next, the storage pools profiles are set to mirror (RAID-10) across the 76 data HDDs drives. The log profile and cache device profiles used are set to be striped. The log construct in each storage pool is the ZFS Intent Log (ZIL) for the pool. The cache construct is the ZFS L2 Adaptive Replacement Cache for the pool. Each storage pool is also configured as a ZFS filesystem which is then configured with 16 ZFS filesystem shares. Since each Oracle ZFS Storage ZS11-2 controller is configured with one storage pool and is a ZFS filesystem and contains 16 ZFS filesystem shares, the System Under Test has 32 ZFS filesystem shares (32 NFS shares). There are 2 internal mirrored system disk drives per Oracle ZFS Storage ZS11-2 controller and are used only for the controllers NAS operating system. These drives are exclusively used for the NAS Firmware and do not cache or store user data. Each of the Oracle x9-2 workload clients mounts 4 NFS shares per Oracle ZFS Storage ZS11-2 controller for a total of 8 NFS shares. Each Oracle x9-2 workload client uses 2 100Gbe networks. (see Oracle ZFS Storage ZS11-2 Filesystem and Network Configuration Diagram).

Storage and Filesystem Notes

All filesystems on both Oracle ZFS Storage ZS11-2 controllers are created with a setting of the Database Record Size of 128KB. The logbias setting is set to latency (the default value) for each filesystem. These standard settings are controlled through the Oracle ZFS Storage administration using the Administration browser or cli interfaces.

Transport Configuration - Physical

Item No	Transport Type	Number of Ports Used	Notes
1	100GbE Ethernet	8	Each Oracle ZFS Storage ZS11-2 Controller is networked via 4 x 200GbE Ethernet physical ports for data.
2	1GbE Ethernet	2	Each Oracle ZFS Storage ZS11-2 Controller uses 1 x 1GbE Ethernet physical port for NAS configuration and management.
3	100GbE Ethernet	8	Each Oracle x9-2 Client Node uses is networked via 2 x 100GbE Ethernet physical ports for data.
4	1GbE Ethernet	4	Each Oracle x9-2 Client Node uses 1 x 1GbE Ethernet physical port for configuration and management.

Transport Configuration Notes

Each Oracle ZFS Storage controller uses 4 x 200 GbE Ethernet ports for a total of 8 x 200 GbE ports. In the event of a controller failure, IP address will be taken over by the surviving controller. All 200 GbE ports are set to MTU 9000. There is 1 x 1GbE port per controller and client that are assigned as the administration interface, each are connected to the 1GbE ports on the Netgear Gigbit switch. These interfaces are only used to manage the controllers and clients. They do not take part in data services in the System Under Test.

Switches - Physical

Processing Elements - Physical

Memory - Physical

Item No	Switch Name	Switch Type	Total Port Count	Used Port Count	Notes
1	Arista DCS-7060CX-32S	100/40/10/25/50 Gb/sec Ethernet Switch	32	16	All ports set for MTU 9000. Port count based on 100Gbe.
2	Netgear Gigabit Switch GS724Tv4	10/100/1000 Mb/sec Ethernet Switch	26	6	Only the 1GbE ports are used for Management and Configuration of SUT

Item No	Qty	Type	Location	Description	Processing Function
1	4	CPU	Oracle ZFS Storage ZS11-2	2 x 32-Core 2x2.95GHz AMD EPYC 9J15 CPU	ZFS, TCP/IP, RAID/Storage Drivers, NFS
2	8	CPU	Oracle x9-2 Client Node	2 x 24-Core 2.1GHz Xeon Gold 5318Y processors	TCP/IP, NFS

Description	Size in GiB	Number of Instances	Nonvolatile	Total GiB
Memory in Oracle ZFS Storage ZS11-2	2304	2	V	4608
Memory in Oracle x9-2 clients	512	4	V	2048
Grand Total Memory Gibibytes				6656

Memory Notes

The Oracle ZFS Storage controllers' main memory is used for the ZFS Adaptive Replacement Cache (ARC is a read data cache), as well as operating system memory.Oracle x9-2 client memory is not used for storage or cache of the Oracle ZFS Storage ZS11-2 controllers, only for the client OS.

Stable Storage

The Stable Storage requirement is guaranteed by the ZFS Intent Log (ZIL) which logs writes and other filesystem changing transactions to the stable storage of write flash accelerator SSDs or HDDs depending on the configuration. The System Under Test uses write flash accelerator SSDs. Writes and other filesystem changing transactions are not acknowledged until the data is written to stable storage. The Oracle ZFS Storage Appliance is an active-active cluster high availability system. In the event of a controller failure or power loss, each controller can take over for the other. Write flash accelerator SSDs and/or HDDs are located in shared disk shelves and can be accessed via the 16 backend SAS-3 channels from both controllers, the remaining active controller can complete any outstanding transactions using the ZIL. In the event of power loss to both controllers, the ZIL is used after power is restored to reinstate any writes and other filesystem changes.

Solution Under Test Configuration Notes

SPECstorage™ Solution 2020_vda Result

Performance