Hewlett Packard Enterprise ProLiant DL385 Gen11 878137 SPECjbb2015-MultiJVM max-jOPS
367338 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Hewlett Packard Enterprise Test Sponsor: Hewlett Packard Enterprise Test location: Houston, TX Test date: May 14, 2023
SPEC license #: 3 Hardware Availability: Jun-2023 Software Availability: Apr-2023 Publication: Tue Jun 13 10:03:08 EDT 2023
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorHewlett Packard Enterprise
Vendor URLhttp://www.hpe.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores256
Total Threads512
Total Memory Amount (GB)1536
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameProLiant DL385 Gen11
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableJun-2023
ModelProLiant DL385 Gen11
Form Factor2U Rack
CPU NameAMD EPYC 9754
CPU Characteristics128 Core, 2.25 GHz, 256 MB L3 Cache(Max. Boost Clock Up to 3.1 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System256
Cores Per Chip128
Threads Per System512
Threads Per Core2
VersionA55 v1.30 03/06/2023
CPU Frequency (MHz)2250
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache1024 KB I+D on chip per core
Tertiary Cache256 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB SATA SSD
File Systembtrfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64 GB
Memory Details64GB 2Rx4 PC5-38400R , running at 4800 MHz
# and type of Network Interface Cards (NICs)HPE Ethernet 1Gb 4-port
Power Supply Quantity and Rating (W)2 x 1600
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.7
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.7
AvailableApr-2023
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Maximum Cooling
  • Determinism Control=Manual
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • Numa Memory Domains Per Socket(NPS)=Four Memory Domains Per Socket
  • L1 Stream HW Prefetcher=Disabled
  • L2 Stream HW Prefetcher=Disabled
  • Minimum Processor Idle Power Core C-State=No C-states
  • xGMI Link Bandwidth=32Gbps
  • Package Power Limit=400
Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(32), jvm_TxInjector_1(32)
OS Image Description os_1
Tuning
  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
  • tuned-adm profile throughput-performance
  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 20000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 810000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 300000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:ParallelGCThreads=1 -XX:CICompilerCount=2

Tuning

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms28g -Xmx28g -Xmn25g -XX:AllocatePrefetchInstr=2 -XX:+UseParallelGC -XX:ParallelGCThreads=16 -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:SurvivorRatio=20 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=11k -XX:MaxGCPauseMillis=100 -XX:LoopUnrollLimit=200 -XX:+UseTransparentHugePages -XX:TLABAllocationWeight=2 -XX:ThreadStackSize=140 -XX:CompileThresholdScaling=120 -XX:CICompilerCount=4 -XX:AutoBoxCacheMax=32 -XX:OnStackReplacePercentage=100 -XX:TLABSize=1m -XX:MinTLABSize=1m -XX:-ResizeTLAB -XX:TLABWasteTargetPercent=1 -XX:TLABWasteIncrement=1 -XX:YoungPLABSize=1m -XX:OldPLABSize=1m

Tuning

Used numactl to affinitize each Backend JVM to 8 Core / 16 Threads

  • numactl --physcpubind=0-7,256-263 --localalloc
  • numactl --physcpubind=8-15,264-271 --localalloc
  • numactl --physcpubind=16-23,272-279 --localalloc
  • numactl --physcpubind=24-31,280-287 --localalloc
  • numactl --physcpubind=32-39,288-295 --localalloc
  • numactl --physcpubind=40-47,296-303 --localalloc
  • numactl --physcpubind=48-55,304-311 --localalloc
  • numactl --physcpubind=56-63,312-319 --localalloc
  • numactl --physcpubind=64-71,320-327 --localalloc
  • numactl --physcpubind=72-79,328-335 --localalloc
  • numactl --physcpubind=80-87,336-343 --localalloc
  • numactl --physcpubind=88-95,344-351 --localalloc
  • numactl --physcpubind=96-103,352-359 --localalloc
  • numactl --physcpubind=104-111,360-367 --localalloc
  • numactl --physcpubind=112-119,368-375 --localalloc
  • numactl --physcpubind=120-127,376-383 --localalloc
  • numactl --physcpubind=128-135,384-391 --localalloc
  • numactl --physcpubind=136-143,392-399 --localalloc
  • numactl --physcpubind=144-151,400-407 --localalloc
  • numactl --physcpubind=152-159,408-415 --localalloc
  • numactl --physcpubind=160-167,416-423 --localalloc
  • numactl --physcpubind=168-175,424-431 --localalloc
  • numactl --physcpubind=176-183,432-439 --localalloc
  • numactl --physcpubind=184-191,440-447 --localalloc
  • numactl --physcpubind=192-199,448-455 --localalloc
  • numactl --physcpubind=200-207,456-463 --localalloc
  • numactl --physcpubind=208-215,464-471 --localalloc
  • numactl --physcpubind=216-223,472-479 --localalloc
  • numactl --physcpubind=224-231,480-487 --localalloc
  • numactl --physcpubind=232-239,488-495 --localalloc
  • numactl --physcpubind=240-247,496-503 --localalloc
  • numactl --physcpubind=248-255,504-511 --localalloc
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:ParallelGCThreads=1 -XX:CICompilerCount=2

Tuning

Used numactl to affinitize each Transaction Injector JVM to 8 Core / 16 Threads

  • numactl --physcpubind=0-7,256-263 --localalloc
  • numactl --physcpubind=8-15,264-271 --localalloc
  • numactl --physcpubind=16-23,272-279 --localalloc
  • numactl --physcpubind=24-31,280-287 --localalloc
  • numactl --physcpubind=32-39,288-295 --localalloc
  • numactl --physcpubind=40-47,296-303 --localalloc
  • numactl --physcpubind=48-55,304-311 --localalloc
  • numactl --physcpubind=56-63,312-319 --localalloc
  • numactl --physcpubind=64-71,320-327 --localalloc
  • numactl --physcpubind=72-79,328-335 --localalloc
  • numactl --physcpubind=80-87,336-343 --localalloc
  • numactl --physcpubind=88-95,344-351 --localalloc
  • numactl --physcpubind=96-103,352-359 --localalloc
  • numactl --physcpubind=104-111,360-367 --localalloc
  • numactl --physcpubind=112-119,368-375 --localalloc
  • numactl --physcpubind=120-127,376-383 --localalloc
  • numactl --physcpubind=128-135,384-391 --localalloc
  • numactl --physcpubind=136-143,392-399 --localalloc
  • numactl --physcpubind=144-151,400-407 --localalloc
  • numactl --physcpubind=152-159,408-415 --localalloc
  • numactl --physcpubind=160-167,416-423 --localalloc
  • numactl --physcpubind=168-175,424-431 --localalloc
  • numactl --physcpubind=176-183,432-439 --localalloc
  • numactl --physcpubind=184-191,440-447 --localalloc
  • numactl --physcpubind=192-199,448-455 --localalloc
  • numactl --physcpubind=200-207,456-463 --localalloc
  • numactl --physcpubind=208-215,464-471 --localalloc
  • numactl --physcpubind=216-223,472-479 --localalloc
  • numactl --physcpubind=224-231,480-487 --localalloc
  • numactl --physcpubind=232-239,488-495 --localalloc
  • numactl --physcpubind=240-247,496-503 --localalloc
  • numactl --physcpubind=248-255,504-511 --localalloc
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Pass Fail Fail
jOPS 859842 868990 878137 887284 896431
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 242402 306433 386471 468797 497001 367338
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 9147 / 18295 - / 9147 - / 9147 - / 9147 - / 9147 - / 9147
1000us 27442 / 36589 18295 / 27442 9147 / 18295 9147 / 18295 9147 / 18295 - / 9147
5000us 594572 / 603719 237829 / 246976 155503 / 164651 137209 / 146356 100620 / 109767 18295 / 27442
10000us 612866 / 622014 539688 / 548836 338449 / 347596 301860 / 311007 237829 / 246976 18295 / 27442
25000us 631161 / 640308 594572 / 603719 512247 / 521394 466510 / 475658 301860 / 311007 36589 / 27442
50000us 640308 / 649455 612866 / 622014 557983 / 567130 521394 / 530541 393332 / 365890 36589 / 27442
75000us 649455 / 658603 622014 / 631161 576277 / 585425 539688 / 548836 475658 / 448216 36589 / 27442
100000us 649455 / 658603 631161 / 640308 594572 / 603719 567130 / 576277 503099 / 484805 36589 / 27442
200000us 686044 / 695192 649455 / 658603 622014 / 631161 622014 / 631161 594572 / 548836 301860 / 27442
500000us 868990 / 859842 740928 / 750075 695192 / 704339 686044 / 695192 667750 / 676897 530541 / 182945
1000000us 878137 / - 868990 / 878137 841548 / 850695 814106 / 823253 768370 / 777517 622014 / 603719
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group10.Backend.beJVM Group10.TxInjector.txiJVM1 Group11.Backend.beJVM Group11.TxInjector.txiJVM1 Group12.Backend.beJVM Group12.TxInjector.txiJVM1 Group13.Backend.beJVM Group13.TxInjector.txiJVM1 Group14.Backend.beJVM Group14.TxInjector.txiJVM1 Group15.Backend.beJVM Group15.TxInjector.txiJVM1 Group16.Backend.beJVM Group16.TxInjector.txiJVM1 Group17.Backend.beJVM Group17.TxInjector.txiJVM1 Group18.Backend.beJVM Group18.TxInjector.txiJVM1 Group19.Backend.beJVM Group19.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group20.Backend.beJVM Group20.TxInjector.txiJVM1 Group21.Backend.beJVM Group21.TxInjector.txiJVM1 Group22.Backend.beJVM Group22.TxInjector.txiJVM1 Group23.Backend.beJVM Group23.TxInjector.txiJVM1 Group24.Backend.beJVM Group24.TxInjector.txiJVM1 Group25.Backend.beJVM Group25.TxInjector.txiJVM1 Group26.Backend.beJVM Group26.TxInjector.txiJVM1 Group27.Backend.beJVM Group27.TxInjector.txiJVM1 Group28.Backend.beJVM Group28.TxInjector.txiJVM1 Group29.Backend.beJVM Group29.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group30.Backend.beJVM Group30.TxInjector.txiJVM1 Group31.Backend.beJVM Group31.TxInjector.txiJVM1 Group32.Backend.beJVM Group32.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1 Group9.Backend.beJVM Group9.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 700 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256
specjbb.comm.connect.selector.runner.count 0 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
specjbb.comm.connect.timeouts.connect 60000 900000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.timeouts.read 60000 800000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.timeouts.write 60000 800000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.worker.pool.max 256 700 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256
specjbb.comm.connect.worker.pool.min 1 16 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
specjbb.controller.maxir.maxFailedPoints 3 1
specjbb.customerDriver.threads 64 {probe=100, saturate=200, service=120}
specjbb.forkjoin.workers 512 {Tier1=530, Tier2=65, Tier3=140}
specjbb.group.count 1 32
specjbb.mapreducer.pool.size 512 10
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 914726 IR
High-bound (settled) is 885485 IR