Dell Inc. PowerEdge R7625 794337 SPECjbb2015-Distributed max-jOPS
356591 SPECjbb2015-Distributed critical-jOPS
Tested by: Dell Inc. Test Sponsor: Dell Inc. Test location: Round Rock, TX Test date: Oct 19, 2022
SPEC license #: 55 Hardware Availability: Nov-2022 Software Availability: Aug-2022 Publication: Thu Nov 10 10:32:32 EST 2022
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorDell Inc.
Vendor URLhttp://www.dell.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores192
Total Threads384
Total Memory Amount (GB)1536
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameDell Inc. PowerEdge R7625
VendorDell Inc.
Vendor URLhttp://www.dell.com
AvailableNov-2022
ModelPowerEdge R7625
Form Factor2U
CPU NameAMD EPYC 9654
CPU Characteristics96 core, 2.4GHz, 384MB L3 Cache (Max. Boost Clock up to 3.7GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System192
Cores Per Chip96
Threads Per System384
Threads Per Core2
Version1.0.0, 09/28/2022
CPU Frequency (MHz)2400
Primary Cache32 KB(I)+32 KB(D) per core
Secondary Cache1 MB (I+D) per core
Tertiary Cache384 MB (I+D) on chip per chip
Other CacheNone
Disk1 x SAS SSD 600GB
File Systembtrfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64 GB
Memory Details64 GB 2Rx4 PC5-38400R (slots A1-12, B1-12 populated)
# and type of Network Interface Cards (NICs)2 x Broadcom Gigabit Ethernet BCM5720
Power Supply Quantity and Rating (W)2 X 2400
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented
  • The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 18.0.2.1
VendorOracle
Vendor URLhttp://www.oracle.com
VersionJava HotSpot 64-bit Server VM, version 18.0.2.1
AvailableAug-2022
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameDell Inc. PowerEdge R7625
VendorDell Inc.
Vendor URLhttp://www.dell.com
AvailableNov-2022
ModelPowerEdge R7625
Form Factor2U
CPU NameAMD EPYC 9654
CPU Characteristics96 core, 2.4GHz, 384MB L3 Cache (Max. Boost Clock up to 3.7GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System192
Cores Per Chip96
Threads Per System384
Threads Per Core2
Version1.0.0, 09/28/2022
CPU Frequency (MHz)2400
Primary Cache32 KB(I)+32 KB(D) per core
Secondary Cache1 MB (I+D) per core
Tertiary Cache384 MB (I+D) on chip per chip
Other CacheNone
Disk1 x SAS SSD 600GB
File Systembtrfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64 GB
Memory Details64 GB 2Rx4 PC5-38400R (slots A1-12, B1-12 populated)
# and type of Network Interface Cards (NICs)2 x Broadcom Gigabit Ethernet BCM5720
Power Supply Quantity and Rating (W)2 X 2400
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented
  • The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 18.0.2.1
VendorOracle
Vendor URLhttp://www.oracle.com
VersionJava HotSpot 64-bit Server VM, version 18.0.2.1
AvailableAug-2022
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning
  • Logical Processor : Enabled
  • L1 Stream HW Prefetcher : Disabled
  • L2 Stream HW Prefetcher : Disabled
  • MADT Core Enumeration : Linear
  • NUMA Nodes Per Socket : 4
  • L3 cache as NUMA Domain : Enabled
  • System Profile : Custom
  • Determinism Slider : Power Determinism
  • Algorithm Performance Boost Disable (ApbDis) : Enabled
  • ApbDis Fixed Socket P-State : P0
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(24)
OS Image Description os_1
Tuning
  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 40000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 800000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 200000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
  • sysctl -w net.ipv4.icmp_echo_ignore_broadcasts=1
  • sysctl -w net.ipv4.conf.all.rp_filter=1
  • sysctl -w fs.inotify.max_user_watches=65536
  • sysctl -w net.ipv4.conf.default.promote_secondaries=1
  • sysctl -w net.ipv4.conf.all.promote_secondaries=1
  • sysctl -w vm.dirty_background_ratio=1
  • sysctl -w vm.swappiness=0
  • sysctl -w vm.overcommit_memory=0
  • sysctl -w net.ipv4.tcp_mtu_probing=1
  • sysctl -w net.core.wmem_max=12582912
  • sysctl -w net.core.rmem_max=12582912
  • sysctl -w net.ipv4.tcp_rmem='10240 87380 12582912'
  • sysctl -w net.ipv4.tcp_wmem='10240 87380 12582912'
  • sysctl -w net.core.netdev_max_backlog=655560
  • sysctl -w net.core.somaxconn=32768
  • sysctl -w net.ipv4.tcp_no_metrics_save=1
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line -Xms31g -Xmx31g -Xmn29g -XX:AllocatePrefetchInstr=2 -XX:+UseParallelGC -XX:ParallelGCThreads=16 -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:SurvivorRatio=18 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=11k -XX:MaxGCPauseMillis=100 -XX:LoopUnrollLimit=200 -XX:+UseTransparentHugePages -XX:TLABAllocationWeight=2 -XX:ThreadStackSize=140 -XX:CompileThresholdScaling=120 -XX:CICompilerCount=4 -XX:AutoBoxCacheMax=32 -XX:OnStackReplacePercentage=100 -XX:TLABSize=1m -XX:MinTLABSize=1m -XX:-ResizeTLAB -XX:TLABWasteTargetPercent=1 -XX:TLABWasteIncrement=1 -XX:YoungPLABSize=1m -XX:OldPLABSize=1m
Tuning Used numactl to affinitize each Backend JVM to 8 Core / 16 Threads
    • Group1: --physcpubind=0-7,192-199 --localalloc
    • Group2: --physcpubind=8-15,200-207 --localalloc
    • Group3: --physcpubind=16-23,208-215 --localalloc
    • Group4: --physcpubind=24-31,216-223 --localalloc
    • Group5: --physcpubind=32-39,224-231 --localalloc
    • Group6: --physcpubind=40-47,232-239 --localalloc
    • Group7: --physcpubind=48-55,240-247 --localalloc
    • Group8: --physcpubind=56-63,248-255 --localalloc
    • Group9: --physcpubind=64-71,256-263 --localalloc
    • Group10: --physcpubind=72-79,264-271 --localalloc
    • Group11: --physcpubind=80-87,272-279 --localalloc
    • Group12: --physcpubind=88-95,280-287 --localalloc
    • Group13: --physcpubind=96-103,288-295 --localalloc
    • Group14: --physcpubind=104-111,296-303 --localalloc
    • Group15: --physcpubind=112-119,304-311 --localalloc
    • Group16: --physcpubind=120-127,312-319 --localalloc
    • Group17: --physcpubind=128-135,320-327 --localalloc
    • Group18: --physcpubind=136-143,328-335 --localalloc
    • Group19: --physcpubind=144-151,336-343 --localalloc
    • Group20: --physcpubind=152-159,344-351 --localalloc
    • Group21: --physcpubind=160-167,352-359 --localalloc
    • Group22: --physcpubind=168-175,360-367 --localalloc
    • Group23: --physcpubind=176-183,368-375 --localalloc
    • Group24: --physcpubind=184-191,376-383 --localalloc
Notes None
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning
  • Logical Processor : Enabled
  • L1 Stream HW Prefetcher : Disabled
  • L2 Stream HW Prefetcher : Disabled
  • MADT Core Enumeration : Linear
  • NUMA Nodes Per Socket : 4
  • L3 cache as NUMA Domain : Enabled
  • System Profile : Custom
  • Determinism Slider : Power Determinism
  • Algorithm Performance Boost Disable (ApbDis) : Enabled
  • ApbDis Fixed Socket P-State : P0
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(24)
OS Image Description os_2
Tuning
  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 40000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 800000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 200000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line -Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:ParallelGCThreads=2 -XX:CICompilerCount=2
Tuning Used numactl to interleave memory on all CPUs
  • numactl --interleave=all
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line -Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:ParallelGCThreads=2 -XX:CICompilerCount=2
Tuning Used numactl to affinitize each Transaction Injector JVM to 8 Core / 16 Threads
    • Group1: --physcpubind=0-7,192-199 --localalloc
    • Group2: --physcpubind=8-15,200-207 --localalloc
    • Group3: --physcpubind=16-23,208-215 --localalloc
    • Group4: --physcpubind=24-31,216-223 --localalloc
    • Group5: --physcpubind=32-39,224-231 --localalloc
    • Group6: --physcpubind=40-47,232-239 --localalloc
    • Group7: --physcpubind=48-55,240-247 --localalloc
    • Group8: --physcpubind=56-63,248-255 --localalloc
    • Group9: --physcpubind=64-71,256-263 --localalloc
    • Group10: --physcpubind=72-79,264-271 --localalloc
    • Group11: --physcpubind=80-87,272-279 --localalloc
    • Group12: --physcpubind=88-95,280-287 --localalloc
    • Group13: --physcpubind=96-103,288-295 --localalloc
    • Group14: --physcpubind=104-111,296-303 --localalloc
    • Group15: --physcpubind=112-119,304-311 --localalloc
    • Group16: --physcpubind=120-127,312-319 --localalloc
    • Group17: --physcpubind=128-135,320-327 --localalloc
    • Group18: --physcpubind=136-143,328-335 --localalloc
    • Group19: --physcpubind=144-151,336-343 --localalloc
    • Group20: --physcpubind=152-159,344-351 --localalloc
    • Group21: --physcpubind=160-167,352-359 --localalloc
    • Group22: --physcpubind=168-175,360-367 --localalloc
    • Group23: --physcpubind=176-183,368-375 --localalloc
    • Group24: --physcpubind=184-191,376-383 --localalloc
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Pass Fail Fail
jOPS 777436 785886 794337 802787 811237
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 232386 291538 383084 441834 502798 356591
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us - / 8450 - / 8450 - / 8450 - / 8450 - / 8450 - / 8450
1000us 92954 / 101405 8450 / 16901 - / 8450 - / 8450 - / 8450 - / 8450
5000us 574627 / 583077 245061 / 253512 169008 / 177458 152107 / 160557 126756 / 135206 8450 / 16901
10000us 591527 / 599978 540825 / 549275 363367 / 371817 312664 / 321115 228161 / 236611 8450 / 16901
25000us 608428 / 616878 583077 / 591527 507023 / 515474 456321 / 464771 312664 / 270412 8450 / 16901
50000us 608428 / 616878 591527 / 599978 549275 / 557726 507023 / 515474 397168 / 354916 8450 / 16901
75000us 616878 / 625329 599978 / 608428 566176 / 574627 532375 / 540825 456321 / 405619 8450 / 16901
100000us 625329 / 633779 608428 / 616878 574627 / 583077 557726 / 566176 498573 / 507023 8450 / 16901
200000us 650680 / 659130 625329 / 633779 608428 / 616878 591527 / 599978 566176 / 574627 287313 / 67603
500000us 785886 / 794337 709833 / 718283 667581 / 676031 659130 / 667581 633779 / 599978 456321 / 270412
1000000us 794337 / - 785886 / 794337 768985 / 777436 760535 / 768985 743634 / 752085 566176 / 405619
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group10.Backend.beJVM Group10.TxInjector.txiJVM1 Group11.Backend.beJVM Group11.TxInjector.txiJVM1 Group12.Backend.beJVM Group12.TxInjector.txiJVM1 Group13.Backend.beJVM Group13.TxInjector.txiJVM1 Group14.Backend.beJVM Group14.TxInjector.txiJVM1 Group15.Backend.beJVM Group15.TxInjector.txiJVM1 Group16.Backend.beJVM Group16.TxInjector.txiJVM1 Group17.Backend.beJVM Group17.TxInjector.txiJVM1 Group18.Backend.beJVM Group18.TxInjector.txiJVM1 Group19.Backend.beJVM Group19.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group20.Backend.beJVM Group20.TxInjector.txiJVM1 Group21.Backend.beJVM Group21.TxInjector.txiJVM1 Group22.Backend.beJVM Group22.TxInjector.txiJVM1 Group23.Backend.beJVM Group23.TxInjector.txiJVM1 Group24.Backend.beJVM Group24.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1 Group9.Backend.beJVM Group9.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 160 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330
specjbb.comm.connect.selector.runner.count 0 4 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
specjbb.comm.connect.timeouts.connect 60000 900000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.timeouts.read 60000 800000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.timeouts.write 60000 800000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000 60000
specjbb.comm.connect.worker.pool.max 256 160 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330 512 330
specjbb.comm.connect.worker.pool.min 1 16 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1 32 1
specjbb.controller.host localhost 127.0.0.1
specjbb.controller.maxir.maxFailedPoints 3 1
specjbb.customerDriver.threads 64 {probe=120, saturate=200, service=160}
specjbb.forkjoin.workers 384 {Tier1=553, Tier2=25, Tier3=90}
specjbb.group.count 1 24
specjbb.mapreducer.pool.size 384 10
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 845039 IR
High-bound (settled) is 818540 IR