Supermicro SuperServer SYS-241H-TNRTTP 870936 SPECjbb2015-MultiJVM max-jOPS
453733 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Apr 13, 2023
SPEC license #: 001176 Hardware Availability: Mar-2023 Software Availability: Jan-2023 Publication: Fri Apr 21 12:47:13 EDT 2023
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips4
Total Cores240
Total Threads480
Total Memory Amount (GB)2048
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-241H-TNRTTP
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableMar-2023
ModelX13QEH+
Form Factor2U
CPU NameIntel Xeon 8490H
CPU Characteristics60 Core, 1.9 GHz, 112.5MB L3 Cache (Turbo Boost Technology up to 3.50 GHz)
Number of Systems1
Nodes Per System1
Chips Per System4
Cores Per System240
Cores Per Chip60
Threads Per System480
Threads Per Core2
Version1.2 (03/17/2023)
CPU Frequency (MHz)1900
Primary Cache32 KB I + 48 KB D on chip per core
Secondary Cache2 MB I+D on chip per core
Tertiary Cache112.5 MB I+D on chip per chip
Other CacheNone
Disk1x 1.92TB NVMe SSD
File Systembtrfs
Memory Amount (GB)2048
# and size of DIMM(s)32 x 64GB
Memory Details64GB 2Rx4 PC5-4800
# and type of Network Interface Cards (NICs)1x 10 Gbit + 1x 1Gbit NICs
Power Supply Quantity and Rating (W)2 x 2700W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttps://www.suse.com/
Version5.14.21-150400.22-default
AvailableJun-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.6
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.6
AvailableJan-2023
Bitness64
Notesnote
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Hyper-Threading[ALL]=Enable
  • Hardware Prefetcher= Enabled
  • Turbo Mode=Enable
  • SNC=Enable SNC4 (4-clusters) Enable
  • LLC Prefetch=Disable
  • LLC Dead Line Alloc=Disable
  • DCU Streamer Prefetcher=Enable
  • Power Technology=custom
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Extreme Performance

Notes notes
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(4), jvm_TxInjector_1(4)
OS Image Description os_1
Tuning

  • ulimit -n 131072
  • sysctl net.core.wmem_max=12582912
  • sysctl net.core.rmem_max=12582912
  • sysctl net.ipv4.tcp_rmem='10240 87380 12582912'
  • sysctl net.ipv4.tcp_wmem='10240 87380 12582912'
  • sysctl net.core.netdev_max_backlog=655560
  • sysctl net.core.somaxconn=32768
  • sysctl net.ipv4.tcp_no_metrics_save=1
  • systemctl stop systemd-update-utmp-runlevel.service
  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 16000000 > /sys/kernel/debug/sched/latency_ns
  • echo 1000 > /sys/kernel/debug/sched/migration_cost_ns
  • echo 28000000 > /sys/kernel/debug/sched/min_granularity_ns
  • echo 9 > /sys/kernel/debug/sched/nr_migrate
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 1 > /sys/kernel/debug/sched/tunable_scaling
  • echo 50000000 > /sys/kernel/debug/sched/wakeup_granularity_ns
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • ulimit -v 800000000
  • ulimit -m 800000000
  • ulimit -l 800000000
  • tuned-adm profile throughput-performance
  • echo 1500 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_hugepages

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning None
Notes

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all

JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-showversion -XX:+UseParallelGC -XX:+UseLargePages -XX:+AlwaysPreTouch -XX:-UseAdaptiveSizePolicy -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=10k -XX:-UseCountedLoopSafepoints -XX:LoopUnrollLimit=20 -server -XX:TargetSurvivorRatio=99 -XX:SurvivorRatio=28 -XX:LargePageSizeInBytes=1g -XX:UseAVX=0 -Xms31744m -Xmx31744m -Xmn29696m -XX:ParallelGCThreads=30

Tuning numactl used to affinitize each Backend JVM to a single memory node, eg:
  • numactl --cpunodebind=$node --localalloc
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseLargePages -XX:LargePageSizeInBytes=1G -XX:+UseParallelGC -XX:ParallelGCThreads=2

Tuning numactl used to affinitize each TxInjector JVM to a single memory node, eg:
  • numactl --cpunodebind=$node --localalloc
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 861470 870936 880403 889870 899336
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 307667 364468 468601 572735 639002 453733
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 18933 / 28400 9467 / 18933 - / 9467 - / 9467 - / 9467 - / 9467
1000us 369201 / 378668 37867 / 47333 28400 / 37867 18933 / 28400 9467 / 18933 - / 9467
5000us 804669 / 814136 738403 / 747869 435468 / 444935 302934 / 312401 142000 / 151467 18933 / 9467
10000us 814136 / 823603 757336 / 766803 605869 / 615335 492268 / 501735 302934 / 312401 18933 / 9467
25000us 823603 / 833070 776269 / 785736 691069 / 700536 634269 / 643736 359735 / 369201 18933 / 9467
50000us 823603 / 833070 785736 / 795203 719469 / 728936 662669 / 672136 463868 / 473335 18933 / 9467
75000us 833070 / 842536 795203 / 804669 738403 / 747869 681602 / 691069 568002 / 577469 18933 / 28400
100000us 833070 / 842536 804669 / 814136 747869 / 757336 719469 / 728936 634269 / 643736 208267 / 47333
200000us 842536 / 852003 823603 / 833070 785736 / 795203 766803 / 776269 738403 / 747869 568002 / 520668
500000us 870936 / - 852003 / 861470 823603 / 833070 814136 / 823603 795203 / 804669 757336 / 766803
1000000us 870936 / - 870936 / - 852003 / 861470 852003 / 861470 842536 / 852003 785736 / 795203
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 232
specjbb.comm.connect.selector.runner.count 0 1
specjbb.comm.connect.timeouts.connect 60000 900000
specjbb.comm.connect.timeouts.read 60000 800000
specjbb.comm.connect.timeouts.write 60000 800000
specjbb.comm.connect.worker.pool.max 256 81
specjbb.comm.connect.worker.pool.min 1 24
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 480 {Tier1=234, Tier2=7, Tier3=30}
specjbb.group.count 1 16
specjbb.mapreducer.pool.size 480 223
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 946670 IR
High-bound (settled) is 916354 IR