Super Micro Computer, Inc Supermicro A+ Server AS-2124BT-HTR Model H12DST-B 1231087 SPECjbb2015-Distributed max-jOPS
566486 SPECjbb2015-Distributed critical-jOPS
Tested by: Super Micro Computer, Inc Test Sponsor: Super Micro Computer, Inc Test location: San Jose, California Test date: October 22, 2019
SPEC license #: 001176 Hardware Availability: December-2019 Software Availability: Sep-2019 Publication: Thu Nov 7 16:49:16 EST 2019
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes4
All Nodes IdenticalYES
Nodes Per System4
Total Chips8
Total Cores512
Total Threads1024
Total Memory Amount (GB)4096
Total OS Images4
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSupermicro A+ Server AS-2124BT-HTR
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
AvailableDecember-2019
ModelH12DST-B
Form Factor2U
CPU NameAMD EPYC 7742
CPU Characteristics64 core, 2.25GHz, 256MB L3 Cache (Turbo Boost Technology up to 3.4 GHz)
Number of Systems1
Nodes Per System4
Chips Per System8
Cores Per System512
Cores Per Chip64
Threads Per System1024
Threads Per Core2
VersionT20190905164238 09/05/2019
CPU Frequency (MHz)2250
Primary Cache32KB(I)+32KB(D) per core
Secondary Cache512KB (I+D) per core
Tertiary Cache256MB (I+D) on chip per chip
Other CacheNone
Disk4 x 960GB M.2 PCIe Gen3
File Systembtrfs
Memory Amount (GB)4096
# and size of DIMM(s)64 x 64GB
Memory Details64GB 2Rx4 PC4-2933Y-R
# and type of Network Interface Cards (NICs)1 x Supermicro AOC-MH25G-m2S2T Dual Port 25GbE SFP28 NIC
Power Supply Quantity and Rating (W)2 x 2200W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP1
VendorSUSE
Vendor URLhttp://suse.com/
Version4.12.14-197.18-default
AvailableMay-2019
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 13
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 13
AvailableSep-2019
Bitness64
Notesnote
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameSupermicro A+ Server 1123US-TN10RT
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
AvailableDecember-2019
ModelH11DSU-iN
Form Factor1U
CPU NameAMD EPYC 7742
CPU Characteristics64 core, 2.25GHz, 256MB L3 Cache (Turbo Boost Technology up to 3.4 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System128
Cores Per Chip64
Threads Per System256
Threads Per Core2
Version2.0 06/14/2019
CPU Frequency (MHz)2250
Primary Cache32KB(I)+32KB(D) per core
Secondary Cache512KB (I+D) per core
Tertiary Cache256MB (I+D) on chip per chip
Other CacheNone
Disk1 x 1.8 TB NVMe PCIe Gen3
File Systembtrfs
Memory Amount (GB)1024
# and size of DIMM(s)32 x 32GB
Memory Details32GB 2Rx4 PC4-3200R
# and type of Network Interface Cards (NICs)1 x Supermicro AOC-MH25G-m2S2T Dual Port 25GbE SFP28 NIC
Power Supply Quantity and Rating (W)2 x 1000W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP1
VendorSUSE
Vendor URLhttp://suse.com/
Version4.12.14-197.18-default
AvailableMay-2019
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 13
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 13
AvailableSep-2019
Bitness64
Notesnote
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(4)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • SMT Control = Auto
  • IOMMU = Enabled
  • NUMA nodes per socket = NPS4
  • Determinism Control = Manual
  • Determinism Slider = Power
  • cTDP Control = Manual
  • cTDP = 240
  • Package Power Limit Control = Manual
  • Package Power Limit = 240
  • L1 Stream HW Prefetcher = Disable
  • L2 Stream HW Prefetcher = Disable

Notes notes
OS Image os_Image_1
JVM Instances jvm_Backend_1(32)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 16000000 > /proc/sys/kernel/sched_latency_ns
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 28000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 9 > /proc/sys/kernel/sched_nr_migrate
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 1 > /proc/sys/kernel/sched_tunable_scaling
  • echo 50000000 > /proc/sys/kernel/sched_wakeup_granularity_ns

  • echo 3000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness

  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled

  • Add cgroup_disable=memory,cpu,cpuacct,blkio,hugetlb,pids,cpuset,perf_event,freezer,devices,net_cls,net_prio to GRUB_CMDLINE_LINUX_DEFAULT
  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms32736M -Xmx32736M -Xmn31736M -XX:-UseDynamicNumberOfGCThreads -XX:CICompilerCount=32 -XX:AllocatePrefetchInstr=2 -XX:+UseParallelOldGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseLargePages -XX:TLABAllocationWeight=55 -XX:ThreadStackSize=512 -XX:SurvivorRatio=31 -XX:TargetSurvivorRatio=95 -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=300 -XX:LoopUnrollLimit=100 -XX:+UseTransparentHugePages

Tuning None
Notes

Used numactl to affinitize each Backend JVM to one NUMA node in every H12DST-B node in SuT

  • numactl --cpunodebind=0 --membind=0
  • numactl --cpunodebind=1 --membind=1
  • numactl --cpunodebind=2 --membind=2
  • numactl --cpunodebind=3 --membind=3
  • numactl --cpunodebind=4 --membind=4
  • numactl --cpunodebind=5 --membind=5
  • numactl --cpunodebind=6 --membind=6
  • numactl --cpunodebind=7 --membind=7

Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • SMT Control = Auto
  • IOMMU = Enabled
  • NUMA nodes per socket = NPS4
  • Determinism Control = Manual
  • Determinism Slider = Power
  • cTDP Control = Manual
  • cTDP = 240
  • Package Power Limit Control = Manual
  • Package Power Limit = 240
  • Memory Clock Speed = 2933MHz
  • L1 Stream HW Prefetcher = Disable
  • L2 Stream HW Prefetcher = Disable

Notes notes
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(32)
OS Image Description os_2
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • echo 10000 > /proc/sys/kernel/sched_cfs_bandwidth_slice_us
  • echo 0 > /proc/sys/kernel/sched_child_runs_first
  • echo 16000000 > /proc/sys/kernel/sched_latency_ns
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 28000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 9 > /proc/sys/kernel/sched_nr_migrate
  • echo 100 > /proc/sys/kernel/sched_rr_timeslice_ms
  • echo 1000000 > /proc/sys/kernel/sched_rt_period_us
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 0 > /proc/sys/kernel/sched_schedstats
  • echo 1 > /proc/sys/kernel/sched_tunable_scaling
  • echo 50000000 > /proc/sys/kernel/sched_wakeup_granularity_ns

  • echo 3000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness

  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled

  • Add cgroup_disable=memory,cpu,cpuacct,blkio,hugetlb,pids,cpuset,perf_event,freezer,devices,net_cls,net_prio to GRUB_CMDLINE_LINUX_DEFAULT
  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelOldGC -XX:CICompilerCount=2 -XX:ParallelGCThreads=2

Tuning None
Notes

Used numactl to interleave memory on all CPUs in Driver system

  • numactl --interleave=all

JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelOldGC -XX:CICompilerCount=2 -XX:ParallelGCThreads=2

Tuning None
Notes

Used numactl to affinitize four Transaction Injector JVM (4 Groups) to one NUMA node in Driver system

  • Group1: numactl --cpunodebind=0 --membind=0
  • Group2: numactl --cpunodebind=0 --membind=0
  • Group3: numactl --cpunodebind=0 --membind=0
  • Group4: numactl --cpunodebind=0 --membind=0
  • Group5: numactl --cpunodebind=1 --membind=1
  • Group6: numactl --cpunodebind=1 --membind=1
  • Group7: numactl --cpunodebind=1 --membind=1
  • Group8: numactl --cpunodebind=1 --membind=1
  • ...
  • Group32: numactl --cpunodebind=7 --membind=7

max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 1215304 1231087 1246870 1262654 1278437
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 418254 465603 560302 670784 797050 566486
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 15783 / 31566 - / 15783 - / 15783 - / 15783 - / 15783 - / 15783
1000us 536628 / 552411 63133 / 78916 15783 / 31566 15783 / 31566 - / 15783 - / 15783
5000us 1231087 / - 1041689 / 1057472 520845 / 536628 410362 / 426146 268314 / 284097 - / 15783
10000us 1231087 / - 1152171 / 1167955 868074 / 883858 741809 / 757592 410362 / 426146 - / 15783
25000us 1231087 / - 1215304 / 1231087 1025906 / 1041689 931207 / 946990 457712 / 473495 - / 15783
50000us 1231087 / - 1215304 / 1231087 1057472 / 1073256 962773 / 978557 552411 / 568194 - / 15783
75000us 1231087 / - 1231087 / - 1073256 / 1089039 994340 / 1010123 662893 / 678676 15783 / 31566
100000us 1231087 / - 1231087 / - 1089039 / 1104822 1025906 / 1041689 789158 / 804942 15783 / 31566
200000us 1231087 / - 1231087 / - 1136388 / 1152171 1089039 / 1104822 1010123 / 1025906 378796 / 63133
500000us 1231087 / - 1231087 / - 1167955 / 1183738 1136388 / 1152171 1089039 / 1104822 978557 / 931207
1000000us 1231087 / - 1231087 / - 1183738 / 1199521 1167955 / 1183738 1089039 / 1104822 1057472 / 1041689
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 210
specjbb.comm.connect.selector.runner.count 0 3
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 90
specjbb.controller.host localhost 10.19.40.56
specjbb.customerDriver.threads 64 {probe=64, saturate=64}
specjbb.forkjoin.workers 256 {Tier1=210, Tier2=70, Tier3=28}
specjbb.group.count 1 32
specjbb.mapreducer.pool.size 256 28
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 1578317 IR
High-bound (settled) is 1370630 IR