Lenovo Global Technology ThinkSystem SR665 V3 785886 SPECjbb2015-Distributed max-jOPS
401361 SPECjbb2015-Distributed critical-jOPS
Tested by: Lenovo Global Technology Test Sponsor: Lenovo Global Technology Test location: Beijing, China Test date: Oct 19, 2022
SPEC license #: 9017 Hardware Availability: Dec-2022 Software Availability: Aug-2022 Publication: Thu Nov 10 10:32:32 EST 2022
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorLenovo Global Technology
Vendor URLhttp://www.lenovo.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores192
Total Threads384
Total Memory Amount (GB)1536
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameThinkSystem SR665 V3
VendorLenovo Global Technology
Vendor URLhttp://www.lenovo.com
AvailableDec-2022
ModelThinkSystem SR665 V3
Form Factor2U
CPU NameAMD EPYC 9654
CPU Characteristics96 core, 2.40GHz, 384MB L3 Cache (Max Boost Clock up to 3.70GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System192
Cores Per Chip96
Threads Per System384
Threads Per Core2
VersionKAE103A
CPU Frequency (MHz)2400
Primary Cache32KB(I)+32KB(D) on chip per core
Secondary Cache1MB (I+D) on chip per core
Tertiary Cache384MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480GB SATA SSD
File SystemXFS
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64 GB
Memory Details64 GB 2Rx4 PC5-4800B-R
# and type of Network Interface Cards (NICs)1 x 10/25 GbE PCIE NIC
Power Supply Quantity and Rating (W)1 x 1800W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameRed Hat Enterprise Linux release 8.6 (Ootpa)
VendorRed Hat
Vendor URLhttps://www.redhat.com/
Version4.18.0-372.9.1
AvailableMay-2022
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.4.1
VendorOracle Corporation
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-Bit Server VM, version 17.0.4.1
AvailableAug-2022
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameThinkSystem SR665
VendorLenovo Global Technology
Vendor URLhttp://www.lenovo.com
AvailableAug-2022
ModelThinkSystem SR665
Form Factor2U
CPU NameAMD EPYC 7773X
CPU Characteristics64 core, 2.20GHz, 768 MB L3 Cache (Max Boost Clock up to 3.50GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System128
Cores Per Chip64
Threads Per System256
Threads Per Core2
VersionD8E125J
CPU Frequency (MHz)2200
Primary Cache32KB I + 32KB D on chip per core
Secondary Cache512KB I+D on chip per core
Tertiary Cache768MB (I+D) on chip per chip
Other CacheNone
Disk1 x 960GB SATA SSD
File SystemXFS
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB 2Rx4 PC4-3200AA-R
# and type of Network Interface Cards (NICs)1 x 10/25 GbE PCIE NIC
Power Supply Quantity and Rating (W)1 x 1800W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP4
VendorSUSE
Vendor URLhttp://suse.com/
Version5.14.21-150400.22-default
AvailableJune-2022
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 17.0.4.1
VendorOracle Corporation
Vendor URLhttp://oracle.com/
Versionava HotSpot 64-Bit Server VM, version 17.0.4.1
AvailableAug-2022
Bitness64
Notesnote
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning BIOS Configuration:
  • Operating Mode set to Maximum Performance and then set to Custom Mode
  • NUMA Nodes per Socket set to NPS4
  • L1 Stream HW Prefetcher set to Disabled
  • L2 Stream HW Prefetcher set to Disabled
  • ACPI SRAT L3 Cache as NUMA Domain set to Enabled
  • SOC P-states set to P0
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(24)
OS Image Description os_1
Tuning
  • cpupower frequency-set -g performance
  • tuned-adm profile throughput-performance
  • echo 800000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 200000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 64 > /proc/sys/kernel/sched_nr_migrate
  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 400000 > /proc/sys/kernel/sched_latency_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/vm/numa_stat
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line -Xms30g -Xmx30g -Xmn27g -XX:AllocatePrefetchInstr=2 -XX:+UseParallelGC -XX:ParallelGCThreads=16 -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:SurvivorRatio=28 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=11k -XX:MaxGCPauseMillis=300 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2 -XX:+UseTransparentHugePages -XX:-UseFastStosb
Tuning None
Notes Used numactl to affinitize one Backend JVM (1 Group) to one NUMA node
  • Group1: numactl --cpunodebind=0 --localalloc
  • Group2: numactl --cpunodebind=1 --localalloc
  • Group3: numactl --cpunodebind=2 --localalloc
  • Group4: numactl --cpunodebind=3 --localalloc
  • Group5: numactl --cpunodebind=4 --localalloc
  • Group6: numactl --cpunodebind=5 --localalloc
  • Group7: numactl --cpunodebind=6 --localalloc
  • Group8: numactl --cpunodebind=7 --localalloc
  • Group9: numactl --cpunodebind=8 --localalloc
  • Group10: numactl --cpunodebind=9 --localalloc
  • Group11: numactl --cpunodebind=10 --localalloc
  • Group12: numactl --cpunodebind=11 --localalloc
  • Group13: numactl --cpunodebind=12 --localalloc
  • Group14: numactl --cpunodebind=13 --localalloc
  • Group15: numactl --cpunodebind=14 --localalloc
  • Group16: numactl --cpunodebind=15 --localalloc
  • Group17: numactl --cpunodebind=16 --localalloc
  • Group18: numactl --cpunodebind=17 --localalloc
  • Group19: numactl --cpunodebind=18 --localalloc
  • Group20: numactl --cpunodebind=19 --localalloc
  • Group21: numactl --cpunodebind=20 --localalloc
  • Group22: numactl --cpunodebind=21 --localalloc
  • Group23: numactl --cpunodebind=22 --localalloc
  • Group24: numactl --cpunodebind=23 --localalloc
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning BIOS Configuration:
  • Operating Mode set to Maximum Performance and then set to Custom Mode
  • NUMA Nodes per Socket set to NPS2
  • L1 Stream HW Prefetcher set to Disable
  • L2 Stream HW Prefetcher set to Disable
  • SOC P-states set to P0
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(24)
OS Image Description os_2
Tuning
  • cpupower frequency-set -g performance
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 100000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 600000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 100000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line -Xms10g -Xmx10g -Xmn8g -XX:+UseParallelGC -XX:ParallelGCThreads=4
Tuning None
Notes Used numactl to run all available nodes
  • numactl --interleave=all
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line -Xms4g -Xmx4g -Xmn3680m -XX:+UseParallelGC -XX:ParallelGCThreads=2
Tuning None
Notes Used numactl to affinitize one TxInjector JVM (6 Groups) to one NUMA node
  • Group1: numactl --cpunodebind=0 --localalloc
  • Group2: numactl --cpunodebind=0 --localalloc
  • Group3: numactl --cpunodebind=0 --localalloc
  • Group4: numactl --cpunodebind=0 --localalloc
  • Group5: numactl --cpunodebind=0 --localalloc
  • Group6: numactl --cpunodebind=0 --localalloc
  • Group7: numactl --cpunodebind=1 --localalloc
  • Group8: numactl --cpunodebind=1 --localalloc
  • Group9: numactl --cpunodebind=1 --localalloc
  • Group10: numactl --cpunodebind=1 --localalloc
  • Group11: numactl --cpunodebind=1 --localalloc
  • Group12: numactl --cpunodebind=2 --localalloc
  • Group13: numactl --cpunodebind=2 --localalloc
  • Group14: numactl --cpunodebind=2 --localalloc
  • Group15: numactl --cpunodebind=2 --localalloc
  • Group16: numactl --cpunodebind=2 --localalloc
  • Group17: numactl --cpunodebind=2 --localalloc
  • Group18: numactl --cpunodebind=2 --localalloc
  • Group19: numactl --cpunodebind=3 --localalloc
  • Group20: numactl --cpunodebind=3 --localalloc
  • Group21: numactl --cpunodebind=3 --localalloc
  • Group22: numactl --cpunodebind=3 --localalloc
  • Group23: numactl --cpunodebind=3 --localalloc
  • Group24: numactl --cpunodebind=3 --localalloc
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 777436 785886 794337 802787 811237
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 283088 333790 409844 485897 553500 401361
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 8450 / 16901 - / 8450 - / 8450 - / 8450 - / 8450 - / 8450
1000us 101405 / 109855 25351 / 33802 8450 / 16901 8450 / 16901 - / 8450 - / 8450
5000us 667581 / 676031 312664 / 321115 202809 / 211260 177458 / 185909 126756 / 135206 - / 8450
10000us 718283 / 726734 633779 / 642230 439420 / 447871 363367 / 371817 278863 / 287313 - / 8450
25000us 726734 / 735184 692932 / 701382 591527 / 599978 557726 / 566176 329565 / 338016 - / 8450
50000us 735184 / 743634 709833 / 718283 625329 / 633779 591527 / 599978 405619 / 414069 25351 / 8450
75000us 743634 / 752085 718283 / 726734 642230 / 650680 608428 / 616878 481672 / 490123 25351 / 8450
100000us 743634 / 752085 726734 / 735184 667581 / 676031 625329 / 633779 549275 / 557726 25351 / 16901
200000us 760535 / 768985 735184 / 743634 709833 / 718283 684482 / 692932 625329 / 633779 346466 / 76054
500000us 785886 / - 760535 / 768985 743634 / 752085 735184 / 743634 659130 / 667581 566176 / 557726
1000000us 785886 / - 777436 / 785886 768985 / 777436 752085 / 760535 676031 / 684482 650680 / 633779
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group10.Backend.beJVM Group11.Backend.beJVM Group12.Backend.beJVM Group13.Backend.beJVM Group14.Backend.beJVM Group15.Backend.beJVM Group16.Backend.beJVM Group17.Backend.beJVM Group18.Backend.beJVM Group19.Backend.beJVM Group2.Backend.beJVM Group20.Backend.beJVM Group21.Backend.beJVM Group22.Backend.beJVM Group23.Backend.beJVM Group24.Backend.beJVM Group3.Backend.beJVM Group4.Backend.beJVM Group5.Backend.beJVM Group6.Backend.beJVM Group7.Backend.beJVM Group8.Backend.beJVM Group9.Backend.beJVM
specjbb.comm.connect.client.pool.size 256 384
specjbb.comm.connect.selector.runner.count 0 24
specjbb.comm.connect.timeouts.connect 60000 900000
specjbb.comm.connect.timeouts.read 60000 900000
specjbb.comm.connect.timeouts.write 60000 900000
specjbb.comm.connect.worker.pool.max 256 120 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160 160
specjbb.controller.host localhost 192.168.10.44
specjbb.customerDriver.threads 64 {probe=96, saturate=96}
specjbb.forkjoin.workers 256 {Tier1=210, Tier2=1, Tier3=20}
specjbb.group.count 1 24
specjbb.mapreducer.pool.size 256 4
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 845039 IR
High-bound (settled) is 818540 IR