| CPU2006 license: | 3 | Test date: | May-2016 |
|---|---|---|---|
| Test sponsor: | HPE | Hardware Availability: | Jun-2016 |
| Tested by: | HPE | Software Availability: | Dec-2015 |
| Hardware | |
|---|---|
| CPU Name: | Intel Xeon E7-8891 v4 |
| CPU Characteristics: | Intel Turbo Boost Technology up to 3.50 GHz |
| CPU MHz: | 2800 |
| FPU: | Integrated |
| CPU(s) enabled: | 40 cores, 4 chips, 10 cores/chip |
| CPU(s) orderable: | 2,4 chip |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 256 KB I+D on chip per core |
| L3 Cache: | 60 MB I+D on chip per chip |
| Other Cache: | None |
| Memory: | 512 GB (32 x 16 GB 2Rx4 PC4-2400T-R, running at 1600 MHz) |
| Disk Subsystem: | 1 x 800 GB NVMe PCIe SSD, RAID 0 |
| Other Hardware: | DL580 Gen9 NVMe SSD Express Bay Enablement Kit |
| Software | |
|---|---|
| Operating System: | SUSE Linux Enterprise Server 12 SP1 (x86_64) Kernel 3.12.49-11-default |
| Compiler: | C/C++: Version 16.0.0.101 of Intel C++ Studio XE for Linux; Fortran: Version 16.0.0.101 of Intel Fortran Studio XE for Linux |
| Auto Parallel: | Yes |
| File System: | xfs |
| System State: | Run level 3 (multi-user) |
| Base Pointers: | 64-bit |
| Peak Pointers: | 32/64-bit |
| Other Software: | None |
Results Table
| Benchmark | Base | Peak | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
| Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||
| 410.bwaves | 11.4 | 1190 | 11.2 | 1210 | 11.4 | 1190 | 11.6 | 1170 | 11.5 | 1190 | 11.2 | 1210 |
| 416.gamess | 479 | 40.9 | 480 | 40.8 | 478 | 41.0 | 422 | 46.4 | 422 | 46.4 | 422 | 46.4 |
| 433.milc | 133 | 69.0 | 135 | 68.2 | 132 | 69.5 | 133 | 69.0 | 135 | 68.2 | 132 | 69.5 |
| 434.zeusmp | 40.8 | 223 | 40.6 | 224 | 41.2 | 221 | 40.8 | 223 | 40.6 | 224 | 41.2 | 221 |
| 435.gromacs | 128 | 55.8 | 129 | 55.5 | 128 | 55.7 | 128 | 55.8 | 129 | 55.5 | 128 | 55.7 |
| 436.cactusADM | 11.1 | 1080 | 10.6 | 1130 | 10.8 | 1110 | 11.1 | 1080 | 10.6 | 1130 | 10.8 | 1110 |
| 437.leslie3d | 26.0 | 362 | 24.7 | 380 | 24.7 | 381 | 26.0 | 362 | 24.7 | 380 | 24.7 | 381 |
| 444.namd | 259 | 31.0 | 259 | 31.0 | 259 | 31.0 | 253 | 31.7 | 253 | 31.7 | 253 | 31.7 |
| 447.dealII | 173 | 65.9 | 172 | 66.7 | 173 | 66.0 | 173 | 65.9 | 172 | 66.7 | 173 | 66.0 |
| 450.soplex | 182 | 45.9 | 179 | 46.7 | 181 | 46.0 | 182 | 45.9 | 179 | 46.7 | 181 | 46.0 |
| 453.povray | 84.7 | 62.8 | 84.8 | 62.7 | 83.8 | 63.5 | 76.3 | 69.7 | 74.3 | 71.6 | 75.1 | 70.9 |
| 454.calculix | 145 | 56.8 | 145 | 57.0 | 145 | 56.9 | 134 | 61.7 | 134 | 61.6 | 134 | 61.6 |
| 459.GemsFDTD | 43.3 | 245 | 44.6 | 238 | 43.1 | 246 | 38.3 | 277 | 39.1 | 271 | 38.3 | 277 |
| 465.tonto | 207 | 47.6 | 208 | 47.4 | 208 | 47.3 | 170 | 57.8 | 170 | 58.0 | 169 | 58.1 |
| 470.lbm | 9.29 | 1480 | 9.33 | 1470 | 9.24 | 1490 | 9.29 | 1480 | 9.33 | 1470 | 9.24 | 1490 |
| 481.wrf | 93.1 | 120 | 93.0 | 120 | 92.3 | 121 | 93.1 | 120 | 93.0 | 120 | 92.3 | 121 |
| 482.sphinx3 | 238 | 81.9 | 238 | 81.9 | 237 | 82.3 | 234 | 83.2 | 234 | 83.1 | 237 | 82.4 |
Operating System Notes
Stack size set to unlimited using "ulimit -s unlimited" Transparent Huge Pages enabled with: echo always > /sys/kernel/mm/transparent_hugepage/enabled
Platform Notes
BIOS Configuration: HP Power Profile set to Custom HP Power Regulator to HP Static High Performance Mode Minimum Processor Idle Power Core C-State set to C6 State Minimum Processor Idle Power Package C-State set to No Package State QPI Snoop Configuration set to Home Snoop Collaborative Power Control set to Disabled Thermal Configuration set to Maximum Cooling Processor Power and Utilization Monitoring set to Disabled Intel Hyperthreading set to Disabled Sysinfo program /home/experiment/fp/new/cpu2006/config/sysinfo.rev6914 $Rev: 6914 $ $Date:: 2014-06-25 #$ e3fbb8667b5a285932ceab81e28219e1 running on linux-vi0i Tue May 17 02:22:02 2016 This section contains SUT (System Under Test) info as seen by some common utilities. To remove or add to this section, see: http://www.spec.org/cpu2006/Docs/config.html#sysinfo From /proc/cpuinfo model name : Intel(R) Xeon(R) CPU E7-8891 v4 @ 2.80GHz 4 "physical id"s (chips) 40 "processors" cores, siblings (Caution: counting these is hw and system dependent. The following excerpts from /proc/cpuinfo might not be reliable. Use with caution.) cpu cores : 10 siblings : 10 physical 0: cores 5 9 10 11 13 18 24 26 28 29 physical 1: cores 5 9 10 11 13 18 24 26 28 29 physical 2: cores 5 9 10 11 13 18 24 26 28 29 physical 3: cores 5 9 10 11 13 18 24 26 28 29 cache size : 61440 KB From /proc/meminfo MemTotal: 529321304 kB HugePages_Total: 0 Hugepagesize: 2048 kB From /etc/*release* /etc/*version* SuSE-release: SUSE Linux Enterprise Server 12 (x86_64) VERSION = 12 PATCHLEVEL = 1 # This file is deprecated and will be removed in a future service pack or release. # Please check /etc/os-release for details about this release. os-release: NAME="SLES" VERSION="12-SP1" VERSION_ID="12.1" PRETTY_NAME="SUSE Linux Enterprise Server 12 SP1" ID="sles" ANSI_COLOR="0;32" CPE_NAME="cpe:/o:suse:sles:12:sp1" uname -a: Linux linux-vi0i 3.12.49-11-default #1 SMP Wed Nov 11 20:52:43 UTC 2015 (8d714a0) x86_64 x86_64 x86_64 GNU/Linux run-level 3 May 16 22:44 SPEC is set to: /home/experiment/fp/new/cpu2006 Filesystem Type Size Used Avail Use% Mounted on /dev/nvme0n1p4 xfs 703G 34G 669G 5% /home Additional information from dmidecode: Warning: Use caution when you interpret this section. The 'dmidecode' program reads system data which is "intended to allow hardware to be accurately determined", but the intent may not be met, as there are frequent changes to hardware, firmware, and the "DMTF SMBIOS" standard. BIOS HP U17 04/26/2016 Memory: 64x UNKNOWN NOT AVAILABLE 32x UNKNOWN NOT AVAILABLE 16 GB 2 rank 2400 MHz, configured at 1600 MHz (End of data from sysinfo program) Regarding the sysinfo display about the memory installed, the correct amount of memory is 512 GB and the dmidecode description should have one line reading as: 32x UNKNOWN NOT AVAILABLE 16 GB 2 rank 2400 MHz, configured at 1600 MHz
General Notes
Environment variables set by runspec before the start of the run: KMP_AFFINITY = "granularity=fine,compact" OMP_NUM_THREADS = "40" LD_LIBRARY_PATH = "/home/experiment/fp/new/cpu2006/libs/32:/home/experiment/fp/new/cpu2006/libs/64:/home/experiment/fp/new/cpu2006/sh" Binaries compiled on a system with 1x Intel Xeon E5-2660 v4 CPU + 128GB memory using RedHat EL 7.2
Base Compiler Invocation
C benchmarks:
| icc -m64 |
C++ benchmarks:
| icpc -m64 |
Fortran benchmarks:
| ifort -m64 |
Benchmarks using both Fortran and C:
| icc -m64 ifort -m64 |
Base Portability Flags
| 410.bwaves: | -DSPEC_CPU_LP64 |
| 416.gamess: | -DSPEC_CPU_LP64 |
| 433.milc: | -DSPEC_CPU_LP64 |
| 434.zeusmp: | -DSPEC_CPU_LP64 |
| 435.gromacs: | -DSPEC_CPU_LP64 -nofor_main |
| 436.cactusADM: | -DSPEC_CPU_LP64 -nofor_main |
| 437.leslie3d: | -DSPEC_CPU_LP64 |
| 444.namd: | -DSPEC_CPU_LP64 |
| 447.dealII: | -DSPEC_CPU_LP64 |
| 450.soplex: | -DSPEC_CPU_LP64 |
| 453.povray: | -DSPEC_CPU_LP64 |
| 454.calculix: | -DSPEC_CPU_LP64 -nofor_main |
| 459.GemsFDTD: | -DSPEC_CPU_LP64 |
| 465.tonto: | -DSPEC_CPU_LP64 |
| 470.lbm: | -DSPEC_CPU_LP64 |
| 481.wrf: | -DSPEC_CPU_LP64 -DSPEC_CPU_CASE_FLAG -DSPEC_CPU_LINUX |
| 482.sphinx3: | -DSPEC_CPU_LP64 |
Base Optimization Flags
C benchmarks:
| -xCORE-AVX2 -ipo -O3 -no-prec-div -static -parallel -opt-prefetch -ansi-alias -qopt-prefetch-issue-excl-hint -auto-ilp32 |
C++ benchmarks:
| -xCORE-AVX2 -ipo -O3 -no-prec-div -static -opt-prefetch -ansi-alias -qopt-calloc |
Fortran benchmarks:
| -xCORE-AVX2 -ipo -O3 -no-prec-div -static -parallel -opt-prefetch -fp-model fast=2 -qopt-prefetch-issue-excl-hint |
Benchmarks using both Fortran and C:
| -xCORE-AVX2 -ipo -O3 -no-prec-div -static -parallel -opt-prefetch -ansi-alias -qopt-prefetch-issue-excl-hint -auto-ilp32 -fp-model fast=2 |
Peak Compiler Invocation
C benchmarks:
| icc -m64 |
C++ benchmarks:
| icpc -m64 |
Fortran benchmarks:
| ifort -m64 |
Benchmarks using both Fortran and C:
| icc -m64 ifort -m64 |
Peak Portability Flags
Same as Base Portability Flags
Peak Optimization Flags
C benchmarks:
| 433.milc: | basepeak = yes |
| 470.lbm: | basepeak = yes |
| 482.sphinx3: | -xCORE-AVX2 -ipo -O3 -no-prec-div -static -parallel -opt-prefetch -ansi-alias -fp-model fast=2 -nofor-main -qopt-prefetch-issue-excl-hint -funroll-all-loops |
C++ benchmarks:
| 444.namd: | -xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -prof-use(pass 2) -fno-alias -auto-ilp32 |
| 447.dealII: | basepeak = yes |
| 450.soplex: | basepeak = yes |
| 453.povray: | -xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -prof-use(pass 2) -unroll4 -ansi-alias |
Fortran benchmarks:
| 410.bwaves: | -xCORE-AVX2 -ipo -O3 -no-prec-div -static -parallel -opt-prefetch -fp-model fast=2 -qopt-prefetch-issue-excl-hint -funroll-all-loops |
| 416.gamess: | -xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -prof-use(pass 2) -unroll2 -inline-level=0 -scalar-rep- |
| 434.zeusmp: | basepeak = yes |
| 437.leslie3d: | basepeak = yes |
| 459.GemsFDTD: | -xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -prof-use(pass 2) -unroll2 -inline-level=0 -opt-prefetch -parallel |
| 465.tonto: | -xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -prof-use(pass 2) -inline-calloc -opt-malloc-options=3 -auto -unroll4 |
Benchmarks using both Fortran and C:
| 435.gromacs: | basepeak = yes |
| 436.cactusADM: | basepeak = yes |
| 454.calculix: | -xCORE-AVX2 -ipo -O3 -no-prec-div -auto-ilp32 -ansi-alias |
| 481.wrf: | basepeak = yes |