| MPI2007 license: | 4 | Test date: | Dec-2013 |
|---|---|---|---|
| Test sponsor: | SGI | Hardware Availability: | Sep-2013 |
| Tested by: | SGI | Software Availability: | Nov-2013 |
| Benchmark | Base | Peak | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
| Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||
| 104.milc | 80 | 93.7 | 16.7 | 93.3 | 16.8 | 93.4 | 16.8 | |||||||
| 107.leslie3d | 80 | 259 | 20.2 | 258 | 20.2 | 259 | 20.2 | |||||||
| 113.GemsFDTD | 80 | 207 | 30.4 | 208 | 30.3 | 208 | 30.3 | |||||||
| 115.fds4 | 80 | 111 | 17.6 | 111 | 17.7 | 111 | 17.6 | |||||||
| 121.pop2 | 80 | 216 | 19.1 | 216 | 19.1 | 216 | 19.1 | |||||||
| 122.tachyon | 80 | 161 | 17.4 | 161 | 17.4 | 161 | 17.4 | |||||||
| 126.lammps | 80 | 180 | 16.2 | 179 | 16.2 | 180 | 16.2 | |||||||
| 127.wrf2 | 80 | 213 | 36.6 | 213 | 36.6 | 213 | 36.6 | |||||||
| 128.GAPgeofem | 80 | 83.5 | 24.7 | 83.4 | 24.8 | 83.0 | 24.9 | |||||||
| 129.tera_tf | 80 | 156 | 17.8 | 155 | 17.9 | 155 | 17.8 | |||||||
| 130.socorro | 80 | 80.8 | 47.3 | 80.6 | 47.4 | 80.8 | 47.2 | |||||||
| 132.zeusmp2 | 80 | 137 | 22.7 | 136 | 22.8 | 137 | 22.7 | |||||||
| 137.lu | 80 | 138 | 26.7 | 133 | 27.7 | 135 | 27.2 | |||||||
| Software Summary | |
|---|---|
| C Compiler: | Intel C++ Composer XE 2011 for Linux, Version 14.0.0.080 Build 20130728 |
| C++ Compiler: | Intel C++ Composer XE 2011 for Linux, Version 14.0.0.080 Build 20130728 |
| Fortran Compiler: | Intel Fortran Composer XE 2011 for Linux, Version 14.0.0.080 Build 20130728 |
| Base Pointers: | 64-bit |
| Peak Pointers: | 64-bit |
| MPI Library: | SGI MPT 2.09 |
| Other MPI Info: | OFED 1.5.2 |
| Pre-processors: | None |
| Other Software: | None |
| Hardware | |
|---|---|
| Number of nodes: | 4 |
| Uses of the node: | compute |
| Vendor: | SGI |
| Model: | SGI ICE X IP-113 (Intel Xeon E5-2690 v2, 3.0 GHz) |
| CPU Name: | Intel Xeon E5-2690 v2 |
| CPU(s) orderable: | 1-2 chips |
| Chips enabled: | 2 |
| Cores enabled: | 20 |
| Cores per chip: | 10 |
| Threads per core: | 2 |
| CPU Characteristics: | Ten Core, 3.0 GHz, 8.0 GT/s QPI Intel Turbo Boost Technology up to 3.60 GHz Hyper-Threading Technology enabled |
| CPU MHz: | 3000 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 256 KB I+D on chip per core |
| L3 Cache: | 25 MB I+D on chip per chip |
| Other Cache: | None |
| Memory: | 64 GB (8 x 8 GB 2Rx4 PC3-14900R-13, ECC) |
| Disk Subsystem: | None |
| Other Hardware: | None |
| Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
| Number of Adapters: | 2 |
| Slot Type: | PCIe x8 Gen3 |
| Data Rate: | InfiniBand 4x FDR |
| Ports Used: | 2 |
| Interconnect Type: | InfiniBand |
| Software | |
|---|---|
| Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
| Adapter Driver: | OFED-1.5.2 |
| Adapter Firmware: | 2.11.312 |
| Operating System: | SUSE Linux Enterprise Server 11 SP2, Kernel 3.0.80-0.7-default |
| Local File System: | NFSv3 |
| Shared File System: | NFSv3 IPoIB |
| System State: | Multi-user, run level 3 |
| Other Software: | SGI Tempo Compute Node 2.7.3, Build 708rp14.sles11sp2-1305311204 |
| Hardware | |
|---|---|
| Number of nodes: | 1 |
| Uses of the node: | fileserver |
| Vendor: | SGI |
| Model: | SGI Modular InfiniteStorage Server |
| CPU Name: | Intel Xeon E5-2670 |
| CPU(s) orderable: | 1-2 chips |
| Chips enabled: | 2 |
| Cores enabled: | 16 |
| Cores per chip: | 8 |
| Threads per core: | 2 |
| CPU Characteristics: | Intel Turbo Boost Technology up to 3.33 GHz Hyper-Threading Technology enabled |
| CPU MHz: | 2600 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 256 KB I+D on chip per chip |
| L3 Cache: | 20 MB I+D on chip per chip |
| Other Cache: | None |
| Memory: | 128 GB (8 * 16 GB 2Rx4 PC3-12800R-11, ECC) |
| Disk Subsystem: | 64.8 TB RAID 6 72 x 900 GB SAS (Western Digital, 10K RPM) |
| Other Hardware: | None |
| Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
| Number of Adapters: | 2 |
| Slot Type: | PCIe x8 Gen3 |
| Data Rate: | InfiniBand 4x FDR |
| Ports Used: | 2 |
| Interconnect Type: | InfiniBand |
| Software | |
|---|---|
| Adapter: | Mellanox MT27500 with ConnectX-3 ASIC (PCIe x8 Gen3 8 GT/s) |
| Adapter Driver: | OFED-1.5.0 |
| Adapter Firmware: | 2.11.312 |
| Operating System: | SUSE Linux Enterprise Server 11 SP3 Kernel |
| Local File System: | xfs |
| Shared File System: | -- |
| System State: | Multi-user, run level 3 |
| Other Software: | SGI Foundation Software 2.9, Build 700r3.sles11-1004061553 |
| Hardware | |
|---|---|
| Vendor: | Mellanox Technologies and SGI |
| Model: | None |
| Switch Model: | SGI FDR Integrated IB Switch Blade 2SW9x27 with Mellanox SwitchX device 51000 |
| Number of Switches: | 2 |
| Number of Ports: | 36 |
| Data Rate: | InfiniBand 4x FDR |
| Firmware: | 07130007_LLR and 08130007_LLR |
| Topology: | Enhanced Hypercube |
| Primary Use: | MPI and I/O traffic |
The config file option 'submit' was used.
130.socorro (base): "nullify_ptrs" src.alt was used.
Software environment:
export MPI_REQUEST_MAX=65536
export MPI_TYPE_MAX=32768
export MPI_BUFS_THRESHOLD=1
export MPI_IB_RAILS=2
ulimit -s unlimited
BIOS settings:
AMI BIOS version 3.0
Hyper-Threading Technology enabled (default)
Intel Turbo Boost Technology enabled (default)
Intel Turbo Boost Technology activated in the OS via
/etc/init.d/acpid start
/etc/init.d/powersaved start
powersave -f
Job Placement:
Each MPI job was assigned to a topologically compact set
of nodes, i.e. the minimal needed number of switches was
used for each job: 2 switches for up to 180 ranks,
4 switches for up to 320 ranks, 8 switches for 640 ranks,
10 switches for 800 ranks, 16 switches for 1280 ranks,
22 switches for 1920 ranks, and 30 switches for 2560 ranks,
Additional notes regarding interconnect:
The Infiniband network consists of two independent planes,
with half the switches in the system allocated to each plane.
I/O traffic is restricted to one plane, while MPI traffic can
use both planes.
| icc |
| 126.lammps: | icpc |
| ifort |
| icc ifort |
| 121.pop2: | -DSPEC_MPI_CASE_FLAG |
| 127.wrf2: | -DSPEC_MPI_CASE_FLAG -DSPEC_MPI_LINUX |
| 130.socorro: | -assume nostd_intent_in |