SPEC(R) MPIL2007 Summary SGI SGI Altix ICE 8200EX (Intel Xeon X5560, 2.80 GHz) Tue Jan 5 19:01:07 2010 MPI2007 License: 4 Test date: Jan-2010 Test sponsor: SGI Hardware availability: Sep-2009 Tested by: SGI Software availability: Dec-2009 Base Base Base Peak Peak Peak Benchmarks Ranks Run Time Ratio Ranks Run Time Ratio -------------- ------ --------- --------- ------ --------- --------- 121.pop2 512 228 17.1 S 121.pop2 512 224 17.4 S 121.pop2 512 224 17.4 * 122.tachyon 512 278 7.00 S 122.tachyon 512 250 7.79 * 122.tachyon 512 249 7.79 S 125.RAxML 512 494 5.91 * 125.RAxML 512 494 5.91 S 125.RAxML 512 501 5.83 S 126.lammps 512 194 12.6 S 126.lammps 512 195 12.6 * 126.lammps 512 196 12.5 S 128.GAPgeofem 512 319 18.6 * 128.GAPgeofem 512 320 18.6 S 128.GAPgeofem 512 312 19.0 S 129.tera_tf 512 162 6.80 * 129.tera_tf 512 162 6.77 S 129.tera_tf 512 161 6.83 S 132.zeusmp2 512 129 16.5 * 132.zeusmp2 512 129 16.4 S 132.zeusmp2 512 128 16.5 S 137.lu 512 119 35.3 S 137.lu 512 119 35.3 S 137.lu 512 119 35.3 * 142.dmilc 512 99.3 37.1 * 142.dmilc 512 99.4 37.1 S 142.dmilc 512 99.2 37.1 S 143.dleslie 512 151 20.6 * 143.dleslie 512 151 20.6 S 143.dleslie 512 149 20.8 S 145.lGemsFDTD 512 196 22.5 * 145.lGemsFDTD 512 196 22.5 S 145.lGemsFDTD 512 195 22.6 S 147.l2wrf2 512 356 23.1 S 147.l2wrf2 512 356 23.0 * 147.l2wrf2 512 356 23.0 S ============================================================================== 121.pop2 512 224 17.4 * 122.tachyon 512 250 7.79 * 125.RAxML 512 494 5.91 * 126.lammps 512 195 12.6 * 128.GAPgeofem 512 319 18.6 * 129.tera_tf 512 162 6.80 * 132.zeusmp2 512 129 16.5 * 137.lu 512 119 35.3 * 142.dmilc 512 99.3 37.1 * 143.dleslie 512 151 20.6 * 145.lGemsFDTD 512 196 22.5 * 147.l2wrf2 512 356 23.0 * SPECmpiL_base2007 16.1 SPECmpiL_peak2007 Not Run BENCHMARK DETAILS ----------------- Type of System: Homogeneous Total Compute Nodes: 64 Total Chips: 128 Total Cores: 512 Total Threads: 1024 Total Memory: 2304 GB Base Ranks Run: 512 Minimum Peak Ranks: -- Maximum Peak Ranks: -- C Compiler: Intel C Compiler for Linux Version 11.1, Build 20091130 C++ Compiler: Intel C++ Compiler for Linux Version 11.1, Build 20091130 Fortran Compiler: Intel Fortran Compiler for Linux Version 11.1, Build 20091130 Base Pointers: 64-bit Peak Pointers: 64-bit MPI Library: SGI MPT 1.25 Other MPI Info: OFED-1.4.1 Pre-processors: None Other Software: None Node Description: SGI Altix ICE 8200EX Compute Node =================================================== HARDWARE -------- Number of nodes: 64 Uses of the node: compute Vendor: SGI Model: SGI Altix ICE 8200EX (Intel Xeon X5560, 2.80 GHz) CPU Name: Intel Xeon X5560 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 8 Cores per chip: 4 Threads per core: 2 CPU Characteristics: Intel Turbo Boost Technology up to 3.2 GHz, 6.4 GT/s QPI, Hyper-Threading enabled CPU MHz: 2800 Primary Cache: 32 KB I + 32 KB D on chip per core Secondary Cache: 256 KB I+D on chip per core L3 Cache: 8 MB I+D on chip per chip Other Cache: None Memory: 36 GB (6*4GB + 6*2GB DDR3-1333 CL9 RDIMMs running at 1066 MHZ. The 4GB DIMM is installed in DIMM slot A in each channel.) Disk Subsystem: None Other Hardware: None Adapter: Mellanox MT26418 ConnectX IB DDR (PCIe x8 Gen2 5 GT/s) Number of Adapters: 1 Slot Type: PCIe x8 Gen2 Data Rate: InfiniBand 4x DDR Ports Used: 2 Interconnect Type: InfiniBand SOFTWARE -------- Adapter: Mellanox MT26418 ConnectX IB DDR (PCIe x8 Gen2 5 GT/s) Adapter Driver: OFED-1.4.1 Adapter Firmware: 2.6.0 Operating System: SUSE Linux Enterprise Server 10 (x86_64) SP2 Kernel 2.6.16.60-0.30-smp Local File System: None Shared File System: NFSv3 IPoIB System State: Multi-user, run level 3 Other Software: SGI ProPack 6 for Linux Service Pack 5, SGI Tempo V 1.9 Node Description: SGI InfiniteStorage Nexis 2000 NAS ==================================================== HARDWARE -------- Number of nodes: 1 Uses of the node: fileserver Vendor: SGI Model: SGI Altix XE 240 (Intel Xeon 5140, 2.33 GHz) CPU Name: Intel Xeon 5140 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 4 Cores per chip: 2 Threads per core: 1 CPU Characteristics: 1333 MHz FSB CPU MHz: 2333 Primary Cache: 32 KB I + 32 KB D on chip per core Secondary Cache: 4 MB I+D on chip per chip L3 Cache: None Other Cache: None Memory: 16 GB (8*2GB DDR2-667MHz DIMMS) Disk Subsystem: 4.3 TB RAID 5 48 x 146 GB SAS (Seagate Cheetah 15K.5 ) Other Hardware: None Adapter: Mellanox MT26418 ConnectX IB DDR (PCIe x8 Gen2 5 GT/s) Number of Adapters: 2 Slot Type: PCIe x8 Gen2 Data Rate: InfiniBand 4x DDR Ports Used: 2 Interconnect Type: InfiniBand SOFTWARE -------- Adapter: Mellanox MT26418 ConnectX IB DDR (PCIe x8 Gen2 5 GT/s) Adapter Driver: OFED-1.4.1 Adapter Firmware: 2.3.0 Operating System: SUSE Linux Enterprise Server 10 (x86_64) SP1 Kernel 2.6.16.54-0.2.5-smp Local File System: xfs Shared File System: -- System State: Multi-user, run level 3 Other Software: SGI ProPack 5 for Linux Service Pack 5 Interconnect Description: InfiniBand (MPI) ========================================== HARDWARE -------- Vendor: Mellanox Technologies Model: MT26418 ConnectX Switch Model: Mellanox MT48436 InfiniScale-IV Number of Switches: 128 Number of Ports: 36 Data Rate: InfiniBand 4x QDR Firmware: 4020001 Topology: Bristle hypercube with double dimensional links Primary Use: MPI traffic Interconnect Description: InfiniBand (I/O) ========================================== HARDWARE -------- Vendor: Mellanox Technologies Model: MT26418 ConnectX Switch Model: Mellanox MT48436 InfiniScale-IV Number of Switches: 64 Number of Ports: 36 Data Rate: InfiniBand 4x QDR Firmware: 4020001 Topology: Bristle hypercube with double dimensional links Primary Use: I/O traffic Submit Notes ------------ The config file option 'submit' was used. General Notes ------------- Software environment: export MPI_REQUEST_MAX=65536 export MPI_TYPE_MAX=32768 export MPI_BUFS_THRESHOLD=1 export MPI_DSM_DISTRIBUTE=yes export MPI_IB_RAILS=2 ulimit -s unlimited BIOS settings: AMI BIOS version 8.15 Hyper-Threading Technology enabled (default) Intel Turbo Boost Technology enabled (default) Intel Turbo Boost Technology activated in the OS via /etc/init.d/acpid start /etc/init.d/powersaved start powersave -f Interconnect Data Rate: The system interconnect has DDR InfiniBand HCAs, while the switches and cables run up to QDR rate. Job Placement: Each MPI job was assigned to a topologically compact set of nodes, i.e. the minimal needed number of switches was used for each job: 2 switches for 16/32/64 ranks, 4 switches for 128 ranks, 8 switches for 256 ranks, 16 switches for 512 ranks, 32 switches for 1024 ranks, 64 switches for 2048 ranks and 128 switches for 4096 ranks. Base Compiler Invocation ------------------------ C benchmarks: icc C++ benchmarks: 126.lammps: icpc Fortran benchmarks: ifort Benchmarks using both Fortran and C: icc ifort Base Portability Flags ---------------------- 121.pop2: -DSPEC_MPI_CASE_FLAG Base Optimization Flags ----------------------- C benchmarks: -O3 -xSSE4.2 -no-prec-div C++ benchmarks: 126.lammps: -O3 -xSSE4.2 -no-prec-div -ansi-alias Fortran benchmarks: -O3 -xSSE4.2 -no-prec-div Benchmarks using both Fortran and C: -O3 -xSSE4.2 -no-prec-div Base Other Flags ---------------- C benchmarks: -lmpi C++ benchmarks: 126.lammps: -lmpi Fortran benchmarks: -lmpi Benchmarks using both Fortran and C: -lmpi The flags file that was used to format this result can be browsed at http://www.spec.org/mpi2007/flags/SGI_x86_64_Intel111_flags.20100202.html You can also download the XML flags source by saving the following link: http://www.spec.org/mpi2007/flags/SGI_x86_64_Intel111_flags.20100202.xml SPEC and SPEC MPI are registered trademarks of the Standard Performance Evaluation Corporation. All other brand and product names appearing in this result are trademarks or registered trademarks of their respective holders. ----------------------------------------------------------------------------- For questions about this result, please contact the tester. For other inquiries, please contact webmaster@spec.org. Copyright 2006-2010 Standard Performance Evaluation Corporation Tested with SPEC MPI2007 v85. Report generated on Tue Jul 22 13:39:19 2014 by MPI2007 ASCII formatter v1463. Originally published on 2 February 2010.