SPECsfs97_R1.v3 Result =============================================================================== BlueArc Corporation : BlueArc Titan 2200, 2-Node Active/Acti SPECsfs97_R1.v3 = 195502 Ops/Sec (Overall Response Time = 2.37 msec) =============================================================================== Throughput Response ops/sec msec 20208 0.8 40214 1.1 60618 1.4 80937 1.8 101499 2.2 121719 2.7 142104 3.1 162759 3.7 181640 5.2 195502 5.6 =============================================================================== Server Configuration and Availability Vendor BlueArc Corporation Hardware Available January 2006 Software Available March 2006 Date Tested November 2005 SFS License number 000063 Licensee Location San Jose, California, USA CPU, Memory and Power Model Name BlueArc Titan 2200, 2-Node Active/Active Cluster Processor MPC7457 POWERPC 1.267GHZ + FPGAs (see notes on FPGAs) # of Processors 2 cores, 2 chips, 1 core/chip (with 14 FPGAs, 7 per node) Primary Cache 32KBI + 32KBD on chip (per chip) Secondary Cache 512KB(I+D) on chip (per chip) Other Cache 16 GB UPS N/A Other Hardware System Management Unit (SMU) - see notes; Four 10Gbit Ethernet Cluster Interconnect Ports, 2 per node Memory Size 47.6 GB (not including other_cache_size and NVRAM) NVRAM Size 4 GB NVRAM Type DIMM NVRAM Description 72 hour battery backed Server Software OS Name and Version BlueArc Titan SU4.2 Other Software N/A File System BlueArc Silicon File System with Cluster Name Space (CNS) NFS version 3 Server Tuning Buffer Cache Size N/A # NFS Processes N/A Fileset Size 1935.5 GB Network Subsystem Network Type Integrated Network Controller Desc. 6-port, 1Gbps Ethernet Number Networks 1 (N1) Number Network Controllers 2 Protocol Type TCP Switch Type Force10 Networks S50 Data Center Switch Bridge Type N/A Hub Type N/A Other Network Hardware N/A Disk Subsystem and Filesystems Number Disk Controllers 2 Number of Disks 416 Number of Filesystems single namespace (see notes) File System Creation Ops 4K block size, CNS enabled File System Config 16 Individual file system volumes aggregated using CNS to present a single, unified namespace, 8 volumes per node Disk Controller Integrated quad-port, 4Gbps FC, each running at 2Gbps # of Controller Type 2 Number of Disks 208 Disk Type 73GB x 15,000 RPM, Seagate ST373454FC File Systems on Disks F1 Special Config Notes see notes Load Generator (LG) Configuration Number of Load Generators 28 Number of Processes per LG 32 Biod Max Read Setting 2 Biod Max Write Setting 2 LG Type LG1 LG Model AMAX 1U Number and Type Processors 2x2.8Ghz Xeon Memory Size 1GB Operating System Redhat Linux 8.0 Compiler SFS97_R1 precompiled Compiler Options N/A Network Type Integrated Intel Pro/1000MT Testbed Configuration LG # LG Type Network Target File Systems Notes ---- ------- ------- ------------------- ----- 1 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 2 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 3 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 4 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A 5 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 6 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 7 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 8 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A 9 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 10 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 11 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 12 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A 13 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 14 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 15 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 16 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A 17 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 18 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 19 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 20 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A 21 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 22 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 23 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 24 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A 25 LG1 1 /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0 N/A 26 LG1 1 /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir3, /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2 N/A 27 LG1 1 /root/dir4, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir5, /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4 N/A 28 LG1 1 /root/dir6, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir7, /root/dir8, /root/dir9, /root/dir10, /root/dir11, /root/dir12, /root/dir13, /root/dir14, /root/dir15, /root/dir0, /root/dir1, /root/dir2, /root/dir3, /root/dir4, /root/dir5, /root/dir6 N/A =============================================================================== Notes and Tuning <> The tested system was a BlueArc Titan 2200, 2-node Active/Active cluster with high memory option and all standard protection services enabled, including RAID, NVRAM logging, NVRAM mirroring, and media error scrubbing. <> Each node was connected to eight dual controller FC-14C disk arrays where each FC-14C has a single FC-14E expansion enclosure connected to it, for a total of 208 disks per node. Sixteen file system volumes were configured (8 per node), each spanning two 12+1 RAID 5 arrays. The sixteen file system volumes were aggregated across both nodes and presented to the network as a single, unified namespace by the BlueArc Titan Silicon File System with Cluster Name Space (CNS) enabled. <> The redundant disk array controllers were each attached to redundant Brocade 4100 FC switches, which were in turn connected to both Titan 2200 nodes to provide a completely redundant switched fabric path between the Titan 2200 and all disk arrays, such that any client could access data on any array through any connection to either server node. <> Both nodes were connected to a Force10 Ethernet network switche. The system is fully redundant and will fail over to redundant components upon any failure of Titan server, FC Fabric or storage array. <> Automatic load balancing was utilized to equalize system drive to FC port workloads <> <> <> Titan uses Field Programmable Gate Arrays to accelerate processing of network traffic and file system I/O. 7 FPGAs are used for NFS processing per node, out of a total of 12 FPGAs per node. <> Server Tuning 1: disable file read-ahead 'fsm read-ahead 0 0'; disable shortname generation for CIFS clients 'shortname -g off'; server running in 'Native Unix' security mode; set metadata cache bias to small files 'fsm cache-bias - small-files'; disable system drive performance monitoring statistics 'sim si-delay-tables off' <> The SMU provides a system management interface for the complete Titan storage solution. <> Jumbo frames were not enabled in this test. <> For UAR compliance, load generators accessed all cluster namespace objects uniformly across both servers in the cluster. This results in 50% of access to each of the servers to be redirected to the other cluster member. The number of potential proc/mount/port/LG combinations is 16x8 = 128 (procs) which we distributed uniformly across all LG's on the same flat network. No routing or bridging was employed so all clients had equal access to all cluster namespace objects, either directly or indirectly (50/50 split), and uniformly, through each cluster member. <> For example: <> S11-14 = Server 1 - network ports 1-4 <> S21-24 = Server 2 - network ports 1-4 <> F1 = cluster namespace root (representing 16 filesystem objects across the entire storage) <> R1-8 = cluster namespace objects rooted to server 1 <> R9-16 = cluster namespace objects rooted to server 2 <> Each LG with 32 procs has uniform access to all storage, utilizing all network ports, and across every 4 clients, the following accesses are uniformly utilized <> (repeated 7 times across 28 LG's): <> S11:F1/R1-8, S11:F1/R9-16, S21:F1/R1-8, S21:F1/R9-16 <> S12:F1/R1-8, S12:F1/R9-16, S22:F1/R1-8, S22:F1/R9-16 <> S13:F1/R1-8, S13:F1/R9-16, S23:F1/R1-8, S23:F1/R9-16 <> S14:F1/R1-8, S14:F1/R9-16, S24:F1/R1-8, S24:F1/R9-16 <> Note that should a server fail in the cluster, all cluster namespace objects are still available to all clients via the remaining server. <> Each Titan 2200 in this cluster has 34.5 gigabytes (GB) of of memory, cache and NVRAM distributed as follows: <> NIM (Network Interface Module) - 2.8 GB memory <> FSA (File System - A) - 4.0 GB memory <> FSB (File System - B) - 17.25 GB, of which 2.0 is NVRAM and 14.5 is temporary FS metadata cache. The remaining amount is used for temporary buffering data moving to/from the disk drives and/or network. <> SIM (Storage Interface Module) - 9.75 GB, of which 8.0 is "sector" cache used for interface with RAID controllers and disk subsystem. <> The 16.0 GB of "other cache size" listed in this submission refers to the 8.0 GB of sector cache in each SIM module. =============================================================================== Generated on Wed Feb 22 15:09:27 EST 2006 by SPEC SFS97 ASCII Formatter Copyright (c) 1997-2004 Standard Performance Evaluation Corporation