SPECsfs2008_cifs Result

Throughput (ops/sec) Response (msec) 11824 0.7 23685 0.8 35572 0.9 47399 1.1 59418 2.0 71119 2.2 83073 2.4 95116 2.7 107243 3.3 118463 6.4

Tested By	EMC Corporation
Product Name	Celerra Gateway NS-G8 Server Failover Cluster, 3 Datamovers (1 stdby) / Symmetrix V-Max
Hardware Available	December 2009
Software Available	December 2009
Date Tested	December 2009
SFS License Number	47
Licensee Locations	Hopkinton, MA

The NS-G8 Gateway Server system is a consolidation of file-based servers with NAS (NFS, CIFS) applications configured in a 2+1 High-Availability cluster. The servers deliver network services over high-speed Gigabit Ethernet. The cluster tested here consists of two active datamovers that each provides 4 Jumbo-frame capable Gigabit Ethernet interfaces and one stand-by datamover to provide high availability. The NS-G8 is a gateway to Shared Storage Array Symmetrix V-Max. The Symmetrix V-Max is a new storage architecture using 4 V-Max engines interconnected via a set of multiple active 4 Gbit/s FC HBAs connecting to the fabric.

Item No	Qty	Type	Vendor	Model/Name	Description
1	1	Enclosure	EMC	NSG8-DME0	Celerra NS-G8 empty datamover add on enclosure
2	1	Enclosure	EMC	NSG8-DME1	Celerra NS-G8 empty datamover add on enclosure
3	3	Datamover	EMC	NSG8-DM-8A	Celerra NS-G8 datamover, 4 GbE ports, 4 FC ports
4	1	Control station	EMC	NSG8-CSB	Celerra NS-G8 control station (Administration only)
5	3	Software	EMC	NSG8-UNIX-L	Celerra NS-G8 UNIX License
6	1	Intelligent Storage Array Engine	EMC	SB-64-BASE	Symmetrix V-Max Base Engine, 64 GB Cache
7	3	Intelligent Storage Array Engine	EMC	SB-ADD64NDE	Symmetrix V-Max Add Engine, 64 GB Cache
8	16	FE IO Module	EMC	SB-FE80000	Symmetrix V-Max Front End IO Module with multimode SFP's
9	16	Drive Enclosure	EMC	SB-DE15-DIR	V-Max Direct Connect Storage Bay, Drive Enclosure
10	96	Flash Disk	STEC	NF4F14001B	V-Max Enterprise Flash Drive (EFD) 400 GB 4 Gbit/s FC optical
11	4	FC Disk	SEAGATE	NS4154501B	V-Max Cheetah 450 GB 15K.6 4 Gbit/s FC Disks
12	4	Standby Power Supply	EMC	SB-DB-SPS	V-Max Standby Power Supply
13	1	FC Switch	EMC	EMC DS-300B	24 port Fibre Channel Switch

OS Name and Version	DART 5.6.46.4
Other Software	EMC Celerra Control Station Linux 2.6.9-67.0.4.5611
Filesystem Software	Celerra UxFS File System

Name	Value	Description
ufs syncInterval	22500	Timeout between UFS log flushes
cifs vnodepercent	100	Vnode percentage flush start
cifs M83search	0	Search in the 8.3 name space is disable if the M256 search has failed
ufs inoBlkHashSize	170669	Inode block hash size
ufs updateAccTime	0	Disable access time updates
cifs prealloc	1	Preallocates file space on creation, rather than having the IO expand the file
file prefetch	0	Disable DART read prefetch
ufs inoHighWaterMark	65536	Number of dirty inode buffers per filesystem
cifs enableFileFiltering	0	Bit vector to enable various forms of file filtering
ufs inoHashTableSize	2005027	Inode hash table size
cifs maxMpxCount	1024	Unacknowledged command count max
kernel maxStrToBeProc	24	Number of network streams to process at once
ufs nFlushIno	48	Number of UxFS inode blocks flush threads
kernel outerLoop	16	Number of consecutive iterations of network packets processing
kernel buffersWatermarkPercentage	5	Flushing buffer cache threashold

Server Tuning Notes

Description	Number of Disks	Usable Size
This set of 96 EFD disks is divided into 48 2-disk RAID1 pairs, each with 4 LUs per drive, exported as 192 logical volumes. All data file systems reside on these disks.	96	18.8 TB
This set of FC disks consists of 2 2-disk RAID1 pairs, each with 2 LUs per drive, exported as 8 logical volumes. These disks are reserved for Celerra system use	4	900.0 GB
Total	100	19.6 TB

Number of Filesystems	8
Total Exported Capacity	17600 GB
Filesystem Type	UxFS
Filesystem Creation Options	Default
Filesystem Config	Each filesystem is striped (32 KB elementsize), across 48 disks (192 logical volumes) for fs1 fs2 fs3 fs4 fs5 fs6 fs7 and fs8
Fileset Size	13826.4 GB

The stripe size for all RAID1 logical volumes was 32 KB. Each logical volume was 100 GB. The filesystem named fs1 was built on a Celerra meta volume made by striping across 24 logical volumes on the first V-Max Engine. The filesystem named fs2 was built on a Celerra meta volume made by striping across 24 logical volumes on same V-Max Engine. fs3 and fs4 were configured similar on the second V-Max Engine. Same with fs5 and fs6 on 3rd V-Max Engine and fs7 and fs8 on the last V-Max Engine.

Item No	Network Type	Number of Ports Used	Notes
1	Jumbo Gigabit Ethernet	8	This is the Gigabit network interface used for both datamovers.

Network Configuration Notes

All Gigabit network interfaces were connected to a Cisco 6509 switch.

An MTU size of 9000 was set for all connections to the switch. Each datamover was connected to the network via 4 ports. The LG1 class workload machines were connected with one port each.

Item No	Qty	Type	Description	Processing Function
1	4	CPU	Dual Intel Quad-core 2.3 GHz Xeon E5345 8 MB L2 cache for each datamover server. 4 chips active for the workload. (2 standby not in the quantity)	CIFS protocol, UxFS filesystem

Processing Element Notes

Each datamover has two physical processors.

Description	Size in GB	Number of Instances	Total GB	Nonvolatile
Each datamover main memory. (4 GB in the standby datamover not in the quantity)	4	2	8	V
V-Max storage array battery backed global memory. (64 GB per V-Max engine)	64	4	256	NV
Grand Total Memory Gigabytes			264

Memory Notes

The Symmetrix V-Max was configured with a total of 256 GB of memory. The memory is backed up with sufficient battery power to safely destage all the cached data onto the disk in the event of a power failure.

8 CIFS file systems were used. Each RAID1 pair had 4 LUs bound on it. Each file system was striped over a quarter of the logical volumes. The storage array had 8 Fibre Channel connections, 4 per datamover.

The system under test consisted of 2 NS-G8 Gateway datamovers attached to a Symmetrix V-Max Storage Array with 4 FC links. The datamovers were running DART 5.6.46.4. 4 GbE Ethernet ports per datamover were connected to the network.

Failover is supported by an additional Celerra datamover that operates in stand-by mode. In the event of the datamover failure, this unit takes over the function of the failed unit. The stand-by datamover does not contribute to the performance of the system and it is not included in the components listed above.

Item No	Qty	Vendor	Model/Name	Description
1	24	Dell	Dell PowerEdge 1850	Dell server with 1 GB RAM and the Linux 2.6.9-42.ELsmp operating system

LG Type Name	LG1
BOM Item #	1
Processor Name	Intel(R) Xeon(TM) CPU 3.60GHz
Processor Speed	3.6 GHz
Number of Processors (chips)	2
Number of Cores/Chip	2
Memory Size	1 GB
Operating System	Linux 2.6.9-42.ELsmp
Network Type	1 x Broadcom BCM5704 NetXtreme Gigabit Ethernet

Benchmark Parameters

Network Attached Storage Type	CIFS
Number of Load Generators	24
Number of Processes per LG	32

Testbed Configuration

LG No	LG Type	Network	Target Filesystems	Notes
1..24	LG1	1	/fs1,/fs2,/fs3.../fs7,/fs8	N/A

Load Generator Configuration Notes

All filesystems were mounted on all clients, which were connected to the same physical and logical network.

Each client has the same file systems mounted from each of the two active datmovers.

Failover is supported by an additional Celerra datamover that operates in stand-by mode. In the event of the datamover failure, this unit takes over the function of the failed unit. The stand-by datamover does not contribute to the performance of the system and it is not included in the components listed above.

Symmetrix V-Max was configured with 256 GB of memory, 64 GB per V-Max engine. The memory is backed up with sufficient battery power to safely destage all the cached data onto the disk in the event of a power failure.

• Config Diagram