SPECsfs97_R1.v3 Result

EMC Corp. :	Celerra 510 cluster (2FS, non-failover)
SPECsfs97_R1.v3 =	33128 Ops/Sec (Overall Response Time = 2.51 msec)

Performance

Throughput (ops/sec)	Response (msec)
3310	1.6
6681	1.6
9966	1.7
13244	1.7
16695	2.0
20069	2.3
23329	2.8
26819	3.4
30181	4.2
33128	8.5

Configuration

Server Configuration and Availability
Vendor	EMC Corp.
Hardware Available	January 2002
Software Available	January 2002
Date Tested	April 17 2002
SFS License Number	47
Licensee Locations	Hopkinton, MA

CPU, Memory and Power

Model Name Celerra 510 cluster (2FS, non-failover)

Processor 866 MHz Pentium III

# of Processors 4

Primary Cache 16KBI+16KBD on chip

Secondary Cache 256KB(I+D) on chip

Other Cache N/A

UPS N/A

Other Hardware 1 507 Control Station, 1 Brocade Silkworm 2800

Memory Size 6 GB (3GB per node)

NVRAM Size N/A

NVRAM Type N/A

NVRAM Description N/A

Server Software

OS Name and Version Dart 4.0.14.0

Other Software Redhat Linux 6.2 on Control Station

File System UxFS

NFS version 3

Server Tuning

Buffer Cache Size Dynamic

# NFS Processes 156

Fileset Size 319.1 GB

Network Subsystem
Network Type	Jumbo Gigabit Ethernet
Network Controller Desc.	Alteon AceNIC
Number Networks	2
Number Network Controllers	4 (2 per node)
Protocol Type	TCP

Switch Type Extreme BlackDiamond Gbe (Jumbo)

Bridge Type N/A

Hub Type N/A

Other Network Hardware N/A

Disk Subsystem and Filesystems

Number Disk Controllers 4

Number of Disks 92

Number of Filesystems 2

File System Creation Ops default

File System Config striped across 44 disk luns with a 64K stripe unit

Disk Controller Emulex LP8000DC Fibre Channel

# of Controller Type 4

Number of Disks 92

Disk Type Seagate Cheetah 73GB 10K RPM

File Systems on Disks OS (2), UxFS Log (2), Filesystem F1(44) F2(44)

Special Config Notes 16GB memory on Symmetrix. See notes below

Load Generator (LG) Configuration
Number of Load Generators	10
Number of Processes per LG	26
Biod Max Read Setting	2
Biod Max Write Setting	2

LG Type LG1

LG Model Sun Sparc 220R

Number and Type Processors 2x450 MHz Sparc

Memory Size 512 MB

Operating System Solaris 2.8

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

LG Type LG2

LG Model Sun Sparc 420R

Number and Type Processors 2x450 MHz Sparc

Memory Size 1 GB

Operating System Solaris 2.8

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

Testbed Configuration

LG # LG Type Network Target File Systems Notes

1 LG1 1 F1,F2,F1,F2.. N/A

2 LG1 1 F1,F2,F1,F2.. N/A

3 LG1 1 F1,F2,F1,F2.. N/A

4 LG1 1 F1,F2,F1,F2.. N/A

5 LG1 1 F1,F2,F1,F2.. N/A

6 LG2 2 F1,F2,F1,F2.. N/A

7 LG2 2 F1,F2,F1,F2.. N/A

8 LG2 2 F1,F2,F1,F2.. N/A

9 LG2 2 F1,F2,F1,F2.. N/A

10 LG1 2 F1,F2,F1,F2.. N/A

Testbed Configuration
LG #	LG Type	Network	Target File Systems	Notes
1	LG1	1	F1,F2,F1,F2..	N/A
2	LG1	1	F1,F2,F1,F2..	N/A
3	LG1	1	F1,F2,F1,F2..	N/A
4	LG1	1	F1,F2,F1,F2..	N/A
5	LG1	1	F1,F2,F1,F2..	N/A
6	LG2	2	F1,F2,F1,F2..	N/A
7	LG2	2	F1,F2,F1,F2..	N/A
8	LG2	2	F1,F2,F1,F2..	N/A
9	LG2	2	F1,F2,F1,F2..	N/A
10	LG1	2	F1,F2,F1,F2..	N/A

Other Notes

param ufs inoHashTableSize=646413 (inode hash table size)
param ufs inoBlkHashSize=129287 (inode block hash size)
param ufs updateAccTime=0 (disable access-time updates)
param nfs withoutCollector=1 (enable NFS-to-CPU thread affinity)
file initialize nodes=646400 dnlc=880000
ace ace0 offload (offload IP checksum computation to the NIC)
ace ace1 offload (offload IP checksum computation to the NIC)
ap pgoff (turn paging off at the CPU level)
nfs start openfiles=413696 nfsd=156
The ufs log was 256 MB
The Symmetrix 8430 used for storage exposes Luns across multiple
Fibre ports. Each Lun is 9G in size. 4 of the fibre ports are connected to
the Fibre switch and zoned along with the 4 ports on the 2 nodes.
Each filesystem is built on a stripe that spans across the filesystem luns.
The Symmetrix was configured with 16GB memory
Client tuning:
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_cwnd_max 2097152
ndd -set /dev/tcp tcp_max_buf 4194304

LG Type	LG1
LG Model	Sun Sparc 220R
Number and Type Processors	2x450 MHz Sparc
Memory Size	512 MB
Operating System	Solaris 2.8
Compiler	Sun Forte 6.2
Compiler Options	None
Network Type	Intraserver Gbe

LG Type	LG2
LG Model	Sun Sparc 420R
Number and Type Processors	2x450 MHz Sparc
Memory Size	1 GB
Operating System	Solaris 2.8
Compiler	Sun Forte 6.2
Compiler Options	None
Network Type	Intraserver Gbe