SPECsfs2008_nfs.v3 Result ================================================================================ Huawei : Huawei OceanStor 9000 Storage System, 20 nodes SPECsfs2008_nfs. = 1007611 Ops/Sec (Overall Response Time = 1.90 msec) v3 ================================================================================ Performance =========== Throughput Response (ops/sec) (msec) --------------------- ---------------- 100050 1.3 200409 1.5 300817 1.6 401085 1.9 500903 2.0 601892 2.3 704199 2.3 803654 2.5 913094 2.2 1007611 2.8 ================================================================================ Product and Test Information ============================ Tested By Huawei Product Name Huawei OceanStor 9000 Storage System, 20 nodes Hardware Available July 2013 Software Available October 2013 Date Tested October 2013 SFS License Number 3175 Licensee Locations Chengdu Research Institute U9 Huawei Chengdu Base, No.1899, Xiyuan Avenue, Hi-tech Western District, Chengdu, Sichuan Province, CHINA The Huawei OceanStor 9000 is a Big Data storage product. Applicable industries include broadcasting media, satellite mapping, genetic research, energy exploration, scientific research and education. With a distributed architecture, the OceanStor 9000 supports seamless scale-out from 3 to a maximum of 288 nodes. All nodes are symmetrically arranged in the OceanStor 9000. The OceanStor 9000 supports on-demand hitless scale-out, which increases capacity and performance linearly. The OceanStor 9000 offers up to 40 PB in a single file system. Such massive scalability helps maximally reduce your CAPEX and TCO while enabling the OceanStor 9000 to optimally adapt to your changing storage requirements. Configuration Bill of Materials =============================== Ite m No Qty Type Vendor Model/Name Description --- --- ---- ------ ---------- ----------- 1 20 Storage Huawei OceanStor OceanStor 9000 high performance node(P Node 9000 P Node Node), including slots for 25 2.5 inch storage devices. 2 120 200GB SSD Huawei Disk drive HSSD 200GB SAS disk solid state Drive(2.5"). 3 380 900GB SAS Huawei Disk drive 900GB 10K RPM SAS Disk Drive(2.5"). Disk 4 1 10GE Huawei Cloud Engine Huawei Cloud Engine switch with 400 network 12800 switch 10GE ports switch Server Software =============== OS Name and Version Huawei OceanStor 9000 V100R001C00 Other Software Huawei OceanStor Integrated Storage Management-N V100R001C00 Filesystem Software WushanFS Server Tuning ============= Name Value Description ---- ----- ----------- nfsd number 64 The number of NFS threads has been increased to 64 by editing /proc/fs/nfsd/work_threads. NFS_MOUNTD_T 8 The maximum number of concurrent mount threads the server HREAD_NUM can handle simultaneously. tcp_mem 9437184 Socket buffer sizes for the 10GE ports. 0 tcp_rmem 9437184 Socket receive buffer sizes for the 10GE ports. 0 tcp_wmem 4718592 Socket send buffer sizes for the 10GE ports. 0 Server Tuning Notes ------------------- None Disks and Filesystems ===================== Description Number of Disks Usable Size ----------- --------------- ----------- 200GB SSDs 120 21.8 TB 900GB SAS drives 380 308.8 TB Total 500 330.5 TB Number of Filesystems 1 Total Exported Capacity 338480 GB Filesystem Type WushanFS Filesystem Creation Options Default Filesystem Config Reed-Solomon (8 + 1) Fileset Size 117201.5 GB The system contains 20 P Nodes. Each has 6 200GB SSDs and 19 900GB SAS disks. The WiseTier software dynamically recognizes hot files and migrates them between the SSDs and the SAS disks; hotspots are stored on the SSDs and colder files on the SAS disks. File data for a given file is striped across 9 P Nodes. Reed-Solomon erasure coding (8 + 1) is the default protection level for an OceanStor 9000 20-node system. +2 and +3 protection levels are also available. Network Configuration ===================== Number Ite of m Ports No Network Type Used Notes --- ------------ ------- ----- 1 10 Gigabit 40 There are 2 10GE network ports used per OceanStor 9000 Ethernet P Node for internal connection, with MTU size 9000. 2 10 Gigabit 20 There is 1 10GE network port used per OceanStor 9000 P Ethernet Node for external connection, with MTU size 1500. Network Configuration Notes --------------------------- All network interfaces were connected to the 10GE network switch(Huawei CE12800). Benchmark Network ================= For each client, 4 10GE interfaces are bonded to one port, with MTU size 1500. Processing Elements =================== Item No Qty Type Description Processing Function ----- --- ---- ----------- ------------------- 1 40 CPU Intel Six-Core Xeon Processor E5-2420, WushanFS, NFS, TCP/IP 1.9GHz, 15MB L3 cache Processing Element Notes ------------------------ Each of the OceanStor 9000 P Nodes has 2 physical processors, and each processor has 6 physical cores. Hyperthreading is enabled, yielding 24 hardware threads per node. Memory ====== Number Nonvo Size of Inst Total latil Description in GB ances GB e ----------- ----- ------- ------ ----- OceanStor 9000 P Node System Memory 96 20 1920 V NVDIMM Non-volatile Memory on PCIe adapter, used to 2 20 40 NV provide stable storage for writes not yet committed to disk. Grand Total Memory Gigabytes 1960 Memory Notes ------------ Each OceanStor 9000 P Node has main memory for the operating system and filesystem data. A separate, NVDIMM module is used to provide stable storage for writes not yet committed to disk. Stable Storage ============== The NVDIMM in each OceanStor 9000 P Node stores and journals writes until they can be flushed to the disks. Each NVDIMM has a capacitor and 2GB flash. Data in the NVDIMM is flushed to flash using capacitor power (up to 25 seconds) when node power fails. Writes are ACKed to the client once they have been written and journaled in the NVDIMM. When the system comes back up after an outage, the journal in the NVDIMM flash is replayed. In the event of capacitor failure, data is no longer journaled in the NVDIMM, but is written to disks on a write-through basis. System Under Test Configuration Notes ===================================== The system under test consists of 20 2U OceanStor 9000 P Nodes. Each P Node has 3 10GE ports connected to a 10GE switch. One port is used for external connections; the other two are used internally. Other System Notes ================== None Test Environment Bill of Materials ================================== Item No Qty Vendor Model/Name Description ------ --- ------ ---------- ----------- 1 4 Huawei Tecal RH2285 48GB RAM Server running SUSE Linux Enterprise Server 11 SP1 Load Generators =============== LG Type Name Tecal RH2285 BOM Item # 1 Processor Name Intel(R) Xeon(R) E5620 Processor Speed 2.4 GHz Number of Processors (chips) 2 Number of Cores/Chip 4 Memory Size 48 GB Operating System SUSE Linux Enterprise Server 11 SP1 Network Type 10 Gigabit Ethernet Load Generator (LG) Configuration ================================= Benchmark Parameters -------------------- Network Attached Storage Type NFS V3 Number of Load Generators 4 Number of Processes per LG 1000 Biod Max Read Setting 2 Biod Max Write Setting 2 Block Size AUTO Testbed Configuration --------------------- LG No LG Type Network Target Filesystems Notes ----- ------- ------- ------------------ ----- 1..4 LG1 10 Gigabit Ethernet Single filesystem named /fs N/A Load Generator Configuration Notes ---------------------------------- All clients are connected to the single filesystem /fs through all OceanStor 9000 P Nodes. Uniform Access Rule Compliance ============================== Each load-generating client hosts 1000 processes. The assignment of processes to network interfaces is done such that they are evenly divided across all network paths to the OceanStor 9000 P Nodes. Other Notes =========== None. ================================================================================ Generated on Mon Dec 09 16:29:31 2013 by SPECsfs2008 ASCII Formatter Copyright (C) 1997-2008 Standard Performance Evaluation Corporation