SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2012 Standard Performance Evaluation Corporation
Oracle Weblogic Server Standard Edition Release 12.1.1 on Oracle Sun Fire X4800 M2
27,150.05 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation		 SPEC license # 73 Test date:
Feb-2012
Software Products
Oracle WebLogic Server Standard Edition Release 12.1.1
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_02
Oracle JDBC Driver 11.2.0.2(Thin)
Oracle Database 11g Enterprise Edition Release 11.2.0.2 		Software Configurations
JEE Application Server
Emulator Software Config
Database Software Config
Driver Software Config 		Hardware Systems
JEE AppServer HW
Database Server HW
Load Driver & Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 80 cores, 8 chips   DB Server CPUs: 40 cores, 4 chips
JEE Instances: 16   DB Instances: 1
Other SUT Components:
   1x Sun 10 Gigabit Ethernet 72-port Switch

Benchmark Settings
Dealer Injection Rate: 17,000   Ramp Up Time: 600 seconds
DB Load Injection Rate: 20,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 170,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 51,000  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 15,394,560 25.00% 4
Manage 15,388,494 24.99% 12
Browse 30,783,889 50.00% 0
Total # Dealer Transactions 61,566,943
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 18,085,989 50.00% 2,996
CreateVehicleWS 18,087,231 50.00% 3,079
Total # Manufacturing Transactions 36,173,220
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.120 0.38 9.889 0.170 2.000
Manage 0.067 0.18 8.003 0.110 2.000
Browse 0.145 0.44 9.209 0.190 2.000
CreateVehicleEJB 0.077 0.15 4.073 0.125 5.000
CreateVehicleWS 0.066 0.08 5.909 0.125 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 27,150.89

Oracle WebLogic Server Standard Edition Release 12.1.1
Vendor: Oracle Corporation Availability: Dec-2011
CTS Version: 6.0 Date Passed CTS: Dec-2011
OS Name: Oracle Linux 5 Update 6 x86_64
EJB Protocol: RMI/T3

Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_02
Vendor: Oracle Corporation Availability: Dec-2011
OS Name: Oracle Linux 5 Update 6 x86_64

Oracle JDBC Driver 11.2.0.2(Thin)
Vendor: Oracle Corporation Availability: Sep-2010
OS Name: Oracle Linux 5 Update 6 x86_64

Oracle Database 11g Enterprise Edition Release 11.2.0.2
Vendor: Oracle Corporation Availability: Sep-2010
OS Name: Oracle Linux 5 Update 6 x86_64

JEE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.1
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_02
JDBC Product: Oracle JDBC Driver 11.2.0.2(Thin)
Hardware: JEE AppServer HW
# of Instances: 16
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information 

 -d64 -server -showversion -Xms6400m -Xmx6400m -Xss128k
 -XX:PermSize=384m -XX:MaxPermSize=384m -XX:NewRatio=2 -XX:+AggressiveOpts -XX:+UseLargePages
 -XX:+HeapDumpOnOutOfMemoryError -XX:-UseBiasedLocking -XX:+DisableExplicitGC
 -XX:+UseParallelOldGC -XX:ParallelGCThreads=4 -XX:+PrintGCTimeStamps -XX:+PrintGCDetails
 -Dweblogic.ProductionModeEnabled=true -Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer
 -Dweblogic.SocketReaders=3 -Dweblogic.management.discover=false
 -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true -Doracle.jdbc.defaultRowPrefetch=200
 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
 -Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory

 Server instances were started in real time using chrt -p 89 and numactl was used to bind 2
 instances per chip.

Emulator Software Config
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.1
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_02
Hardware: Load Driver & Emulator HW
# of Instances: 8
Notes / Tuning Information 

 -showversion -Xmx15g -Xms15g -Xmn7g -Xss272k
 -XX:PermSize=95m -XX:MaxPermSize=512M -XX:+UseLargePages -XX:+AggressiveOpts
 -XX:+DisableExplicitGC -verbosegc -Xloggc:emugc.log -XX:+PrintGCDetails
 -XX:+PrintGCTimeStamps -XX:+PrintCommandLineFlags -Dweblogic.ProductionModeEnabled=true
 -Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer -Dweblogic.SocketReaders=1
 -Dweblogic.management.discover=false -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
 -Dhttp.keepAlive=false -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
 -Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory

 Server instances were started using numactl binding 2 instances per chip using taskset.

Database Software Config
DB Product: Oracle Database 11g Enterprise Edition Release 11.2.0.2
Hardware: Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information 

 db_name                 = specdb
 compatible              = 11.2.0.1.0
 control_files           = ?/dbs/cntrlspecdb
 aq_tm_processes         = 0
 db_4k_cache_size        = 60000M
 db_8k_cache_size        = 80000M
 db_block_checking       = FALSE
 db_block_checksum       = FALSE
 db_block_size           = 2048
 db_cache_advice         = OFF
 db_cache_size           = 180000M
 db_file_multiblock_read_count = 128
 db_files                = 256
 db_keep_cache_size      = 20000M
 db_writer_processes     = 8
 deferred_segment_creation = FALSE
 dml_locks               = 2200
 filesystemio_options    = DirectIO
 log_buffer              = 67108864
 log_checkpoint_interval = 0
 log_checkpoints_to_alert= TRUE
 open_cursors            = 4000
 parallel_max_servers    = 100
 pga_aggregate_target    = 0
 processes               = 4000
 query_rewrite_enabled   = FALSE
 replication_dependency_tracking = FALSE
 session_cached_cursors  = 4000
 sessions                = 6080
 shared_pool_size        = 24000M
 statistics_level        = BASIC
 timed_statistics        = FALSE
 trace_enabled           = FALSE
 transactions            = 15000
 transactions_per_rollback_segment = 1
 undo_management         = AUTO
 undo_retention          = 10
 undo_tablespace         = undo_ts

Driver Software Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_02
Hardware: Load Driver & Emulator HW
# of Instances: 6
Notes / Tuning Information 

 -server -Xms6400M -Xmx6400M -Xss256k -XX:+DisableExplicitGC
 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
 -Dhttp.keepAliveCache.lifeTime=600000 -Djava.net.preferIPv4Stack=true
 -Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer

JEE AppServer HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Fire X4800 M2 Server OS Name: Oracle Linux 5 Update 6 x86_64
Processor: Intel(R) Xeon(R) E7-8870 (Intel Turbo Boost Technology up to 2.80GHz) Filesystem: ext3
MHz: 2400 Disks: 2x 300GB SAS-2 HDD
# of CPUs: 80 cores, 8 chips, 10 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 4x 10GBit Dual-port NIC ExpressModules
Memory (MB): 262144 Other Hardware: 2x StorageTek 8Gb FC Dual GbE HBA ExpressModule
DIMM[0] Count: 64 DIMM[0] Size: 4096
L1 Cache: 32KB I + 32KB D on chip per core # of Systems: 1
L2 Cache: 256KB(I+D) on chip, per core H/W Available: Jul-2011
Other Cache: 30MB (I+D) on chip per chip OS Available: Sep-2010
Notes / Tuning Information 

 Added to /etc/sysctl.conf:
 kernel.sem = 250 32000 100 128
 kernel.shmall = 10737418240
 kernel.shmmax = 4398046511104
 net.core.netdev_max_backlog = 400000
 net.core.optmem_max = 30000000
 net.core.rmem_default = 30000000
 net.core.rmem_max = 30000000
 net.core.somaxconn = 40000
 net.core.wmem_default = 30000000
 net.core.wmem_max = 30000000
 net.ipv4.ip_local_port_range = 1024 65000
 net.ipv4.tcp_fin_timeout = 10
 net.ipv4.tcp_max_syn_backlog = 30000
 net.ipv4.tcp_max_tw_buckets = 2000000
 net.ipv4.tcp_mem = 30000000 30000000 30000000
 net.ipv4.tcp_rmem = 30000000 30000000 30000000
 net.ipv4.tcp_timestamps = 0
 net.ipv4.tcp_wmem = 30000000 30000000 30000000
 vm.zone_reclaim_mode=1

 For each of the 10g NICs:
 set arp_announce = 2
 set arp_ignore = 1
 set txqueuelen 240000
 Set RSS=4 InterruptThrottleRate=6000
 Bind interrupts to a core corresponding to the server instance
 such that the 4 IRQs of a port are bound to different cores.

 Stop iptables and irqbalance.
 Configure 80000 hugepages.

 External Disk configuration:
 Storage used for database files was shared for jms and server logs.

Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Fire X4470 M2 server OS Name: Oracle Linux 5 Update 6 x86_64
Processor: Intel(R) Xeon(R) E7-4870 (Intel Turbo Boost Technology up to 2.80GHz) Filesystem: ext3
MHz: 2400 Disks: 2x 300GB SAS-2
# of CPUs: 40 cores, 4 chips, 10 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 2x 10Gbit Dual Port NIC
Memory (MB): 524288 Other Hardware: 4x StorageTek 8Gb/s FC PCI-e HBA
DIMM[0] Count: 64 DIMM[0] Size: 8192
L1 Cache: 32KB I + 32KB D on chip per core # of Systems: 1
L2 Cache: 256KB(I+D) on chip, per core H/W Available: Jun-2011
Other Cache: 30MB (I+D) on chip per chip OS Available: Sep-2010
Notes / Tuning Information 

 Added to /etc/sysctl.conf:
 kernel.sem = 250 32000 100 128
 kernel.shmall = 10737418240
 kernel.shmmax = 4398046511104
 net.core.netdev_max_backlog = 400000
 net.core.optmem_max = 30000000
 net.core.rmem_default = 30000000
 net.core.rmem_max = 30000000
 net.core.somaxconn = 40000
 net.core.wmem_default = 30000000
 net.core.wmem_max = 30000000
 net.ipv4.ip_local_port_range = 1024 65000
 net.ipv4.tcp_fin_timeout = 10
 net.ipv4.tcp_max_syn_backlog = 30000
 net.ipv4.tcp_max_tw_buckets = 2000000
 net.ipv4.tcp_mem = 30000000 30000000 30000000
 net.ipv4.tcp_rmem = 30000000 30000000 30000000
 net.ipv4.tcp_timestamps = 0
 net.ipv4.tcp_wmem = 30000000 30000000 30000000
 vm.zone_reclaim_mode=1

 For each of the 4x 10g NICs:
 set arp_announce = 2
 set arp_ignore = 1
 set txqueuelen 240000
 Set RSS=4 InterruptThrottleRate=6000
 Interrupts of each NIC were bound to separate cores of different procesors.
 8 Oracle listeners were started, 2 were bound per processor using taskset.

 Stop iptables and irqbalance.
 Configure 200000 hugepages.

 External Storage configuration:
 4x Sun Fire X4270 M2 running Solaris 11 and each configured with 1x Sun Storage F5100 Flash Array,
 2x SAS HBA, and 1x FC HBA for the database files
 using the COMSTAR function, included in the FDA.
 2x Sun Storage 2540 M2 arrays configured for the redo logs.

Load Driver & Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Fire X4170 M2 Server OS Name: Oracle Linux 5 Update 6 x86_64
Processor: Intel(R) Xeon(R) X5670 Filesystem: ext3
MHz: 2925 Disks: 2x 300GB 10K RPM SAS
# of CPUs: 12 cores, 2 chips, 6 cores/chip (2 threads/core) Network Interface: 1x 10Gbit Dual-port NIC
Memory (MB): 98304 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 8
L2 Cache: 256KB per core H/W Available: Jun-2010
Other Cache: 12 MB I+D L3 on chip per chip OS Available: Sep-2010
Notes / Tuning Information 

 Added to /etc/sysctl.conf:
 kernel.sem = 250 32000 100 128
 kernel.shmall = 10737418240
 kernel.shmmax = 51539607552
 net.core.netdev_max_backlog = 400000
 net.core.optmem_max = 30000000
 net.core.rmem_default = 30000000
 net.core.rmem_max = 30000000
 net.core.somaxconn = 40000
 net.core.wmem_default = 30000000
 net.core.wmem_max = 30000000
 net.ipv4.ip_local_port_range = 1024 65000
 net.ipv4.tcp_fin_timeout = 10
 net.ipv4.tcp_max_syn_backlog = 30000
 net.ipv4.tcp_max_tw_buckets = 2000000
 net.ipv4.tcp_mem = 30000000 30000000 30000000
 net.ipv4.tcp_rmem = 30000000 30000000 30000000
 net.ipv4.tcp_timestamps = 0
 net.ipv4.tcp_wmem = 30000000 30000000 30000000
 vm.zone_reclaim_mode=1
 kernel.pid_max = 4194303

 For the 10g NIC:
 set arp_announce = 2
 set arp_ignore = 1
 set txqueuelen 240000

 Stop iptables
 Configure 20000 hugepages on 2x Emulator HW

Benchmark Modifications
Schema Modifications: 
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_ORDERLINE and O_CUSTINVENTORY were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications: 
  No modifications to the load programs were made.

Benchmark Configuration Information
Isolation Requirement Info: 
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against the database.
Durability Requirement Info: 
  To ensure database durability, RAID 1 was used for the database files on the
  X4270 M2 Storage Servers and database redo logs on the Sun Storage 2540 M2 Arrays.
  
  The application server shared the Storage Servers for database files
  configured as RAID 1 luns for the jms and server logs.
Storage Requirement Info: 
  An 75 minute run at an injection rate of 17000 increased storage by 64.0 GB
  This extrapolates to 1.2 TB storage for a 24 hour run.
  The database was configured with over 7 TB of mirrored storage.

Bill of Materials 
Supplier  Description                                   Product #          Qty
--------  -------------------------------------------   ----------------   ---
Application Server
Oracle	   Sun Fire X4800 M2 Base Assembly	         7100176	     1
Oracle	   Intel Xeon E7-8870 2.4GHz Proc		 7100128	     8
Oracle	   CPU Module w/ 32 DIMM slots, 2 USB ports	 7100177	     4
Oracle	   8GB (2x4GB DIMMS) DDR3-1333                   7100130 	    32
Oracle	   6Gb/s SAS REM RAID HBA                        SG-SAS6-R-REM-Z     1
Oracle	   300GB 10K RPM SAS-2 HDD                       RB-SS2CM-300G10K2   2
Oracle	   10GBE Dual Port SFP+Express Module		 1110A-Z	     4
Oracle	   10 GigE Dual Rate SFP+ SRTransceiver, MM	 2129A		     8
Oracle	   8Gb/s FC GbE HBA, EM,Qlogic			 SG-PCIEFCGBE-Q8-N   2
Oracle	   4x10GbE SFP+ ports, 2x x4SAS 2.0 mini-ports   8508A		     2
Oracle	   Power Cord, 4.0 meter, 15A333                 J-40-15-NEMA        4

Database Server
Oracle	   Sun Fire X4470 M2 Base Assembly	         7100142	     1
Oracle	   2x Intel Xeon E7-4870 2.4GHz CPU Module	 7100148	     2
Oracle	   16GB (2x8GB DIMMS) DDR3-1333 		 7100158	    32
Oracle	   2x Memory Riser Assembly                      7100166	     4
Oracle	   Sun Storage 6Gb SAS PCIe RAID HBA 		 SG-SAS6-R-INT-Z     1
Oracle	   300GB 10K RPM SAS-2 HDD                       RB-SS2CF-300G10K2   2
Oracle	   StorageTek 8Gb/s FC PCI-e HBA dual port	 SG-PCIE2FC-QF8-Z    4
Oracle	   Sun Dual 10 GigE SFP+ PCIe 2.0 NIC		 1109A-Z	     2
Oracle	   10 GigE Dual Rate SFP+ SR Transceiver, MM	 2129A		     4
Oracle	   Power Cord, 4.0 meter, 15A 333                J-40-15-NEMA        2

Storage
Oracle     Sun Storage 2540 M2 Array                     7100183	     2
Oracle     300GB 15K RPM SAS-2 HDD                       7100414 	    24
Oracle     AC power supply                               7100021	     4
Oracle	   Power Cord, 4.0 meter, 15A 333                J-40-15-NEMA        4
Oracle     Sun Storage F5100 Flash Array		 TA-F5100-M2SA	     4
Oracle     Twenty 24GB SATA SLC flash modules		 TA-24GBSTSF-20FM   16
Oracle     0.5M, Mini, shielded, SAS cable		 XTA-0.5M-SAS       16
Oracle     Sun Fire X4270 M2 Server, base chassis	 X4270M2-H1-AA	     4
Oracle     1200W PS                                      5933A		     4
Oracle     3.06 Ghz Intel X5675                          4373A		     4
Oracle     Processor heat sink                           5899A-N	     4
Oracle     4 GB DIMM DDR3                                4910A		     8
Oracle     2TB - 7200 RPM SAS Disk Assembly		 RA-SS1CR-2T7K	     8
Oracle     Sun Storage 6 Gb SAS PCIe HBA		 SG-SAS6-INT-Z	     8
Oracle     Sun StorageTek 8 Gb FC PCIe HBA		 SG-PCIE2FC-QF8-Z    4
Oracle     Solaris 11 11/11                                                  1

Switch Hardware
Oracle     Sun 10 Gigabit Ethernet Switch with 72 ports  X2074A-F            1
Oracle     QSFP to 4x SFP+ Splitter Cable                2125A-3M            5


Oracle     Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1
Oracle     Oracle Premier Support for Operating Systems			     4

Oracle     Oracle Database 11g Enterprise Edition, Per Processor
-          Unlimited Users for 3 years                                      20*
Oracle     Partitioning, Per Processor, Unlimited Users for 3 years         20*
Oracle     Oracle Premium Support for 3 years                                2

Oracle     Oracle WebLogic Server Standard Edition Release 12.1.1
-          Per Processor for 3 years                                        40*
Oracle     Oracle Premium Support for 3 years                                1

(* 20 = 0.5 * 40 and and 40 = 0.5 * 80) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' cores
shall be determined by multiplying 'n' cores by a factor of 0.5.

Other Benchmark Information 
  DNS round robin load balancing was used with the DNS server running on the Database Server.
  
  All network connections were 10 Gbps.

General Notes 
 The only errors in the driver log files were those that are
 normally generated by this benchmark.

 On the database, incremental checkpointing ensured that no buffer will
 remain dirty (in the cache) for more than the allowed time.

For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2012 Standard Performance Evaluation Corporation

First published at SPEC.org on 27-Mar-2012