Performance

Configuration

Notes for Banking Workload

SUT Notes

• 1 disk for OS
• 27 disks for 'Default Web Site' (fileset, applications, logs),SW RAID0
• - using 128k chunk size for the raid array (mdadm.conf: default 64k)
• set noatime,nodiratime,nocheck for specweb mount (/etc/fstab):
• - noatime/nodiratime: Do not update inode access times on this file system.
• - nocheck: No checking is done. (no check on mount)
• Intel PRO/1000 MT dual (PCI-X):
• (insmod tg3 eth0, e1000 eth1 eth2 eth3 eth4)
• - FlowControl=0 (off), default read settings from the EEPROM
• - RxDescriptors=768, default 256
• - TxDescriptors=4096, default 256
• (ifconfig eth0 eth1 eth2 eth3 eth4)
• - txqueuelen=60000, transmit queue length; default 100
• /proc/irq
• - 225.smp_affinity=00000001, lock IRQ of NIC(eth1) to 1. processor; default 0xffffffff
• - 233.smp_affinity=00000002, lock IRQ of NIC(eth2) to 2. processor; default 0xffffffff
• - 50.smp_affinity=00000004, lock IRQ of NIC(eth3) to 3. processor; default 0xffffffff
• - 58.smp_affinity=00000008, lock IRQ of NIC(eth4) to 4. processor; default 0xffffffff
• - irqbalance --noethernet; default irqbalance

Operating System Notes

• ulimit -n 1000000, sets number of open files, default 1024
• ulimit -u 1000000, sets max user processes, default 7160
• /proc/sys/net
• - core.optmem_max=10000000, maximum amount of option memory buffers, default 10240
• - core.rmem_default=10000000, default receive socket buffer size, default 65535
• - core.rmem_max=10000000, maximum receive socket buffer size, default 131071
• - core.wmem_default=10000000, default send socket buffer size, default 65535
• - core.wmem_max=10000000, maximum send socket buffer size, default 131071
• - core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, default 300
• - ipv4.tcp_max_tw_buckets=2000000, set TCP time-wait buckets pool size, default 180000
• - ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
• - ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
• - ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space allocatable, default 195584 196096 196608
• - ipv4.tcp_timestamps=0, turns TCP timestamp support off, default on
• - ipv4.tcp_dsack=0, turns DSACK support off, default on
• - ipv4.tcp_sack=0, turns SACK support off, default on
• - ipv4.tcp_window_scaling=0, turns TCP window scaling support off, default on
• - ipv4.ip_forward=1, default off
• Kernel parameters:
• - idle=poll, idle threads poll reschedule flag, default: use HLT instruction

HTTP Software Notes

• Rock Web Server /wwwroot/rockweb/conf/httpd.conf
• - server_log httpd.log
• - validate_static -1, disables static file modification validation, default 0
• - validate_httpmod -1, disables HTTP module modification validation, default 0
• - header_etag_on 0, disables etag header in HTTP replies, default 1
• - header_server_on 0, disables server header in HTTP replies, default 1
• - tcp_send_buf_size 1048576,sets socket send buffer size
• - log_buf_size 1048576,sets access log buffer size, default: 65536
• - direct_io 1, uses direct IO when possible
• - connection_timeout 9600, connection inactivity timeout, default 60s
• - keepalive_max 100000, (bank/ecom) max. keepalive requests on a connection, default 100
• - cache_replacement lru, (sup/ecom) least-recent-used policy for file replacement, default random
• - cache_memory_size 8192, (support) cache manager memory, default 0
• - cache_file_max_size 5546968,(support) largest file allowed in cache manager, default 2097152
• - cache_memory_size 8192, (ecommerce) cache manager memory, default 0
• - cache_file_count 60689, (ecommerce) estimated number of static files for the cache, default 27179
• - worker 10.100.5.100/80 10.100.5.100/443 */9090
• - worker 10.100.6.100/80 10.100.6.100/443
• - worker 10.100.7.100/80 10.100.7.100/443
• - worker 10.100.8.100/80 10.100.8.100/443
• - ;host; wsrv:80
• - document_root /wwwroot/jakarta-tomcat-5.5.9/webapps
• - access_log access_port80.log
• - access_log_format commonlog
• - error_log error_port80.log
• - ;file; /
• - cgi_type gateway
• - cgi_regex .*jsp
• - cgi_listener localhost/8009
• - ;/file;
• - ;/host;
• - ;host; wsrv:443
• - ssl_key_file /wwwroot/rockweb/etc/key-cert/sample.key
• - ssl_cert_file /wwwroot/rockweb/etc/key-cert/sample.certificate
• - document_root /wwwroot/jakarta-tomcat-5.5.9/webapps
• - access_log access_port443.log
• - access_log_format commonlog
• - error_log error_port443.log
• - ;file; /
• - cgi_type gateway
• - cgi_regex .*jsp
• - cgi_listener localhost/8009
• - ;/file;
• - ;/host;

Script Engine Notes

• Apache conf/server.xml (http://jakarta.apache.org/tomcat/tomcat-5.5-doc/config/ajp.html):
• - Connector port=8009; default 8080
• - maxThreads=15000; default 150
• - minSpareThreads=9000, bank; default 25
• - maxSpareThreads=9000, bank; default 75
• - minSpareThreads=9000, ecommerce; default 25
• - maxSpareThreads=9000, ecommerce; default 75
• - minSpareThreads=5000, support; default 25
• - maxSpareThreads=5000, support; default 75
• - acceptCount=10000; default 100
• - connectionTimeout=0; default 20000
• - Host name=wsrv05 appBase=webapps; default name=localhost
• conf/worker.properties (http://jakarta.apache.org/tomcat/tomcat-5.5-doc/config/ajp.html):
• - worker.list=ajp13w01; default: ajp13
• - worker.ajp13w01.type=ajp13
• - worker.ajp13w01.host=localhost
• - worker.ajp13w01.port=8009

HTTP Script Notes

• Tomcat is used as JSP engine
• SPEC-provided JSP scripts, no modifications
• JAVA_OPTS=-Xms4000m -Xmx4000m -Xss512k -Xcompactexplicitgc -server -d64 SUT/etc/profile
• java -Xms512m -Xmx512m -XX:+UseParNewGC -XX:+UseConcMarkSweepGC specwebclient

Client Notes

• NDIS registry tuning parameters [HKLMSystemCurrentControlSetServicesNDISParameters]:
• - ProcessorAffinityMask=0, default 1 (any processor)
• TCP/IP registry tuning parameters [HKLMSystemCurrentControlSetServicesTcpipParameters]:
• - MaxHashTableSize=0x4000, sets TCB hash table size to 16384 entries, default is 512.
• - TcpTimedWaitDelay=0x3c, sets TIME_WAIT parameter to 60 seconds (non-RFC 1122), default is 240.
• - MaxFreeTwTcbs=400000, sets maximum number of TIME_WAIT tcbs to 400,000.
• - MaxFreeTcbs=0x16000, sets number of cached (pre-allocated) TCBs, default 1000
• - MaxUserPort=0xfffe, sets maximum open ports to 65534.
• - TcpWindowSize=65535, sets TCP send/receive window size, default 8192.
• - NumTcbTablePartitions=32, sets number of independent TCB table segments, default 4.

BESIM Notes

• BeSim is on own physically separate machine.
• - 4 subnets clients/SUT (via Broadcom Switches)
• - 1 subnet primeclient/clients/SUT/BESIM (via Summit Switch)
• ulimit -n 10000, sets number of open files, default 1024
• /etc/httpd/httpd.conf
• Timeout 300, num. sec. before receives and sends time out; default 120
• KeepAlive On, allow persistent connection; default Off
• KeepAliveRequests 0, unlimit number of requests; default 100
• KeepAliveTimeout 600, num. sec. wait for next request; default 15
• worker.c:
• - ThreadLimit=256, max number worker threads in a server; default 64
• - ServerLimit=32, max number of active child processes; default 4
• - StartServers=32, initial number of server processes to start; default 2
• - MaxClients=8192, max number of simultaneous client connections; default 150
• - MaxSpareThreads=8192, max number of worker threads which are kept spare; default 75
• - ThreadsPerChild=256, max number of requests a server process serves; default 25
• Listen 10.100.0.91:81 #eth0, bind Apache to a spec. IP-address; default Listen 80
• LoadModule fastcgi_module modules/mod_fastcgi.so
• FastCgiConfig -idle-timeout 86400 -listen-queue-depth 1024 -flush -init-start-delay 0
• ServerName besim:81
• DocumentRoot /var/www; default /var/www/html
• ServerSignature Off, default On
• ScriptAlias /fcgi-bin/ /var/www/fcgi-bin
• AddLanguage en .en (only); default all
• #LanguagePriority en ca ...; default LanguagePriority en ca ...
• #ForceLanguagePriority Prefer Fallback; default ForceLanguagePriority Prefer Fallback
• SetHandler fastcgi-script
• AddHandler fastcgi-script .fcgi
• ErrorLog: LogLevel Error
• CustomLog: LogFormat Common
• (ifconfig eth0)
• - txqueuelen=20000, transmit queue length; default 100
• /proc/irq
• - 169.smp_affinity=00000001, lock IRQ of NIC(eth0) to 1. processor; default 0xffffffff
• - 0.smp_affinity=00000002, lock IRQ of TIMER to 2. processor; default 0xffffffff
• - irqbalance disabled
• /proc/sys/net
• - core.optmem_max=10000000, maximum amount of option memory buffers, default 10240
• - core.rmem_default=10000000, default receive socket buffer size, default 65535
• - core.rmem_max=10000000, maximum receive socket buffer size, default 131071
• - core.wmem_default=10000000, default send socket buffer size, default 65535
• - core.wmem_max=10000000, maximum send socket buffer size, default 131071
• - core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, default 300
• - ipv4.tcp_max_tw_buckets=2000000, set TCP time-wait buckets pool size, default 180000
• - ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
• - ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
• - ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space allocatable, default 195584 196096 196608
• - ipv4.tcp_timestamps=0, turns TCP timestamp support off, default on
• - ipv4.tcp_dsack=0, turns DSACK support off, default on
• - ipv4.tcp_sack=0, turns SACK support off, default on
• - ipv4.tcp_window_scaling=0, turns TCP window scaling support off, default on
• - ipv4.ip_forward=1, default off
• Kernel parameters:
• - idle=poll, idle threads poll reschedule flag, default: use HLT instruction

Other Notes

• N/A

Errors for Banking Workload

Quality of Service Errors

•   No QOS Errors Found

Validation Errors

• 1 Validation Errors for Iteration 1  :   wclt032 - login   

• 3 Validation Errors for Iteration 1  :   wclt021 - account_summary   

• 6 Validation Errors for Iteration 1  :   wclt022 - account_summary   

• 4 Validation Errors for Iteration 1  :   wclt023 - account_summary   

• 5 Validation Errors for Iteration 1  :   wclt024 - account_summary   

• 7 Validation Errors for Iteration 1  :   wclt025 - account_summary   

• 2 Validation Errors for Iteration 1  :   wclt026 - account_summary   

• 4 Validation Errors for Iteration 1  :   wclt027 - account_summary   

• 3 Validation Errors for Iteration 1  :   wclt028 - account_summary   

• 6 Validation Errors for Iteration 1  :   wclt029 - account_summary   

• 2 Validation Errors for Iteration 1  :   wclt030 - account_summary   

• 5 Validation Errors for Iteration 1  :   wclt031 - account_summary   

• 7 Validation Errors for Iteration 1  :   wclt032 - account_summary   

• 8 Validation Errors for Iteration 1  :   wclt033 - account_summary   

• 4 Validation Errors for Iteration 1  :   wclt034 - account_summary   

• 2 Validation Errors for Iteration 1  :   wclt035 - account_summary   

• 3 Validation Errors for Iteration 1  :   wclt036 - account_summary   

• 3 Validation Errors for Iteration 1  :   wclt037 - account_summary   

• 3 Validation Errors for Iteration 1  :   wclt038 - account_summary   

• 3 Validation Errors for Iteration 1  :   wclt039 - account_summary   

• 8 Validation Errors for Iteration 1  :   wclt040 - account_summary   

• 4 Validation Errors for Iteration 1  :   wclt021 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt022 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt023 - check_detail_html   

• 1 Validation Errors for Iteration 1  :   wclt024 - check_detail_html   

• 1 Validation Errors for Iteration 1  :   wclt025 - check_detail_html   

• 1 Validation Errors for Iteration 1  :   wclt026 - check_detail_html   

• 3 Validation Errors for Iteration 1  :   wclt027 - check_detail_html   

• 1 Validation Errors for Iteration 1  :   wclt028 - check_detail_html   

• 3 Validation Errors for Iteration 1  :   wclt029 - check_detail_html   

• 4 Validation Errors for Iteration 1  :   wclt030 - check_detail_html   

• 4 Validation Errors for Iteration 1  :   wclt031 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt032 - check_detail_html   

• 3 Validation Errors for Iteration 1  :   wclt033 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt034 - check_detail_html   

• 4 Validation Errors for Iteration 1  :   wclt035 - check_detail_html   

• 1 Validation Errors for Iteration 1  :   wclt036 - check_detail_html   

• 3 Validation Errors for Iteration 1  :   wclt037 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt038 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt039 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt040 - check_detail_html   

• 2 Validation Errors for Iteration 1  :   wclt021 - bill_pay   

• 3 Validation Errors for Iteration 1  :   wclt022 - bill_pay   

• 2 Validation Errors for Iteration 1  :   wclt023 - bill_pay   

• 2 Validation Errors for Iteration 1  :   wclt024 - bill_pay   

• 2 Validation Errors for Iteration 1  :   wclt025 - bill_pay   

• 4 Validation Errors for Iteration 1  :   wclt026 - bill_pay   

• 5 Validation Errors for Iteration 1  :   wclt027 - bill_pay   

• 5 Validation Errors for Iteration 1  :   wclt028 - bill_pay   

• 4 Validation Errors for Iteration 1  :   wclt029 - bill_pay   

• 9 Validation Errors for Iteration 1  :   wclt030 - bill_pay   

• 8 Validation Errors for Iteration 1  :   wclt031 - bill_pay   

• 3 Validation Errors for Iteration 1  :   wclt032 - bill_pay   

• 5 Validation Errors for Iteration 1  :   wclt033 - bill_pay   

• 7 Validation Errors for Iteration 1  :   wclt034 - bill_pay   

• 4 Validation Errors for Iteration 1  :   wclt035 - bill_pay   

• 5 Validation Errors for Iteration 1  :   wclt037 - bill_pay   

• 2 Validation Errors for Iteration 1  :   wclt039 - bill_pay   

• 7 Validation Errors for Iteration 1  :   wclt040 - bill_pay   

• 1 Validation Errors for Iteration 1  :   wclt023 - add_payee   

• 1 Validation Errors for Iteration 1  :   wclt031 - add_payee   

• 1 Validation Errors for Iteration 1  :   wclt033 - add_payee   

• 1 Validation Errors for Iteration 1  :   wclt034 - add_payee   

• 1 Validation Errors for Iteration 1  :   wclt022 - payee_info   

• 2 Validation Errors for Iteration 1  :   wclt021 - quick_pay   

• 2 Validation Errors for Iteration 1  :   wclt022 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt023 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt025 - quick_pay   

• 2 Validation Errors for Iteration 1  :   wclt026 - quick_pay   

• 2 Validation Errors for Iteration 1  :   wclt027 - quick_pay   

• 2 Validation Errors for Iteration 1  :   wclt028 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt029 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt030 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt031 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt032 - quick_pay   

• 3 Validation Errors for Iteration 1  :   wclt033 - quick_pay   

• 3 Validation Errors for Iteration 1  :   wclt034 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt036 - quick_pay   

• 2 Validation Errors for Iteration 1  :   wclt037 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt038 - quick_pay   

• 3 Validation Errors for Iteration 1  :   wclt039 - quick_pay   

• 1 Validation Errors for Iteration 1  :   wclt040 - quick_pay   

• 2 Validation Errors for Iteration 1  :   wclt022 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt024 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt026 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt027 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt028 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt029 - billpay_status   

• 2 Validation Errors for Iteration 1  :   wclt030 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt031 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt033 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt037 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt038 - billpay_status   

• 1 Validation Errors for Iteration 1  :   wclt021 - chg_profile   

• 1 Validation Errors for Iteration 1  :   wclt022 - chg_profile   

• 2 Validation Errors for Iteration 1  :   wclt023 - chg_profile   

• 1 Validation Errors for Iteration 1  :   wclt025 - chg_profile   

• 1 Validation Errors for Iteration 1  :   wclt026 - chg_profile   

• 1 Validation Errors for Iteration 1  :   wclt029 - chg_profile   

• 1 Validation Errors for Iteration 1  :   wclt032 - chg_profile   

• 1 Validation Errors for Iteration 1  :   wclt037 - chg_profile   

• 2 Validation Errors for Iteration 1  :   wclt023 - post_profile   

• 1 Validation Errors for Iteration 1  :   wclt024 - post_profile   

• 2 Validation Errors for Iteration 1  :   wclt033 - post_profile   

• 1 Validation Errors for Iteration 1  :   wclt038 - post_profile   

• 1 Validation Errors for Iteration 1  :   wclt021 - req_checks   

• 1 Validation Errors for Iteration 1  :   wclt026 - req_checks   

• 1 Validation Errors for Iteration 1  :   wclt031 - req_checks   

• 1 Validation Errors for Iteration 1  :   wclt033 - req_checks   

• 1 Validation Errors for Iteration 1  :   wclt035 - req_checks   

• 2 Validation Errors for Iteration 1  :   wclt040 - req_checks   

• 1 Validation Errors for Iteration 1  :   wclt022 - post_chk_order   

• 1 Validation Errors for Iteration 1  :   wclt026 - post_chk_order   

• 1 Validation Errors for Iteration 1  :   wclt033 - post_chk_order   

• 1 Validation Errors for Iteration 1  :   wclt021 - req_xfer_form   

• 1 Validation Errors for Iteration 1  :   wclt024 - req_xfer_form   

• 1 Validation Errors for Iteration 1  :   wclt026 - req_xfer_form   

• 1 Validation Errors for Iteration 1  :   wclt027 - req_xfer_form   

• 1 Validation Errors for Iteration 1  :   wclt033 - req_xfer_form   

• 1 Validation Errors for Iteration 1  :   wclt038 - req_xfer_form   

• 1 Validation Errors for Iteration 1  :   wclt023 - post_fund_xfer   

• 1 Validation Errors for Iteration 1  :   wclt028 - post_fund_xfer   

• 1 Validation Errors for Iteration 1  :   wclt031 - post_fund_xfer   

• 1 Validation Errors for Iteration 1  :   wclt033 - post_fund_xfer   

• 1 Validation Errors for Iteration 1  :   wclt036 - post_fund_xfer   

• 2 Validation Errors for Iteration 1  :   wclt037 - post_fund_xfer   

• 1 Validation Errors for Iteration 1  :   wclt038 - post_fund_xfer   

• 1 Validation Errors for Iteration 1  :   wclt040 - post_fund_xfer   

• 3 Validation Errors for Iteration 1  :   wclt021 - logout   

• 4 Validation Errors for Iteration 1  :   wclt022 - logout   

• 3 Validation Errors for Iteration 1  :   wclt023 - logout   

• 1 Validation Errors for Iteration 1  :   wclt024 - logout   

• 1 Validation Errors for Iteration 1  :   wclt025 - logout   

• 3 Validation Errors for Iteration 1  :   wclt026 - logout   

• 2 Validation Errors for Iteration 1  :   wclt028 - logout   

• 1 Validation Errors for Iteration 1  :   wclt029 - logout   

• 2 Validation Errors for Iteration 1  :   wclt030 - logout   

• 2 Validation Errors for Iteration 1  :   wclt032 - logout   

• 5 Validation Errors for Iteration 1  :   wclt033 - logout   

• 5 Validation Errors for Iteration 1  :   wclt034 - logout   

• 1 Validation Errors for Iteration 1  :   wclt035 - logout   

• 2 Validation Errors for Iteration 1  :   wclt036 - logout   

• 1 Validation Errors for Iteration 1  :   wclt037 - logout   

• 2 Validation Errors for Iteration 1  :   wclt038 - logout   

• 2 Validation Errors for Iteration 1  :   wclt040 - logout   

Notes for Ecommerce Workload

SUT Notes

• 1 disk for OS
• 27 disks for 'Default Web Site' (fileset, applications, logs),SW RAID0
• - using 128k chunk size for the raid array (mdadm.conf: default 64k)
• set noatime,nodiratime,nocheck for specweb mount (/etc/fstab):
• - noatime/nodiratime: Do not update inode access times on this file system.
• - nocheck: No checking is done. (no check on mount)
• Intel PRO/1000 MT dual (PCI-X):
• (insmod tg3 eth0, e1000 eth1 eth2 eth3 eth4)
• - FlowControl=0 (off), default read settings from the EEPROM
• - RxDescriptors=768, default 256
• - TxDescriptors=4096, default 256
• (ifconfig eth0 eth1 eth2 eth3 eth4)
• - txqueuelen=60000, transmit queue length; default 100
• /proc/irq
• - 225.smp_affinity=00000001, lock IRQ of NIC(eth1) to 1. processor; default 0xffffffff
• - 233.smp_affinity=00000002, lock IRQ of NIC(eth2) to 2. processor; default 0xffffffff
• - 50.smp_affinity=00000004, lock IRQ of NIC(eth3) to 3. processor; default 0xffffffff
• - 58.smp_affinity=00000008, lock IRQ of NIC(eth4) to 4. processor; default 0xffffffff
• - irqbalance --noethernet; default irqbalance

Operating System Notes

• ulimit -n 1000000, sets number of open files, default 1024
• ulimit -u 1000000, sets max user processes, default 7160
• /proc/sys/net
• - core.optmem_max=10000000, maximum amount of option memory buffers, default 10240
• - core.rmem_default=10000000, default receive socket buffer size, default 65535
• - core.rmem_max=10000000, maximum receive socket buffer size, default 131071
• - core.wmem_default=10000000, default send socket buffer size, default 65535
• - core.wmem_max=10000000, maximum send socket buffer size, default 131071
• - core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, default 300
• - ipv4.tcp_max_tw_buckets=2000000, set TCP time-wait buckets pool size, default 180000
• - ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
• - ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
• - ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space allocatable, default 195584 196096 196608
• - ipv4.tcp_timestamps=0, turns TCP timestamp support off, default on
• - ipv4.tcp_dsack=0, turns DSACK support off, default on
• - ipv4.tcp_sack=0, turns SACK support off, default on
• - ipv4.tcp_window_scaling=0, turns TCP window scaling support off, default on
• - ipv4.ip_forward=1, default off
• Kernel parameters:
• - idle=poll, idle threads poll reschedule flag, default: use HLT instruction

HTTP Software Notes

• Rock Web Server /wwwroot/rockweb/conf/httpd.conf
• - server_log httpd.log
• - validate_static -1, disables static file modification validation, default 0
• - validate_httpmod -1, disables HTTP module modification validation, default 0
• - header_etag_on 0, disables etag header in HTTP replies, default 1
• - header_server_on 0, disables server header in HTTP replies, default 1
• - tcp_send_buf_size 1048576,sets socket send buffer size
• - log_buf_size 1048576,sets access log buffer size, default: 65536
• - direct_io 1, uses direct IO when possible
• - connection_timeout 9600, connection inactivity timeout, default 60s
• - keepalive_max 100000, (bank/ecom) max. keepalive requests on a connection, default 100
• - cache_replacement lru, (sup/ecom) least-recent-used policy for file replacement, default random
• - cache_memory_size 8192, (support) cache manager memory, default 0
• - cache_file_max_size 5546968,(support) largest file allowed in cache manager, default 2097152
• - cache_memory_size 8192, (ecommerce) cache manager memory, default 0
• - cache_file_count 60689, (ecommerce) estimated number of static files for the cache, default 27179
• - worker 10.100.5.100/80 10.100.5.100/443 */9090
• - worker 10.100.6.100/80 10.100.6.100/443
• - worker 10.100.7.100/80 10.100.7.100/443
• - worker 10.100.8.100/80 10.100.8.100/443
• - ;host; wsrv:80
• - document_root /wwwroot/jakarta-tomcat-5.5.9/webapps
• - access_log access_port80.log
• - access_log_format commonlog
• - error_log error_port80.log
• - ;file; /
• - cgi_type gateway
• - cgi_regex .*jsp
• - cgi_listener localhost/8009
• - ;/file;
• - ;/host;
• - ;host; wsrv:443
• - ssl_key_file /wwwroot/rockweb/etc/key-cert/sample.key
• - ssl_cert_file /wwwroot/rockweb/etc/key-cert/sample.certificate
• - document_root /wwwroot/jakarta-tomcat-5.5.9/webapps
• - access_log access_port443.log
• - access_log_format commonlog
• - error_log error_port443.log
• - ;file; /
• - cgi_type gateway
• - cgi_regex .*jsp
• - cgi_listener localhost/8009
• - ;/file;
• - ;/host;

Script Engine Notes

• Apache conf/server.xml (http://jakarta.apache.org/tomcat/tomcat-5.5-doc/config/ajp.html):
• - Connector port=8009; default 8080
• - maxThreads=15000; default 150
• - minSpareThreads=9000, bank; default 25
• - maxSpareThreads=9000, bank; default 75
• - minSpareThreads=9000, ecommerce; default 25
• - maxSpareThreads=9000, ecommerce; default 75
• - minSpareThreads=5000, support; default 25
• - maxSpareThreads=5000, support; default 75
• - acceptCount=10000; default 100
• - connectionTimeout=0; default 20000
• - Host name=wsrv05 appBase=webapps; default name=localhost
• conf/worker.properties (http://jakarta.apache.org/tomcat/tomcat-5.5-doc/config/ajp.html):
• - worker.list=ajp13w01; default: ajp13
• - worker.ajp13w01.type=ajp13
• - worker.ajp13w01.host=localhost
• - worker.ajp13w01.port=8009

HTTP Script Notes

• Tomcat is used as JSP engine
• SPEC-provided JSP scripts, no modifications
• JAVA_OPTS=-Xms4000m -Xmx4000m -Xss512k -Xcompactexplicitgc -server -d64 SUT/etc/profile
• java -Xms512m -Xmx512m -XX:+UseParNewGC -XX:+UseConcMarkSweepGC specwebclient

Client Notes

• NDIS registry tuning parameters [HKLMSystemCurrentControlSetServicesNDISParameters]:
• - ProcessorAffinityMask=0, default 1 (any processor)
• TCP/IP registry tuning parameters [HKLMSystemCurrentControlSetServicesTcpipParameters]:
• - MaxHashTableSize=0x4000, sets TCB hash table size to 16384 entries, default is 512.
• - TcpTimedWaitDelay=0x3c, sets TIME_WAIT parameter to 60 seconds (non-RFC 1122), default is 240.
• - MaxFreeTwTcbs=400000, sets maximum number of TIME_WAIT tcbs to 400,000.
• - MaxFreeTcbs=0x16000, sets number of cached (pre-allocated) TCBs, default 1000
• - MaxUserPort=0xfffe, sets maximum open ports to 65534.
• - TcpWindowSize=65535, sets TCP send/receive window size, default 8192.
• - NumTcbTablePartitions=32, sets number of independent TCB table segments, default 4.

BESIM Notes

• BeSim is on own physically separate machine.
• - 4 subnets clients/SUT (via Broadcom Switches)
• - 1 subnet primeclient/clients/SUT/BESIM (via Summit Switch)
• ulimit -n 10000, sets number of open files, default 1024
• /etc/httpd/httpd.conf
• Timeout 300, num. sec. before receives and sends time out; default 120
• KeepAlive On, allow persistent connection; default Off
• KeepAliveRequests 0, unlimit number of requests; default 100
• KeepAliveTimeout 600, num. sec. wait for next request; default 15
• worker.c:
• - ThreadLimit=256, max number worker threads in a server; default 64
• - ServerLimit=32, max number of active child processes; default 4
• - StartServers=32, initial number of server processes to start; default 2
• - MaxClients=8192, max number of simultaneous client connections; default 150
• - MaxSpareThreads=8192, max number of worker threads which are kept spare; default 75
• - ThreadsPerChild=256, max number of requests a server process serves; default 25
• Listen 10.100.0.91:81 #eth0, bind Apache to a spec. IP-address; default Listen 80
• LoadModule fastcgi_module modules/mod_fastcgi.so
• FastCgiConfig -idle-timeout 86400 -listen-queue-depth 1024 -flush -init-start-delay 0
• ServerName besim:81
• DocumentRoot /var/www; default /var/www/html
• ServerSignature Off, default On
• ScriptAlias /fcgi-bin/ /var/www/fcgi-bin
• AddLanguage en .en (only); default all
• #LanguagePriority en ca ...; default LanguagePriority en ca ...
• #ForceLanguagePriority Prefer Fallback; default ForceLanguagePriority Prefer Fallback
• SetHandler fastcgi-script
• AddHandler fastcgi-script .fcgi
• ErrorLog: LogLevel Error
• CustomLog: LogFormat Common
• (ifconfig eth0)
• - txqueuelen=20000, transmit queue length; default 100
• /proc/irq
• - 169.smp_affinity=00000001, lock IRQ of NIC(eth0) to 1. processor; default 0xffffffff
• - 0.smp_affinity=00000002, lock IRQ of TIMER to 2. processor; default 0xffffffff
• - irqbalance disabled
• /proc/sys/net
• - core.optmem_max=10000000, maximum amount of option memory buffers, default 10240
• - core.rmem_default=10000000, default receive socket buffer size, default 65535
• - core.rmem_max=10000000, maximum receive socket buffer size, default 131071
• - core.wmem_default=10000000, default send socket buffer size, default 65535
• - core.wmem_max=10000000, maximum send socket buffer size, default 131071
• - core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, default 300
• - ipv4.tcp_max_tw_buckets=2000000, set TCP time-wait buckets pool size, default 180000
• - ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
• - ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
• - ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space allocatable, default 195584 196096 196608
• - ipv4.tcp_timestamps=0, turns TCP timestamp support off, default on
• - ipv4.tcp_dsack=0, turns DSACK support off, default on
• - ipv4.tcp_sack=0, turns SACK support off, default on
• - ipv4.tcp_window_scaling=0, turns TCP window scaling support off, default on
• - ipv4.ip_forward=1, default off
• Kernel parameters:
• - idle=poll, idle threads poll reschedule flag, default: use HLT instruction

Other Notes

• N/A

Errors for Ecommerce Workload

Quality of Service Errors

•   No QOS Errors Found

Validation Errors

•   No Validation Errors Found

Notes for Support Workload

SUT Notes

• 1 disk for OS
• 27 disks for 'Default Web Site' (fileset, applications, logs),SW RAID0
• - using 128k chunk size for the raid array (mdadm.conf: default 64k)
• set noatime,nodiratime,nocheck for specweb mount (/etc/fstab):
• - noatime/nodiratime: Do not update inode access times on this file system.
• - nocheck: No checking is done. (no check on mount)
• Intel PRO/1000 MT dual (PCI-X):
• (insmod tg3 eth0, e1000 eth1 eth2 eth3 eth4)
• - FlowControl=0 (off), default read settings from the EEPROM
• - RxDescriptors=768, default 256
• - TxDescriptors=4096, default 256
• (ifconfig eth0 eth1 eth2 eth3 eth4)
• - txqueuelen=60000, transmit queue length; default 100
• /proc/irq
• - 225.smp_affinity=00000001, lock IRQ of NIC(eth1) to 1. processor; default 0xffffffff
• - 233.smp_affinity=00000002, lock IRQ of NIC(eth2) to 2. processor; default 0xffffffff
• - 50.smp_affinity=00000004, lock IRQ of NIC(eth3) to 3. processor; default 0xffffffff
• - 58.smp_affinity=00000008, lock IRQ of NIC(eth4) to 4. processor; default 0xffffffff
• - irqbalance --noethernet; default irqbalance

Operating System Notes

• ulimit -n 1000000, sets number of open files, default 1024
• ulimit -u 1000000, sets max user processes, default 7160
• /proc/sys/net
• - core.optmem_max=10000000, maximum amount of option memory buffers, default 10240
• - core.rmem_default=10000000, default receive socket buffer size, default 65535
• - core.rmem_max=10000000, maximum receive socket buffer size, default 131071
• - core.wmem_default=10000000, default send socket buffer size, default 65535
• - core.wmem_max=10000000, maximum send socket buffer size, default 131071
• - core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, default 300
• - ipv4.tcp_max_tw_buckets=2000000, set TCP time-wait buckets pool size, default 180000
• - ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
• - ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
• - ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space allocatable, default 195584 196096 196608
• - ipv4.tcp_timestamps=0, turns TCP timestamp support off, default on
• - ipv4.tcp_dsack=0, turns DSACK support off, default on
• - ipv4.tcp_sack=0, turns SACK support off, default on
• - ipv4.tcp_window_scaling=0, turns TCP window scaling support off, default on
• - ipv4.ip_forward=1, default off
• Kernel parameters:
• - idle=poll, idle threads poll reschedule flag, default: use HLT instruction

HTTP Software Notes

• Rock Web Server /wwwroot/rockweb/conf/httpd.conf
• - server_log httpd.log
• - validate_static -1, disables static file modification validation, default 0
• - validate_httpmod -1, disables HTTP module modification validation, default 0
• - header_etag_on 0, disables etag header in HTTP replies, default 1
• - header_server_on 0, disables server header in HTTP replies, default 1
• - tcp_send_buf_size 1048576,sets socket send buffer size
• - log_buf_size 1048576,sets access log buffer size, default: 65536
• - direct_io 1, uses direct IO when possible
• - connection_timeout 9600, connection inactivity timeout, default 60s
• - keepalive_max 100000, (bank/ecom) max. keepalive requests on a connection, default 100
• - cache_replacement lru, (sup/ecom) least-recent-used policy for file replacement, default random
• - cache_memory_size 8192, (support) cache manager memory, default 0
• - cache_file_max_size 5546968,(support) largest file allowed in cache manager, default 2097152
• - cache_memory_size 8192, (ecommerce) cache manager memory, default 0
• - cache_file_count 60689, (ecommerce) estimated number of static files for the cache, default 27179
• - worker 10.100.5.100/80 10.100.5.100/443 */9090
• - worker 10.100.6.100/80 10.100.6.100/443
• - worker 10.100.7.100/80 10.100.7.100/443
• - worker 10.100.8.100/80 10.100.8.100/443
• - ;host; wsrv:80
• - document_root /wwwroot/jakarta-tomcat-5.5.9/webapps
• - access_log access_port80.log
• - access_log_format commonlog
• - error_log error_port80.log
• - ;file; /
• - cgi_type gateway
• - cgi_regex .*jsp
• - cgi_listener localhost/8009
• - ;/file;
• - ;/host;
• - ;host; wsrv:443
• - ssl_key_file /wwwroot/rockweb/etc/key-cert/sample.key
• - ssl_cert_file /wwwroot/rockweb/etc/key-cert/sample.certificate
• - document_root /wwwroot/jakarta-tomcat-5.5.9/webapps
• - access_log access_port443.log
• - access_log_format commonlog
• - error_log error_port443.log
• - ;file; /
• - cgi_type gateway
• - cgi_regex .*jsp
• - cgi_listener localhost/8009
• - ;/file;
• - ;/host;

Script Engine Notes

• Apache conf/server.xml (http://jakarta.apache.org/tomcat/tomcat-5.5-doc/config/ajp.html):
• - Connector port=8009; default 8080
• - maxThreads=15000; default 150
• - minSpareThreads=9000, bank; default 25
• - maxSpareThreads=9000, bank; default 75
• - minSpareThreads=9000, ecommerce; default 25
• - maxSpareThreads=9000, ecommerce; default 75
• - minSpareThreads=5000, support; default 25
• - maxSpareThreads=5000, support; default 75
• - acceptCount=10000; default 100
• - connectionTimeout=0; default 20000
• - Host name=wsrv05 appBase=webapps; default name=localhost
• conf/worker.properties (http://jakarta.apache.org/tomcat/tomcat-5.5-doc/config/ajp.html):
• - worker.list=ajp13w01; default: ajp13
• - worker.ajp13w01.type=ajp13
• - worker.ajp13w01.host=localhost
• - worker.ajp13w01.port=8009

HTTP Script Notes

• Tomcat is used as JSP engine
• SPEC-provided JSP scripts, no modifications
• JAVA_OPTS=-Xms4000m -Xmx4000m -Xss512k -Xcompactexplicitgc -server -d64 SUT/etc/profile
• java -Xms512m -Xmx512m -XX:+UseParNewGC -XX:+UseConcMarkSweepGC specwebclient

Client Notes

• NDIS registry tuning parameters [HKLMSystemCurrentControlSetServicesNDISParameters]:
• - ProcessorAffinityMask=0, default 1 (any processor)
• TCP/IP registry tuning parameters [HKLMSystemCurrentControlSetServicesTcpipParameters]:
• - MaxHashTableSize=0x4000, sets TCB hash table size to 16384 entries, default is 512.
• - TcpTimedWaitDelay=0x3c, sets TIME_WAIT parameter to 60 seconds (non-RFC 1122), default is 240.
• - MaxFreeTwTcbs=400000, sets maximum number of TIME_WAIT tcbs to 400,000.
• - MaxFreeTcbs=0x16000, sets number of cached (pre-allocated) TCBs, default 1000
• - MaxUserPort=0xfffe, sets maximum open ports to 65534.
• - TcpWindowSize=65535, sets TCP send/receive window size, default 8192.
• - NumTcbTablePartitions=32, sets number of independent TCB table segments, default 4.

BESIM Notes

• BeSim is on own physically separate machine.
• - 4 subnets clients/SUT (via Broadcom Switches)
• - 1 subnet primeclient/clients/SUT/BESIM (via Summit Switch)
• ulimit -n 10000, sets number of open files, default 1024
• /etc/httpd/httpd.conf
• Timeout 300, num. sec. before receives and sends time out; default 120
• KeepAlive On, allow persistent connection; default Off
• KeepAliveRequests 0, unlimit number of requests; default 100
• KeepAliveTimeout 600, num. sec. wait for next request; default 15
• worker.c:
• - ThreadLimit=256, max number worker threads in a server; default 64
• - ServerLimit=32, max number of active child processes; default 4
• - StartServers=32, initial number of server processes to start; default 2
• - MaxClients=8192, max number of simultaneous client connections; default 150
• - MaxSpareThreads=8192, max number of worker threads which are kept spare; default 75
• - ThreadsPerChild=256, max number of requests a server process serves; default 25
• Listen 10.100.0.91:81 #eth0, bind Apache to a spec. IP-address; default Listen 80
• LoadModule fastcgi_module modules/mod_fastcgi.so
• FastCgiConfig -idle-timeout 86400 -listen-queue-depth 1024 -flush -init-start-delay 0
• ServerName besim:81
• DocumentRoot /var/www; default /var/www/html
• ServerSignature Off, default On
• ScriptAlias /fcgi-bin/ /var/www/fcgi-bin
• AddLanguage en .en (only); default all
• #LanguagePriority en ca ...; default LanguagePriority en ca ...
• #ForceLanguagePriority Prefer Fallback; default ForceLanguagePriority Prefer Fallback
• SetHandler fastcgi-script
• AddHandler fastcgi-script .fcgi
• ErrorLog: LogLevel Error
• CustomLog: LogFormat Common
• (ifconfig eth0)
• - txqueuelen=20000, transmit queue length; default 100
• /proc/irq
• - 169.smp_affinity=00000001, lock IRQ of NIC(eth0) to 1. processor; default 0xffffffff
• - 0.smp_affinity=00000002, lock IRQ of TIMER to 2. processor; default 0xffffffff
• - irqbalance disabled
• /proc/sys/net
• - core.optmem_max=10000000, maximum amount of option memory buffers, default 10240
• - core.rmem_default=10000000, default receive socket buffer size, default 65535
• - core.rmem_max=10000000, maximum receive socket buffer size, default 131071
• - core.wmem_default=10000000, default send socket buffer size, default 65535
• - core.wmem_max=10000000, maximum send socket buffer size, default 131071
• - core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, default 300
• - ipv4.tcp_max_tw_buckets=2000000, set TCP time-wait buckets pool size, default 180000
• - ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
• - ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
• - ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space allocatable, default 195584 196096 196608
• - ipv4.tcp_timestamps=0, turns TCP timestamp support off, default on
• - ipv4.tcp_dsack=0, turns DSACK support off, default on
• - ipv4.tcp_sack=0, turns SACK support off, default on
• - ipv4.tcp_window_scaling=0, turns TCP window scaling support off, default on
• - ipv4.ip_forward=1, default off
• Kernel parameters:
• - idle=poll, idle threads poll reschedule flag, default: use HLT instruction

Other Notes

• N/A

Errors for Support Workload

Quality of Service Errors

•   No QOS Errors Found

Validation Errors

• 2 Validation Errors for Iteration 1  :   wclt024 - catalog   

• 2 Validation Errors for Iteration 1  :   wclt028 - catalog   

• 1 Validation Errors for Iteration 1  :   wclt024 - product   

• 2 Validation Errors for Iteration 1  :   wclt026 - product   

• 3 Validation Errors for Iteration 1  :   wclt024 - fileCatalog   

• 3 Validation Errors for Iteration 1  :   wclt024 - file   

• 2 Validation Errors for Iteration 1  :   wclt022 - download   

• 12 Validation Errors for Iteration 1  :   wclt024 - download   

• 2 Validation Errors for Iteration 1  :   wclt028 - download