SPECweb2005 Result: IBM: IBM System p5 550

SPECweb2005 Result
Copyright © 2005 Standard Performance Evaluation Corporation

IBM: IBM System p5 550
Zeus Technology Ltd.: Zeus 43r1 (64bit)
Apache Software Foundation: Apache Tomcat 5.5.9 + Compat package 5.5.9

SPECweb2005 = 7881

SPECweb2005_Banking = 12240

SPECweb2005_Ecommerce = 11820

SPECweb2005_Support = 7500

Tested By: IBM

SPEC License #: 11

Test Date: Sep-2005

Performance and Configuration Section
Performance Section
Configuration Section

Details Section
Banking Details
Ecommerce Details
Support Details

Notes Section
Banking Notes
Ecommerce Notes
Support Notes

Errors Section
Banking Errors
Ecommerce Errors
Support Errors

Performance

Banking

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

12240

96.4%

99.8%

0.1%

95.4%

99.9%

0.0%

96.3%

99.9%

0.0%

Ecommerce

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

11820

96.6%

99.7%

0.2%

96.4%

99.7%

0.2%

96.5%

99.7%

0.2%

Support

Simultaneous
User Sessions

Test
Iteration

Aggregate QOS Compliance

Good	Tolerable	Fail

Validation Errors

7500

96.2%

99.6%

0.3%

96.0%

99.5%

0.4%

95.7%

99.5%

0.4%

Configuration

Availability Dates
SUT Hardware	Oct-2005
Backend Simulator	Feb-2003
Web Server Software	Jan-2005
Operating System	Jul-2005
Other Components	N/A

System Under Test (SUT)

# of SUTs 1

Vendor IBM

Model IBM System p5 550

Processor 1.9 GHz POWER5+

Processor Speed (MHz) 1900 MHz

# Processors 4 cores, 2 chips, 2 cores/chip (SMT on)

Primary Cache 64KB(I) + 32KB(D) (on chip)/core

Secondary Cache 1920KB unified (on chip)/chip

Other Cache 36MB unified (off chip)/DCM, 2 DCM/SUT

Memory 32 GB (16x2GB) DDR2

Disk Subsystem 23 x 36GB 15KRPM SCSI

Disk Controllers 3 x PCI-X Dual channel Ultra 320 SCSI controller

Operating System SUSE Linux Enterprise Server 9 SP2 (default kernel 2.6.5-7.191-pseries64)

File System ext2

Other Hardware See SUT notes

Other Software Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2). Classic VM (build 1.4.2, J2RE 1.4.2 IBM build cxp641420ifx-20040722

SUT Network

# of Controllers 6

Network Controllers IBM 10/100/1000 Base-TX Ethernet PCI-X Adapter

# of Networks 6

Network Type Gigabit Ethernet

Network Speed 1 Gb/s

MSL (sec) 30 (Non RFC1122)

Time-Wait (sec) 60 (Non RFC1122)

MTU Size 1500

Web Server Software
Vendor	Zeus Technology Ltd.
Name/Version	Zeus 43r1 (64bit)
Dynamic Scripts	JSP
Server Cache	N/A
Log Mode	Binary Common Log Format

Script Engine
Vendor	Apache Software Foundation
Name/Version	Apache Tomcat 5.5.9 + Compat package 5.5.9
Dynamic Scripts	JSP
Server Cache	N/A
Log Mode	Common Log Format

Clients

# of Clients 24

Model IBM eServer xSeries 335

Processor Intel Xeon

Processor Speed (MHz) 2000 MHz

# Processors 2

Memory 1 GB

Network Controller 1 x BCM5703 Gigabit Ethernet

Operating System RedHat 9.0

JVM Version Java 2 Runtime Environment, Std Edition (build 1.4.2_05-b04)

JIT Version Java HotSpot Client VM (build 1.4.2_05-b04, mixed mode)

Other Hardware N/A

Other Software N/A

Backend Simulator (BESIM)

# of Simulators 1

Model IBM eServer pSeries 630 Model 6C4

Processor 1450 MHz POWER4+

Processor Speed (MHz) 1450 MHz

# of Processors 4

Memory 32 GB

Network Controller IBM 10/100/1000 Base-TX Ethernet PCI-X Adapter

Operating System SUSE Linux Enterprise Server 9 SP1 (default kernel 2.6.5-7.139-pseries64)

File System ext2

Web Server Zeus 42r3 (32bit)

Server Scripts ISAPI

Other Hardware N/A

Other Software N/A

Banking Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

644833

620039

24137

657

6335.6

1.409

34437

account_summary

454977

441230

12688

1059

3579.0

1.273

27571

check_detail_html

255112

241442

13017

653

1748.7

1.422

24025

bill_pay

413380

400293

12118

969

3008.2

1.28

25505

add_payee

33388

32543

773

251.5

1.225

26403

payee_info

23915

22059

1774

299.6

1.531

43921

quick_pay

198053

181283

16109

661

1880.2

1.543

33274

billpay_status

65839

64201

1480

158

623.4

1.225

33191

chg_profile

36649

34972

1590

452.2

1.39

43252

post_profile

26433

25466

897

276.8

1.305

36715

req_checks

36350

26530

9706

114

913.9

1.907

88123

post_chk_order

26226

25084

1057

248.5

1.355

33215

req_xfer_form

51989

50937

957

327.2

1.152

22061

post_fund_xfer

37345

35689

1563

261.3

1.355

24531

logout

183892

179255

4268

369

3946.1

1.35

75212

check_image

510490

510288

130

1551.6

0.217

10653

Total

2998871

2891311	102264	5296

25704.6

640560

607985

32328

247

6113.9

1.459

34457

account_summary

452120

436651

15134

335

3455.4

1.323

27591

check_detail_html

253613

234606

18818

189

1687.9

1.479

24028

bill_pay

410803

395911

14590

302

2901.9

1.331

25502

add_payee

33236

32381

832

243.0

1.275

26398

payee_info

23837

21214

2594

290.0

1.591

43932

quick_pay

196857

173142

23558

157

1814.2

1.601

33271

billpay_status

65500

63970

1490

602.2

1.266

33192

chg_profile

36368

34205

2131

435.7

1.442

43253

post_profile

26206

25215

971

266.4

1.349

36709

req_checks

36037

23519

12490

879.8

1.954

88143

post_chk_order

25991

24567

1400

239.2

1.407

33233

req_xfer_form

51606

50664

899

315.6

1.197

22080

post_fund_xfer

37125

35244

1860

252.3

1.405

24536

logout

182761

178295

4359

107

3802.5

1.377

75113

check_image

507594

507494

1498.1

0.226

10654

Total

2980214

2845063	133542	1609

24799.0

640899

615721

25145

6122.2

1.458

34444

account_summary

451982

440540

11418

3457.2

1.323

27580

check_detail_html

253319

238111

15173

1688.0

1.478

24028

bill_pay

410577

399405

11147

2904.2

1.33

25505

add_payee

33092

32504

586

242.3

1.271

26403

payee_info

23764

21396

2365

289.5

1.589

43931

quick_pay

196618

176049

20543

1814.2

1.6

33270

billpay_status

65592

64350

1233

603.7

1.269

33192

chg_profile

36446

34744

1700

437.1

1.44

43253

post_profile

26268

25535

731

267.3

1.35

36705

req_checks

36073

23280

12781

881.7

1.955

88135

post_chk_order

25958

24936

1021

239.1

1.403

33223

req_xfer_form

51681

51028

650

316.2

1.194

22066

post_fund_xfer

37072

35628

1440

252.2

1.402

24536

logout

183012

179559

3443

3815.1

1.373

75168

check_image

506958

506954

1497.8

0.224

10653

Total

2979311

2869740	109380	191

24828.7

Notes for Banking Workload

SUT Notes

1 SCSI 15K 36GB disk for OS and webserver
2 SCSI 15K 36GB disks using software RAID0 for web server log
8 SCSI 15K 36GB disks using software RAID0 for Support fileset
2 SCSI 15K 36GB disks using software RAID0 for Ecommerce fileset
10 SCSI 15K 36GB disks using software RAID0 for Banking fileset
2 x External IO Drawer 7311-D20 used for Banking, Support, Ecommerce and web server log disks
Banking and Web Server log disks installed in first IO drawer
Ecommerce and Support disks installed in second IO drawer
All disk drives use stripesize of 64KB
Use 1 integrated Gigabit adapter, 4 Gigabit adapters in CEC (Central Electronics Complex), 1 Gigabit adapter in first IO drawer
1 x Dual Port I/O Hub RIO-2/HSL-2 Copper adapter to attach 2 I/O drawers
3 x PCI-X Dual channel Ultra 320 SCSI Controller (1 in CEC, 1 per I/O drawer)
2 x Cisco 3750-T24 switch
4 clients per net

Operating System Notes

ulimit -n 1000000, sets number of open files, default 1024
Each NIC's TX queue length set to 30000 via ifconfig, default 100
Each NIC's ITR set to 1800 via insmod InterruptThrottleRate=1800, default=dynamic
Each NIC's RxDescriptors set to 2048 via insmod RxDescriptors=2048, default=256
Each NIC's TxDescriptors set to 2048 via insmod TxDescriptors=2048, default=256
6 NIC irqs bound to first 6 logical CPUs
Each NIC's TSO set to off via ethtool, default=on
net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0
net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1
net.ipv4.tcp_max_tw_buckets = 3000000, sets TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 10000000, maximum receive socket buffer size, default 131071
net.core.rmem_default = 10000000, default receive socket buffer size, default 135168
net.core.wmem_max = 10000000, maximum send socket buffer size, default 131071
net.core.wmem_default = 10000000, default send socket buffer size, default 135168
net.core.optmem_max = 10000000, default 20480
net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 392192 392704 393216
net.core.somaxconn=40960, size of the listen queue for accepting new TCP connections, default 128
net.core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, defaul 300
log & Banking, Ecommerce , Support file systems mounted with 'noatime,nodiratime,nobh,noacl', no inode access time updating, no attach buffer_head to file pagecache, no control list
Banking CHECK_IMAGE_SUBDIRS=300
DCM: Acronym for Dual-Chip Module (one dual-core processor chip + one L3-cache chip)
SMT: Acronym for Simultaneous Multi-Threading. A processor technology that allows the simultaneous execution of multiple thread contexts within a single processor. (Enabled by default)

HTTP Software Notes

ZEUSHOME/web/global.cfg
3 ZWS instances (2 children each instance)
tuning!bind_any no, have server sockets bind to IPADDR_ANY, default yes
tuning!cache_files 320001, Size of the web server file cache (number of files), default 8011
tuning!cache_large_file 1048576, max size of a large file (bytes), default 1048577
tuning!cache_small_file 10240, max size of a small file (bytes), default 4096
tuning!cache_stat_expire 180000, Time for which the response of a stat() call is cached (seconds), default 17
tuning!cache_flush_interval 180000, Time after which unaccessed files are flushed from the cache (seconds), default 120
tuning!cache_max_bytes 0, Maximum size to reserve for cached files (bytes) (0 = no limit), default 33554432
tuning!keepalive yes, enable keepalive connections, default yes
tuning!ssl_keepalive yes, Whether to keepalive SSL connections, default no
tuning!ssl_diskcache no, use 2nd level on-disk cache for storing SSL session information, default yes
tuning!max_connections 320001, The maximum number of connections to process simultaneously, defaul half number of file-descriptors
tuning!ssl_sessioncache_size 5003, Size of ssl session cache, default 199
tuning!keepalive_timeout 1200, Time after which an inactive keepalive connection will be closed (seconds), default 15
tuning!keepalive_max -1, Maximum permitted number of keepalive connections (-1 means no limit), default 256
tuning!listen_queue_size 10240, Size of the TCP listen queue, default 256
tuning!cbuff_size 1048576, Cbuff size, default 8192
tuning!so_rbuff_size 32768, Size of the server socket buffer (so_rbuff_size) (bytes), default unset
tuning!softservers no, enable 'software' Virtual Servers, default yes
tuning!unique_bind yes, Force each child processes to bind to a unique IP address, default no
tuning!cache_cooling_time 0, any file modified in the last 'n' seconds is not cached, default 120
tuning!modules!cgi!minuid 0, min uid with CGIs can run, default 0
tuning!modules!cgi!mingid 0, min gid with CGIs can run, default 0
tuning!modules!stats!enabled no, enable the stats module, default no
tuning!modules!nsapi!enabled no, enable the nsapi module, default no
tuning!clientfirst_optimise yes, connection not accepted till data is ready, default no
tuning!maxaccept 40960, max number of accept() calls per server socket, default 32
tuning!ssl_cbuff_size 32840, size of SSL circular buffer, default 16404
Under runningsites:
modules!gateway!enabled yes, enable gateway module
modules!gateway!rewritecookie yes, rewrite cookies from origin server
modules!gateway!rewritelocation yes, rewrite 'Location' headers from Tomcat
modules!gateway!securecookie no, don't force secure flag
security!enabled yes, enable security
For first ZWS instance:
modules!gateway!path!~/.*.jsp localhost:8080, forward JSP requests to Tomcat backend port 8080
For second ZWS instance:
modules!gateway!path!~/.*.jsp localhost:8081, forward JSP requests to Tomcat backend port 8081
For third ZWS instance:
modules!gateway!path!~/.*.jsp localhost:8082, forward JSP requests to Tomcat backend port 8082

HTTP Script Notes

SPEC-provided JSP scripts used without modification
export JAVA_OPT=-Xms2g -Xmx2g -Xcompactexplicitgc -Xrs, set heap size to 2GB and optimize garbage collection
3 Tomcat instances used to deploy JSP scripts
For first instance connector port 8080
For second instance connector port 8081
For third instance connector port 8082
server.xml tuning:
- maxThreads=15000, max number of sessions, default 150
- minSpareThreads=250, number of threads created when connector starts, default 25
- maxSpareThreads=750, max number of unused threads allowed, default 75
- acceptCount=10000, max queue length for connection requests, default 100
- connectTimeout=0, no connection timeout, default 20000
- maxKeepAliveRequests=-1, max number of requests for keepalive (-1 unlimited), default 100

Client Notes

ulimit -n 1000000
java -Xcompactexplicitgc -Xrs -Xms512m -Xmx512m -Xss128k specwebclient

BESIM Notes

System Notes:
ulimit -n 1000000
net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0
net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1
net.ipv4.tcp_max_tw_buckets = 3000000, sets TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 10000000, maximum receive socket buffer size, default 65535
net.core.rmem_default = 10000000, default receive socket buffer size, default 65535
net.core.wmem_max = 10000000, maximum send socket buffer size, default 65535
net.core.wmem_default = 10000000, default send socket buffer size, default 65535
net.core.optmem_max = 10000000, default 10240
net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 31744 32256 32768
net.core.somaxconn=20480, size of the listen queue for accepting new TCP connections, default 128
net.core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, defaul 300
HTTP Software Notes:
Zeus web server global.conf:
tuning!bind_any no, have server sockets bind to IPADDR_ANY, default yes
tuning!cache_files 320001, Size of the web server file cache (number of files), default 8011
tuning!cache_large_file 1048576, max size of a large file (bytes), default 1048577
tuning!cache_small_file 10240, max size of a small file (bytes), default 4096
tuning!cache_stat_expire 180000, Time for which the response of a stat() call is cached (seconds), default 17
tuning!cache_flush_interval 180000, Time after which unaccessed files are flushed from the cache (seconds), default 120
tuning!cache_max_bytes 0, Maximum size to reserve for cached files (bytes) (0 = no limit), default 33554432
tuning!num_children 1, Number of child zeus.web processes, default 1 per CPU
tuning!keepalive yes, enable keepalive connections, default yes
tuning!ssl_keepalive yes, Whether to keepalive SSL connections, default no
tuning!ssl_diskcache no, use 2nd level on-disk cache for storing SSL session information, default yes
tuning!max_connections 5003, The maximum number of connections to process simultaneously, defaul half number of file-descriptors
tuning!ssl_sessioncache_size 5003, Size of ssl session cache, default 199
tuning!keepalive_timeout 1200, Time after which an inactive keepalive connection will be closed (seconds), default 15
tuning!keepalive_max -1, Maximum permitted number of keepalive connections (-1 means no limit), default 256
tuning!listen_queue_size 10240, Size of the TCP listen queue, default 256
tuning!cbuff_size 1048576, Cbuff size, default 8192
tuning!so_rbuff_size 32768, Size of the server socket buffer (so_rbuff_size) (bytes), default unset
tuning!softservers no, enable 'software' Virtual Servers, default yes
tuning!unique_bind yes, Force each child processes to bind to a unique IP address, default no
tuning!cache_cooling_time 0, any file modified in the last 'n' seconds is not cached, default 120
tuning!modules!cgi!minuid 0, min uid with CGIs can run, default 0
tuning!modules!cgi!mingid 0, min gid with CGIs can run, default 0
tuning!modules!stats!enabled no, enable the stats module, default no
tuning!modules!nsapi!enabled no, enable the nsapi module, default no
tuning!clientfirst_optimise yes, connection not accepted till data is ready, default no
tuning!maxaccept 256, max number of accept() calls per server socket, default 32
tuning!ssl_cbuff_size 32840, size of SSL circular buffer, default 16404

Other Notes

Errors for Banking Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

Ecommerce Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

index

251320

243776

6345

1199

9785.4

2.089

138454

126591

125105

1464

6758.3

2.149

189840

browse

225407

216713

7512

1182

9947.2

2.22

156924

browse_productline

192767

190452

2263

10412.5

2.174

192078

productdetail

153881

152288

1485

108

2319.7

1.284

53604

customize1

323718

318517

5108

15033.5

1.934

165138

customize2

171593

168525

3003

7933.2

1.931

164400

customize3

118229

97878

18632

1719

5886.8

2.512

177057

cart

101620

97238

3782

600

2107.9

1.556

73761

72394

67175

4882

337

979.7

1.033

48126

shipping

68185

66773

1361

823.9

0.837

42970

billing

64790

63353

1359

602.8

0.933

33089

confirm

48406

47511

882

433.5

0.741

31848

Total

1918901

1855304	58078	5519

73025.1

index

250463

242371

6836

1256

9701.0

2.109

138479

126172

124672

1456

6699.4

2.157

189839

browse

224708

215137

8341

1230

9861.5

2.24

156904

browse_productline

192248

189817

2347

10326.9

2.181

192051

productdetail

153552

151794

1641

117

2303.2

1.297

53627

customize1

322671

317013

5538

120

14903.8

1.945

165138

customize2

171191

167974

3147

7871.7

1.94

164398

customize3

117972

96494

19688

1790

5842.1

2.538

177053

cart

101253

96587

4130

536

2076.9

1.577

73337

72281

66897

5081

303

979.1

1.057

48433

shipping

68032

66477

1498

817.6

0.858

42970

billing

64628

63075

1458

598.1

0.958

33089

confirm

48357

47426

897

430.7

0.759

31848

Total

1913528

1845734	62058	5736

72412.6

index

250728

243376

6280

1072

9755.4

2.091

138488

125838

124280

1522

6711.6

2.151

189840

browse

224963

216076

7813

1074

9918.0

2.225

156922

browse_productline

192319

189980

2252

10377.7

2.175

192066

productdetail

153720

151970

1630

120

2314.4

1.288

53589

customize1

323297

317553

5601

143

14999.5

1.938

165138

customize2

171536

168161

3297

7922.7

1.934

164395

customize3

118184

97948

18354

1882

5878.3

2.522

177037

cart

101436

96775

4088

573

2095.8

1.567

73541

72244

66827

5051

366

982.8

1.053

48425

shipping

67937

66332

1527

820.1

0.853

42970

billing

64591

63022

1455

114

600.4

0.947

33089

confirm

48361

47368

957

432.7

0.751

31848

Total

1915154

1849668	59827	5659

72809.9

Notes for Ecommerce Workload

SUT Notes

1 SCSI 15K 36GB disk for OS and webserver
2 SCSI 15K 36GB disks using software RAID0 for web server log
8 SCSI 15K 36GB disks using software RAID0 for Support fileset
2 SCSI 15K 36GB disks using software RAID0 for Ecommerce fileset
10 SCSI 15K 36GB disks using software RAID0 for Banking fileset
2 x External IO Drawer 7311-D20 used for Banking, Support, Ecommerce and web server log disks
Banking and Web Server log disks installed in first IO drawer
Ecommerce and Support disks installed in second IO drawer
All disk drives use stripesize of 64KB
Use 1 integrated Gigabit adapter, 4 Gigabit adapters in CEC (Central Electronics Complex), 1 Gigabit adapter in first IO drawer
1 x Dual Port I/O Hub RIO-2/HSL-2 Copper adapter to attach 2 I/O drawers
3 x PCI-X Dual channel Ultra 320 SCSI Controller (1 in CEC, 1 per I/O drawer)
2 x Cisco 3750-T24 switch
4 clients per net

Operating System Notes

ulimit -n 1000000, sets number of open files, default 1024
Each NIC's TX queue length set to 30000 via ifconfig, default 100
Each NIC's ITR set to 1800 via insmod InterruptThrottleRate=1800, default=dynamic
Each NIC's RxDescriptors set to 2048 via insmod RxDescriptors=2048, default=256
Each NIC's TxDescriptors set to 2048 via insmod TxDescriptors=2048, default=256
6 NIC irqs bound to first 6 logical CPUs
Each NIC's TSO set to off via ethtool, default=on
net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0
net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1
net.ipv4.tcp_max_tw_buckets = 3000000, sets TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 10000000, maximum receive socket buffer size, default 131071
net.core.rmem_default = 10000000, default receive socket buffer size, default 135168
net.core.wmem_max = 10000000, maximum send socket buffer size, default 131071
net.core.wmem_default = 10000000, default send socket buffer size, default 135168
net.core.optmem_max = 10000000, default 20480
net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 392192 392704 393216
net.core.somaxconn=40960, size of the listen queue for accepting new TCP connections, default 128
net.core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, defaul 300
log & Banking, Ecommerce , Support file systems mounted with 'noatime,nodiratime,nobh,noacl', no inode access time updating, no attach buffer_head to file pagecache, no control list
Ecommerce PRODUCT_IMAGE_SUBDIRS=100
DCM: Acronym for Dual-Chip Module (one dual-core processor chip + one L3-cache chip)
SMT: Acronym for Simultaneous Multi-Threading. A processor technology that allows the simultaneous execution of multiple thread contexts within a single processor. (Enabled by default)

HTTP Software Notes

ZEUSHOME/web/global.cfg
2 ZWS instances (3 children each instance)
tuning!bind_any no, have server sockets bind to IPADDR_ANY, default yes
tuning!cache_files 320001, Size of the web server file cache (number of files), default 8011
tuning!cache_large_file 1048576, max size of a large file (bytes), default 1048577
tuning!cache_small_file 10240, max size of a small file (bytes), default 4096
tuning!cache_stat_expire 180000, Time for which the response of a stat() call is cached (seconds), default 17
tuning!cache_flush_interval 180000, Time after which unaccessed files are flushed from the cache (seconds), default 120
tuning!cache_max_bytes 0, Maximum size to reserve for cached files (bytes) (0 = no limit), default 33554432
tuning!keepalive yes, enable keepalive connections, default yes
tuning!ssl_keepalive yes, Whether to keepalive SSL connections, default no
tuning!ssl_diskcache no, use 2nd level on-disk cache for storing SSL session information, default yes
tuning!max_connections 320001, The maximum number of connections to process simultaneously, defaul half number of file-descriptors
tuning!ssl_sessioncache_size 5003, Size of ssl session cache, default 199
tuning!keepalive_timeout 1200, Time after which an inactive keepalive connection will be closed (seconds), default 15
tuning!keepalive_max -1, Maximum permitted number of keepalive connections (-1 means no limit), default 256
tuning!listen_queue_size 10240, Size of the TCP listen queue, default 256
tuning!cbuff_size 1048576, Cbuff size, default 8192
tuning!so_rbuff_size 32768, Size of the server socket buffer (so_rbuff_size) (bytes), default unset
tuning!softservers no, enable 'software' Virtual Servers, default yes
tuning!unique_bind yes, Force each child processes to bind to a unique IP address, default no
tuning!cache_cooling_time 0, any file modified in the last 'n' seconds is not cached, default 120
tuning!modules!cgi!minuid 0, min uid with CGIs can run, default 0
tuning!modules!cgi!mingid 0, min gid with CGIs can run, default 0
tuning!modules!stats!enabled no, enable the stats module, default no
tuning!modules!nsapi!enabled no, enable the nsapi module, default no
tuning!clientfirst_optimise yes, connection not accepted till data is ready, default no
tuning!maxaccept 40960, max number of accept() calls per server socket, default 32
tuning!ssl_cbuff_size 32840, size of SSL circular buffer, default 16404
Under runningsites:
modules!gateway!enabled yes, enable gateway module
modules!gateway!rewritecookie yes, rewrite cookies from origin server
modules!gateway!rewritelocation yes, rewrite 'Location' headers from Tomcat
modules!gateway!securecookie no, don't force secure flag
security!enabled yes, enable security
For first ZWS instance:
modules!gateway!path!~/.*.jsp localhost:8080, forward JSP requests to Tomcat backend port 8080
For second ZWS instance:
modules!gateway!path!~/.*.jsp localhost:8081, forward JSP requests to Tomcat backend port 8081

HTTP Script Notes

SPEC-provided JSP scripts used without modification
export JAVA_OPT=-Xms2g -Xmx2g -Xcompactexplicitgc -Xrs, set heap size to 2GB and optimize garbage collection
2 Tomcat instances used to deploy JSP scripts
For first instance connector port 8080
For second instance connector port 8081
server.xml tuning:
- maxThreads=15000, max number of sessions, default 150
- minSpareThreads=250, number of threads created when connector starts, default 25
- maxSpareThreads=750, max number of unused threads allowed, default 75
- acceptCount=10000, max queue length for connection requests, default 100
- connectTimeout=0, no connection timeout, default 20000
- maxKeepAliveRequests=-1, max number of requests for keepalive (-1 unlimited), default 100

Client Notes

ulimit -n 1000000
java -Xcompactexplicitgc -Xrs -Xms512m -Xmx512m -Xss128k specwebclient

BESIM Notes

System Notes:
ulimit -n 1000000
net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0
net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1
net.ipv4.tcp_max_tw_buckets = 3000000, sets TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 10000000, maximum receive socket buffer size, default 65535
net.core.rmem_default = 10000000, default receive socket buffer size, default 65535
net.core.wmem_max = 10000000, maximum send socket buffer size, default 65535
net.core.wmem_default = 10000000, default send socket buffer size, default 65535
net.core.optmem_max = 10000000, default 10240
net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 31744 32256 32768
net.core.somaxconn=20480, size of the listen queue for accepting new TCP connections, default 128
net.core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, defaul 300
HTTP Software Notes:
Zeus web server global.conf:
tuning!bind_any no, have server sockets bind to IPADDR_ANY, default yes
tuning!cache_files 320001, Size of the web server file cache (number of files), default 8011
tuning!cache_large_file 1048576, max size of a large file (bytes), default 1048577
tuning!cache_small_file 10240, max size of a small file (bytes), default 4096
tuning!cache_stat_expire 180000, Time for which the response of a stat() call is cached (seconds), default 17
tuning!cache_flush_interval 180000, Time after which unaccessed files are flushed from the cache (seconds), default 120
tuning!cache_max_bytes 0, Maximum size to reserve for cached files (bytes) (0 = no limit), default 33554432
tuning!num_children 1, Number of child zeus.web processes, default 1 per CPU
tuning!keepalive yes, enable keepalive connections, default yes
tuning!ssl_keepalive yes, Whether to keepalive SSL connections, default no
tuning!ssl_diskcache no, use 2nd level on-disk cache for storing SSL session information, default yes
tuning!max_connections 5003, The maximum number of connections to process simultaneously, defaul half number of file-descriptors
tuning!ssl_sessioncache_size 5003, Size of ssl session cache, default 199
tuning!keepalive_timeout 1200, Time after which an inactive keepalive connection will be closed (seconds), default 15
tuning!keepalive_max -1, Maximum permitted number of keepalive connections (-1 means no limit), default 256
tuning!listen_queue_size 10240, Size of the TCP listen queue, default 256
tuning!cbuff_size 1048576, Cbuff size, default 8192
tuning!so_rbuff_size 32768, Size of the server socket buffer (so_rbuff_size) (bytes), default unset
tuning!softservers no, enable 'software' Virtual Servers, default yes
tuning!unique_bind yes, Force each child processes to bind to a unique IP address, default no
tuning!cache_cooling_time 0, any file modified in the last 'n' seconds is not cached, default 120
tuning!modules!cgi!minuid 0, min uid with CGIs can run, default 0
tuning!modules!cgi!mingid 0, min gid with CGIs can run, default 0
tuning!modules!stats!enabled no, enable the stats module, default no
tuning!modules!nsapi!enabled no, enable the nsapi module, default no
tuning!clientfirst_optimise yes, connection not accepted till data is ready, default no
tuning!maxaccept 256, max number of accept() calls per server socket, default 32
tuning!ssl_cbuff_size 32840, size of SSL circular buffer, default 16404

Other Notes

Errors for Ecommerce Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

Support Run Details

Test results for each iteration

Iteration

Request Type

Total Reqs

QOS

Good	Tolerable	Fail

Weighted
ABR

Avg Resp
Time (sec)

Average
Bytes/Req

home

103929

102255

1574

100

825.9

0.985

60005

162025

160162

1751

112

580.5

0.663

27050

catalog

149349

147447

1753

149

670.6

0.729

33902

product

316107

303384

11744

979

2785.9

1.307

66542

fileCatalog

288075

270932

15744

1399

4014.7

1.67

105222

file

173226

160491

11663

1072

2837.4

1.847

123673

download

86575

86464

79699.1

69.5

6950531

Total

1279286

1231135	44287	3864

91414.3

home

103741

101808

1739

194

824.4

0.994

60006

161729

159493

1948

288

579.2

0.67

27044

catalog

149094

146930

1913

251

669.7

0.731

33918

product

315584

302274

11876

1434

2781.1

1.318

66545

fileCatalog

287643

269942

15774

1927

4008.6

1.681

105231

file

173007

159980

11697

1330

2833.6

1.857

123675

download

86426

86272

79585.2

69.528

6953256

Total

1277224

1226699	45023	5502

91282.1

home

103735

101699

1825

211

823.8

0.999

60003

161584

159087

2195

302

578.3

0.682

27040

catalog

149038

146670

2062

306

668.9

0.741

33913

product

315372

300780

12987

1605

2777.6

1.324

66542

fileCatalog

287405

268549

16826

2030

4003.1

1.689

105234

file

172890

159280

12181

1429

2830.2

1.863

123680

download

86446

86290

79491.8

69.471

6947542

Total

1276470

1222355	48163	5952

91173.9

Notes for Support Workload

SUT Notes

1 SCSI 15K 36GB disk for OS and webserver
2 SCSI 15K 36GB disks using software RAID0 for web server log
8 SCSI 15K 36GB disks using software RAID0 for Support fileset
2 SCSI 15K 36GB disks using software RAID0 for Ecommerce fileset
10 SCSI 15K 36GB disks using software RAID0 for Banking fileset
2 x External IO Drawer 7311-D20 used for Banking, Support, Ecommerce and web server log disks
Banking and Web Server log disks installed in first IO drawer
Ecommerce and Support disks installed in second IO drawer
All disk drives use stripesize of 64KB
Use 1 integrated Gigabit adapter, 4 Gigabit adapters in CEC (Central Electronics Complex), 1 Gigabit adapter in first IO drawer
1 x Dual Port I/O Hub RIO-2/HSL-2 Copper adapter to attach 2 I/O drawers
3 x PCI-X Dual channel Ultra 320 SCSI Controller (1 in CEC, 1 per I/O drawer)
2 x Cisco 3750-T24 switch
4 clients per net

Operating System Notes

ulimit -n 1000000, sets number of open files, default 1024
Each NIC's TX queue length set to 30000 via ifconfig, default 100
Each NIC's ITR set to 1800 via insmod InterruptThrottleRate=1800, default=dynamic
Each NIC's RxDescriptors set to 2048 via insmod RxDescriptors=2048, default=256
Each NIC's TxDescriptors set to 2048 via insmod TxDescriptors=2048, default=256
6 NIC irqs bound to first 6 logical CPUs
Each NIC's TSO set to off via ethtool, default=on
net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0
net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1
net.ipv4.tcp_max_tw_buckets = 3000000, sets TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 10000000, maximum receive socket buffer size, default 131071
net.core.rmem_default = 10000000, default receive socket buffer size, default 135168
net.core.wmem_max = 10000000, maximum send socket buffer size, default 131071
net.core.wmem_default = 10000000, default send socket buffer size, default 135168
net.core.optmem_max = 10000000, default 20480
net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 392192 392704 393216
net.core.somaxconn=40960, size of the listen queue for accepting new TCP connections, default 128
net.core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, defaul 300
log & Banking, Ecommerce , Support file systems mounted with 'noatime,nodiratime,nobh,noacl', no inode access time updating, no attach buffer_head to file pagecache, no control list
Support DOWNLOAD_SUBDIRS=100
DCM: Acronym for Dual-Chip Module (one dual-core processor chip + one L3-cache chip)
SMT: Acronym for Simultaneous Multi-Threading. A processor technology that allows the simultaneous execution of multiple thread contexts within a single processor. (Enabled by default)

HTTP Software Notes

ZEUSHOME/web/global.cfg
1 ZWS instance, 6 children
tuning!bind_any no, have server sockets bind to IPADDR_ANY, default yes
tuning!cache_files 320001, Size of the web server file cache (number of files), default 8011
tuning!cache_large_file 104857600, max size of a large file (bytes), default 1048577
tuning!cache_small_file 10240, max size of a small file (bytes), default 4096
tuning!cache_stat_expire 180000, Time for which the response of a stat() call is cached (seconds), default 17
tuning!cache_flush_interval 180000, Time after which unaccessed files are flushed from the cache (seconds), default 120
tuning!cache_max_bytes 0, Maximum size to reserve for cached files (bytes) (0 = no limit), default 33554432
tuning!num_children 6, Number of child zeus.web processes, default 1 per CPU
tuning!keepalive yes, enable keepalive connections, default yes
tuning!ssl_keepalive yes, Whether to keepalive SSL connections, default no
tuning!ssl_diskcache no, use 2nd level on-disk cache for storing SSL session information, default yes
tuning!max_connections 320001, The maximum number of connections to process simultaneously, defaul half number of file-descriptors
tuning!ssl_sessioncache_size 5003, Size of ssl session cache, default 199
tuning!keepalive_timeout 1200, Time after which an inactive keepalive connection will be closed (seconds), default 15
tuning!keepalive_max -1, Maximum permitted number of keepalive connections (-1 means no limit), default 256
tuning!sendfile_maxsize 104857600, Size in bytes of the biggest file to be sent with sendfile, default 2,147,483,647
tuning!sendfile_minsize 10240, Size in bytes of the smallest file to be sent with sendfile, default 32768
tuning!sendfile_reservefd 65536, Number of file descriptors to reserve for sendfile() fd cache, default 10% of all fd if not set
tuning!listen_queue_size 10240, Size of the TCP listen queue, default 256
tuning!cbuff_size 1048576, Cbuff size, default 8192
tuning!so_rbuff_size 32768, Size of the server socket buffer (so_rbuff_size) (bytes), default unset
tuning!softservers no, enable 'software' Virtual Servers, default yes
tuning!unique_bind yes, Force each child processes to bind to a unique IP address, default no
tuning!cache_cooling_time 0, any file modified in the last 'n' seconds is not cached, default 120
tuning!modules!cgi!minuid 0, min uid with CGIs can run, default 0
tuning!modules!cgi!mingid 0, min gid with CGIs can run, default 0
tuning!modules!stats!enabled no, enable the stats module, default no
tuning!modules!nsapi!enabled no, enable the nsapi module, default no
tuning!clientfirst_optimise yes, connection not accepted till data is ready, default no
tuning!maxaccept 40960, max number of accept() calls per server socket, default 32
tuning!ssl_cbuff_size 32840, size of SSL circular buffer, default 16404
Under runningsites:
modules!gateway!enabled yes, enable gateway module
modules!gateway!path!~/.*.jsp localhost:8080, forward JSP requests to Tomcat backend port 8080
modules!gateway!rewritecookie yes, rewrite cookies from origin server
modules!gateway!rewritelocation yes, rewrite 'Location' headers from Tomcat
modules!gateway!securecookie no, don't force secure flag

HTTP Script Notes

SPEC-provided JSP scripts used without modification
export JAVA_OPT=-Xms2g -Xmx2g -Xcompactexplicitgc -Xrs, set heap size to 2GB and optimize garbage collection
1 Tomcat instances used to deploy JSP scripts
server.xml tuning:
- maxThreads=15000, max number of sessions, default 150
- minSpareThreads=250, number of threads created when connector starts, default 25
- maxSpareThreads=750, max number of unused threads allowed, default 75
- acceptCount=10000, max queue length for connection requests, default 100
- connectTimeout=0, no connection timeout, default 20000
- maxKeepAliveRequests=-1, max number of requests for keepalive (-1 unlimited), default 100

Client Notes

ulimit -n 1000000
java -Xcompactexplicitgc -Xrs -Xms512m -Xmx512m -Xss128k specwebclient

BESIM Notes

System Notes:
ulimit -n 1000000
net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0
net.ipv4.tcp_timestamps = 0, turns TCP timestamp support off, default 1
net.ipv4.tcp_max_tw_buckets = 3000000, sets TCP time-wait buckets pool size, default 180000
net.core.rmem_max = 10000000, maximum receive socket buffer size, default 65535
net.core.rmem_default = 10000000, default receive socket buffer size, default 65535
net.core.wmem_max = 10000000, maximum send socket buffer size, default 65535
net.core.wmem_default = 10000000, default send socket buffer size, default 65535
net.core.optmem_max = 10000000, default 10240
net.ipv4.tcp_rmem = 30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760
net.ipv4.tcp_wmem = 30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072
net.ipv4.tcp_mem = 30000000 30000000 30000000, maximum TCP buffer space, default 31744 32256 32768
net.core.somaxconn=20480, size of the listen queue for accepting new TCP connections, default 128
net.core.netdev_max_backlog=300000, number of unprocessed input packets before kernel starts dropping them, defaul 300
HTTP software Notes:
Zeus web server global.conf:
tuning!bind_any no, have server sockets bind to IPADDR_ANY, default yes
tuning!cache_files 320001, Size of the web server file cache (number of files), default 8011
tuning!cache_large_file 1048576, max size of a large file (bytes), default 1048577
tuning!cache_small_file 10240, max size of a small file (bytes), default 4096
tuning!cache_stat_expire 180000, Time for which the response of a stat() call is cached (seconds), default 17
tuning!cache_flush_interval 180000, Time after which unaccessed files are flushed from the cache (seconds), default 120
tuning!cache_max_bytes 0, Maximum size to reserve for cached files (bytes) (0 = no limit), default 33554432
tuning!num_children 1, Number of child zeus.web processes, default 1 per CPU
tuning!keepalive yes, enable keepalive connections, default yes
tuning!ssl_keepalive yes, Whether to keepalive SSL connections, default no
tuning!ssl_diskcache no, use 2nd level on-disk cache for storing SSL session information, default yes
tuning!max_connections 5003, The maximum number of connections to process simultaneously, defaul half number of file-descriptors
tuning!ssl_sessioncache_size 5003, Size of ssl session cache, default 199
tuning!keepalive_timeout 1200, Time after which an inactive keepalive connection will be closed (seconds), default 15
tuning!keepalive_max -1, Maximum permitted number of keepalive connections (-1 means no limit), default 256
tuning!listen_queue_size 10240, Size of the TCP listen queue, default 256
tuning!cbuff_size 1048576, Cbuff size, default 8192
tuning!so_rbuff_size 32768, Size of the server socket buffer (so_rbuff_size) (bytes), default unset
tuning!softservers no, enable 'software' Virtual Servers, default yes
tuning!unique_bind yes, Force each child processes to bind to a unique IP address, default no
tuning!cache_cooling_time 0, any file modified in the last 'n' seconds is not cached, default 120
tuning!modules!cgi!minuid 0, min uid with CGIs can run, default 0
tuning!modules!cgi!mingid 0, min gid with CGIs can run, default 0
tuning!modules!stats!enabled no, enable the stats module, default no
tuning!modules!nsapi!enabled no, enable the nsapi module, default no
tuning!clientfirst_optimise yes, connection not accepted till data is ready, default no
tuning!maxaccept 256, max number of accept() calls per server socket, default 32
tuning!ssl_cbuff_size 32840, size of SSL circular buffer, default 16404

Other Notes

Errors for Support Workload

Quality of Service Errors

No QOS Errors Found

Validation Errors

No Validation Errors Found

For questions about this result, please contact the submitter: IBM

First published at SPEC.org on 25-Oct-2005