SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
SPECmail2001 on Sun Fire V1280 with Sun[TM] ONE Messaging server 5.2 SPECmail2001 msgs/min = 5,005
SPEC license # 6 Tested by:
Sun Microsystems, Inc.		 Test date:
Apr-2003		 Hardware Avail:
Mar-2003		 Software Avail:
Dec-2002

5,005 SPECmail2001 messages per minute is equivalent to 1,001,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: SMTP Server + POP server + LDAP server | Benchmark Manager/Load Generator | Load Generator | SMTP SINK | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)		 Required
Percentage
Compliant		 Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 100.00% 100.00% 99.89%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.06% 98.84% 38.57%
Error Rate NA <1% 0.00% 0.00% 0.00%

SMTP Server + POP server + LDAP server (1 system)
Software
SMTP, POP3 and LDAP Software: Sun[TM] ONE Messaging server 5.2 Operating System: Solaris[TM] 9 12/02 Operating Environment
Availability: Dec-2002 File System: UFS
Hardware
Vendor: Sun Microsystems, Inc. CPU: UltraSPARC III Cu
Model Name: V1280 CPU MHz: 900
Availability: Mar-2003 CPUs Enabled: 12 cores, 12 chips, 1 core/chip
Disk Subsystem: 1x36GB SCSI, 14x324GB Sun[TM] StorEdge T3 FC-AL, 1x396GB A5200 StorEdge FC-AL Primary Cache: 32KBI+64KBD on chip
Memory (MB): 24576 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun[TM] Gigaswift Ethernet controller, 1 Gb/s Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
13 T3 Sun StorEdge of 9 disks each, RAID0, blocksize 16K, 1GB battery backed up
writebehind cache for Mail Store. Each Sun PCI Dual FC-AL Network Adapter connects
to 2 SUN FCAL 7 port hubs. Three Sun StorEdge T3 connects to one hub and four T3s
connect to the other hub for a total of seven T3s per Sun PCI Dual FC-AL Network Adapter.
1 T3 Sun StorEdge of 9 disks each, RAID0, blocksize 16K, 1GB battery backed up
writebehind cache for Messaging server.
1 Sun A5200 StorEdge with software RAID0, blocksize 16K for LDAP
Operating System Tuning Information:
  set maxusers=2048: Number of concurrent users that will be on the system and
  determines how much physical memory will be allocated to the kernel.
  set maxphys=8388608: The largest single I/O transfer that may be issued to a raw device.
  set rlim_fd_max=65536: Hard limit on the open file descriptors for a single process
  set autoup=600: Controls the frequency in seconds of entire physical memory to
  be scanned for dirty pages
  set tune_t_fsflushr=1: Reduces fsflush daemon overhead
  set ufs:ufs_HW=1572864: Limit the amount of I/O that may be outstanding to a
  single file on a system-wide basis
  set ufs:ufs_LW=1048576: When ufs_HW bytes are outstanding, I/O requests will
  sleep until less than ufs_LW bytes are outstanding
  set sq_max_size=512: The depth of the syncq (number of messages) before a
  destination streams queue generates a QFULL
  set segmap_percent=64: Amount of memory used to hold file system pages
  set shmsys:shminfo_shmmax=0xffffffff: Maximum size in bytes of a shared memory segment
  set semsys:seminfo_semmns=2200: Maximum number of semaphores in the system
  set semsys:seminfo_semmnu=2200: Systemwide maximum number of semaphore undo structures
  set semsys:seminfo_semmsl=340: Maximum number of semaphores per semaphore set
  set semsys:seminfo_semmni=320: Establishes the maximum number of systemwide semaphore sets
  set msgsys:msginfo_msgmax=16384: Maximum size a message can be, in bytes
  set msgsys:msginfo_msgmnb=16384: Maximum number of bytes on a message queue
  set msgsys:msginfo_msgmni=2200: Number of message queue identifiers
  set msgsys:msginfo_msgtql=2500: Maximum number of message headers
  set msgsys:msginfo_msgseg=32767: The number of units of space that can be allocated from
  the memory map segment
  set msgsys:msginfo_msgssz=128: Maximum message segment size
  set msgsys:msginfo_msgmap=200: Number of entries in the message map
  set tcp:tcp_conn_hash_size=262144
  /usr/sbin/ndd -set /dev/tcp tcp_recv_hiwat 65536
  /usr/sbin/ndd -set /dev/tcp tcp_xmit_hiwat 65536
  /usr/sbin/ndd -set /dev/tcp tcp_conn_req_max_q 4096
  /usr/sbin/ndd -set /dev/tcp tcp_conn_req_max_q0 8192
  /usr/sbin/ndd -set /dev/tcp tcp_smallest_anon_port 8192
  /usr/sbin/ndd -set /dev/ip ip_ignore_redirect 1
  /usr/sbin/ndd -set /dev/tcp tcp_keepalive_interval 30000
  /usr/sbin/ndd -set /dev/tcp tcp_naglim_def 1
  /usr/sbin/ndd -set /dev/tcp tcp_mss_min 108
  /usr/sbin/ndd -set /dev/ip ip_respond_to_echo_broadcast 0
  /usr/sbin/ndd -set /dev/ip ip_forward_directed_broadcasts 0
  /usr/sbin/ndd -set /dev/ip ip_strict_dst_multihoming 1
  /usr/sbin/ndd -set /dev/ip ip_forwarding 0
  /usr/sbin/ndd -set /dev/ip ip_forward_src_routed 0
  /usr/sbin/ndd -set /dev/ip ip_respond_to_timestamp 0
  /usr/sbin/ndd -set /dev/ip ip_respond_to_timestamp_broadcast 0
  /usr/sbin/ndd -set /dev/tcp tcp_time_wait_interval 60000
MSL is 30 Seconds, TIME_WAIT is 60 Seconds, MTU is 1500 bytes
SMTP Tuning:
  MIN_PROCS=240
  MAX_PROCS=240
  MIN_CONNS=20
  MAX_CONNS=25
  max_handoffs=100
STORE Tuning:
  store.dbcachesize=640000000
  store.dbtmpdir=/tmp/mboxlist
POP Tuning:
  service.pop.numprocesses=7
LDAP Tuning:
  nsslapd-dbcachesize=3600000000
Job Controller Tuning:
  IMS-POOL job-limit=12
  MAX_MESSAGES=1000000
Misc. Tunings:
  local.ugldapbinddn='cn=Directory Manager'
  service.authcacahesize=100000
  MAX_INTERNAL_BLOCKS=10000
  ims-ms maxjobs=12

Benchmark Manager/Load Generator (1 system)
Software
JVM: Sun[TM] Java(TM) 2 Runtime Environment, Standard Edition Version 1.4.0 (no JIT) Operating System: Solaris[TM] 9 12/02 Operating Environment
Availability: Dec-2002 File System: UFS
Hardware
Vendor: Sun Microsystems, Inc. CPU: UltraSPARC III Cu
Model Name: V880 CPU MHz: 900
Availability: Jun-2002 CPUs Enabled: 8 cores, 8 chips, 1 core/chip
Disk Subsystem: 1x18GB Primary Cache: 32KBI+64KBD on chip
Memory (MB): 16384 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun Gigabit Ethernet controller 1 Gb/s Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
MSL is 30 Seconds, TIME_WAIT is 60 Seconds, MTU is 1500 bytes
JVM command line
 -mx1024m -ms256m

Load Generator (1 system)
Software
JVM: Sun[TM] Java(TM) 2 Runtime Environment, Standard Edition Version 1.4.0 (no JIT) Operating System: Solaris[TM] 9 12/02 Operating ENvironment
Availability: Dec-2002 File System: UFS
Hardware
Vendor: Sun Microsystems, Inc. CPU: UltraSPARC III Cu
Model Name: V880 CPU MHz: 900
Availability: Jun-2002 CPUs Enabled: 8 cores, 8 chips, 1 core/chip
Disk Subsystem: 1x36GB Primary Cache: 32KBI+64KBD on chip
Memory (MB): 32768 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun Gigabit Ethernet controller 1 Gb/s Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information 
MSL is 30 Seconds, TIME_WAIT is 60 Seconds, MTU is 1500 bytes
JVM command line
 -mx1024m -ms256m

SMTP SINK (2 systems)
Software
JVM: Sun[TM] Java(TM) 2 Runtime Environment, Standard Edition Version 1.4.0 (no JIT) Operating System: Solaris[TM] 9 12/02 Operating Environment
Availability: Dec-2002 File System: UFS
Hardware
Vendor: Sun Microsystems, Inc. CPU: UltraSPARC III
Model Name: Sun Blade 1000 Model 1750 CPU MHz: 750
Availability: Sep-2000 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 1x36GB Primary Cache: 32KBI+64KBD on chip
Memory (MB): 2048 Secondary Cache: 8MB(I+D) off chip
Network: 1 Sun Gigabit Ethernet controller 1 Gb/s Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information 
MSL is 30 Seconds, TIME_WAIT is 60 Seconds, MTU is 1500 bytes
JVM command line
 -mx1024m -ms256m


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 800,800 4,004
Actual 801,400 4,007
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 456,193 456,193 100.00%
SMTP Hello 456,193 456,193 100.00%
SMTP Mail From 456,192 456,192 100.00%
SMTP Rcpt To 914,886 914,886 100.00%
SMTP Data 456,193 456,193 100.00%
SMTP Quit 451,764 451,764 100.00%
POP Connect 481,421 481,421 100.00%
POP User ID 481,417 481,417 100.00%
POP Password 481,414 481,414 100.00%
POP Status 481,415 481,415 100.00%
POP Retrieve 481,823 481,823 100.00%
POP Delete 480,533 480,533 100.00%
POP Quit 480,142 480,142 100.00%
Delivery Time 4,471 4,429 99.06%
SMTP Data Response Time 456,193 451,766 99.03%
POP Retrieve Response Time 481,823 481,152 99.86%
Remote Message Delivery 434,343 429,916 98.98%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 4,427
SMTP Session 451,764
SMTP To Local 480,538
SMTP To Remote 434,343
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 1,291
POP Session 480,142
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 2 740 13.77
SMTP Hello 1 749 25.93
SMTP Mail From 0 700 13.38
SMTP Rcpt To 0 738 17.71
SMTP Data 0 1,940 42.55
SMTP Quit 0 680 13.20
POP Connect 1 3,389 22.89
POP User ID 0 737 45.93
POP Password 1 2,780 41.66
POP Status 0 721 24.39
POP Retrieve 0 2,880 35.25
POP Delete 0 691 24.42
POP Quit 0 2,407 32.15
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.26
POP Retrieve (KB down) 1 2,675 24.40


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 1,001,000 5,005
Actual 1,001,200 5,006
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 569,927 569,927 100.00%
SMTP Hello 569,926 569,926 100.00%
SMTP Mail From 569,928 569,928 100.00%
SMTP Rcpt To 1,134,542 1,134,542 100.00%
SMTP Data 569,936 569,936 100.00%
SMTP Quit 564,283 564,283 100.00%
POP Connect 601,523 601,523 100.00%
POP User ID 601,527 601,527 100.00%
POP Password 601,529 601,529 100.00%
POP Status 601,536 601,536 100.00%
POP Retrieve 601,836 601,836 100.00%
POP Delete 600,218 600,218 100.00%
POP Quit 599,980 599,980 100.00%
Delivery Time 5,674 5,608 98.84%
SMTP Data Response Time 569,936 564,283 99.01%
POP Retrieve Response Time 601,836 600,995 99.86%
Remote Message Delivery 536,480 532,147 99.19%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 5,653
SMTP Session 564,283
SMTP To Local 598,059
SMTP To Remote 536,480
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 1,614
POP Session 599,980
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 2 611 15.35
SMTP Hello 0 359 27.75
SMTP Mail From 0 395 13.48
SMTP Rcpt To 0 429 19.62
SMTP Data 0 3,022 49.53
SMTP Quit 0 442 13.55
POP Connect 1 486 23.46
POP User ID 0 680 46.79
POP Password 1 2,810 47.71
POP Status 0 500 24.63
POP Retrieve 0 2,870 36.82
POP Delete 0 503 24.65
POP Quit 0 3,018 33.91
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.52
POP Retrieve (KB down) 1 2,675 24.65


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 1,201,200 6,006
Actual 1,201,000 6,005
Function Attempts # Pass
QoS		 % Pass
QoS
SMTP Connect 684,769 684,769 100.00%
SMTP Hello 684,763 684,763 100.00%
SMTP Mail From 684,759 684,759 100.00%
SMTP Rcpt To 1,369,834 1,369,834 100.00%
SMTP Data 684,674 683,930 99.89%
SMTP Quit 677,867 677,867 100.00%
POP Connect 720,479 720,479 100.00%
POP User ID 720,484 720,484 100.00%
POP Password 720,498 715,708 99.34%
POP Status 720,487 720,487 100.00%
POP Retrieve 710,483 710,483 100.00%
POP Delete 708,629 708,629 100.00%
POP Quit 718,738 718,734 100.00%
Delivery Time 6,946 2,679 38.57%
SMTP Data Response Time 684,674 677,850 99.00%
POP Retrieve Response Time 710,483 709,508 99.86%
Remote Message Delivery 649,911 414,119 63.72%

Counter
Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 6,819
SMTP Session 677,867
SMTP To Local 719,928
SMTP To Remote 649,911
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 1,850
POP Session 718,738
Delivery Time Connect Error 0
Function Minimum Time
(millisec)		 Maximum Time
(millisec)		 Average Time
(millisec)
SMTP Connect 2 3,409 273.14
SMTP Hello 1 3,188 288.77
SMTP Mail From 0 909 16.26
SMTP Rcpt To 0 2,001 120.67
SMTP Data 0 14,962 577.97
SMTP Quit 0 882 16.91
POP Connect 1 1,334 60.31
POP User ID 0 1,565 102.96
POP Password 1 28,965 614.51
POP Status 0 1,360 67.95
POP Retrieve 1 2,242 52.89
POP Delete 0 1,331 58.27
POP Quit 0 5,250 87.87
Function Minimum Size
(KB)		 Maximum Size
(KB)		 Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.43
POP Retrieve (KB down) 1 2,675 24.52

General Notes / Tuning Information 
Network Connectivity:
  1 Sun Gigabit Ethernet conection from the Mail server to 1 Cisco 49126 Gigabit Switch
  Each client and the mail sinks has 1 Sun Gigabit Ethernet connection to the same Cisco 49126 Gigabit Switch

For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 07-May-2003

Benchmark run on Mon Apr 14 09:26:22 EDT 2003 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:24:57 EDT 2005 by SPECmail2001 v1.05 HTML Formatter