Author Topic: Validation Errors after SPECvirt run completed  (Read 39 times)

Miles

  • Jr. Member
  • **
  • Posts: 63
  • Karma: +0/-0
Validation Errors after SPECvirt run completed
« on: November 23, 2017, 04:57:03 AM »
Hi
A 8T4W run completed but many validation errors appeared on the report as follows:
Code: [Select]
Application Server Errors: ◾Dealer 90% Response Time FAILED
◾Dealer Avg. Response Time FAILED
◾Purchase Cycle Time Avg. FAILED
◾Manage Cycle Time Avg. FAILED
◾Browse Cycle Time Avg. FAILED
◾Vehicle Purchasing Rate FAILED
◾Largeorder Vehicle Purchase Rate FAILED
◾Regular Vehicle Purchase Rate FAILED
◾LargeOrderLine Vehicle Rate FAILED
◾PlannedLines Vehicle Rate FAILED
◾Manufacturing 90% Response Time FAILED

◾ Web Server Errors: ◾Iteration 1 failed 95% TIME GOOD QoS. Achieved: 74.8%
◾Iteration 1 failed 99% TIME TOLERABLE QoS. Achieved: 84.3%
◾Weighted percentage difference (1.65%) for product in Iteration 1 is too high. Expected: 274495 requests, Actual: 256246
◾Weighted percentage difference (1.44%) for fileCatalog in Iteration 1 is too high. Expected: 249555 requests, Actual: 233596
◾Sum of weighted percentage difference (6.42%) exceeds 1.5% for Iteration 1
◾Page home errors (1537) >= 0.01 * Requests ( 84269) = 842.69
◾Page search errors (4003) >= 0.01 * Requests ( 130547) = 1305.47
◾Page catalog errors (4406) >= 0.01 * Requests ( 121184) = 1211.84
◾Page product errors (11323) >= 0.01 * Requests ( 256246) = 2562.46
◾Page fileCatalog errors (10097) >= 0.01 * Requests ( 233596) = 2335.96
◾Page file errors (4147) >= 0.01 * Requests ( 140695) = 1406.95
◾Page download errors (1082) >= 0.01 * Requests ( 70335) = 703.35
◾Total validation errors (36595) >= 0.005 * TotalRequests ( 1036872) =5184.36

Code: [Select]
To enable SSLv3, log into the client and:

    Remove SSLv3 and MD5withRSA from the jdk.tls.disabledAlgorithms property in the $JDK_HOME/jre/lib/security/java.security file (SPEC virt_sc assumes an MD5-based SSLv3 cipher).
    Add SSL_RSA_WITH_RC4_128_MD5 to the jdk.tls.legacyAlgorithms list in the $JDK_HOME/jre/lib/security/java.security file.
    Remove !MD5 from the SSLCipherSuite list in /etc/httpd/conf.d/ssl.conf file.

My webserver is RHEL6.5, JAVA version is 1.7.0.45.
I can not find the "jdk.tls.legacyAlgorithms" security/java.security file.
Does other option have the same effect?

Thanks.
« Last Edit: November 23, 2017, 07:35:01 PM by Miles »

DavidSchmidt

  • Moderator
  • Newbie
  • *****
  • Posts: 12
  • Karma: +1/-0
Re: Validation Errors after SPECvirt run completed
« Reply #1 on: November 27, 2017, 10:58:52 AM »
Hi Miles.

It looks like you have multiple tiles going. The errors you are seeing appear to be due to resource or tuning constraints. The user forum is intended to be for help to ensure a user's harness is functioning as intended from a benchmark perspective. Optimization and tuning is unfortunately beyond the scope of the forum. I would recommend referring to published results for suggestions on how to optimize your tunings, particularly around network tuning.

Regarding your question about the SSLv3 functionality, you should check in the java.security file for the java you are using and look for a line like:

   jdk.tls.disabledAlgorithms=SSLv3, RC4, MD5withRSA, DH keySize < 768, \
    EC keySize < 224

You would need to remove "SSLv3" and "MD5withRSA" from the line. That should allow you to use the default encryption and cipher key for SPECvirt_sc2013.

Miles

  • Jr. Member
  • **
  • Posts: 63
  • Karma: +0/-0
Re: Validation Errors after SPECvirt run completed
« Reply #2 on: December 06, 2017, 04:59:08 AM »
Hi
The validation errors will not appear if I add 1 dbserver into my 4T4W
(E.g dbserver1 for appserver1 and appserver2; dbserver2 for appserver3 and
appserver4)
It is the only way to make my application workload good.
I am trying and looking for the solution to meet the method in User's Guide.

DavidSchmidt

  • Moderator
  • Newbie
  • *****
  • Posts: 12
  • Karma: +1/-0
Re: Validation Errors after SPECvirt run completed
« Reply #3 on: December 11, 2017, 12:02:56 PM »
Hi Miles,

When you try to use a single dbserver, what are the entries in your hosts file for the appserver, dbserver and specdb on your clients and appserver/dbserver? Ideally, you should be referring to "appserver" and "dbserver" for each tile, with these names pointing to the appropriate IP addresses for the app/db server on that tile. For example, if you are using a single NIC per VM, your client and VMs' hosts file should look like:

Tile 1
   192.168.1.1   infraserver infraserver1
   192.168.1.2   webserver webserver1
   192.168.1.3   mailserver webserver1
   192.168.1.4   appserver appserver1 specdelivery specemulator
   192.168.1.5   dbserver dbserver1 specdb
   192.168.1.6   batchserver batchserver1
   
   192.168.1.8   specdriver client client1
   192.168.1.8   wclient wclient1

Tile 2
   192.168.2.1   infraserver infraserver2
   192.168.2.2   webserver webserver2
   192.168.2.3   mailserver webserver2
   192.168.2.4   appserver appserver2 specdelivery specemulator
   192.168.1.5   dbserver dbserver2 specdb
   192.168.2.6   batchserver batchserver2
   
   192.168.2.8   specdriver client client2
   192.168.2.8   wclient wclient2

All of your control scripts should utilize the non-indexed names so that they are portable across tiles. Also note that for tile 2, the dbserver is referencing the IP for dbserver1, even though we call it dbserver2. The fact that your setup works if you have individual dbserver VMs for each tile implies that there is some mismatch between your hosts files and your control scripts.