Recent Posts

Pages: [1] 2 3 ... 10
1
Chauffeur-WDK / Re: Calibration or load level scaling problem
« Last post by JeremyArnold on February 08, 2018, 11:49:25 PM »
I don't think we ever got to the bottom of this issue, and I haven't observed it with worklets we've developed inside of SPEC.

If you are willing to post the same portion of your results.xml that Norbert did (showing the 100%, 90%, and 80% interval results), I'll confirm that we're seeing similar behavior in your case.  Then I'll work with you to try to identify what is causing the issue.

Please also let me know what version of the Chauffeur WDK you are using.
2
SERT / Re: SEVERE: Exception connecting with Host after 5 attempts
« Last post by Maxinut on February 08, 2018, 10:57:29 PM »
Thank you for the advice. It helped me a lot. It's very useful to me.
3
Chauffeur-WDK / Re: Calibration or load level scaling problem
« Last post by Maxinut on February 08, 2018, 10:56:25 PM »
I have the same problem. What can I do to fix it?
4
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by Miles on February 06, 2018, 02:49:05 AM »
Hi
Thanks very much !!
5
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by ChrisFloyd on February 05, 2018, 03:42:22 PM »
Miles,

See section 1.3 of the SPECvirt_sc2013 Design Guide:

particularly:

"We calculate the overall score by taking each component workload in each tile and normalizing it against its theoretical maximum for the pre-defined load level. The normalized throughput scores for each tile are averaged arithmetically to create a per-tile submetric, and the submetrics for all tiles are added to get the overall performance metric."

The three values for the theoretical maximum scores for the SPECweb, mail, and SPECjApp workloads can be seen in the "FIXED WORKLOAD PROPERTIES" section of Control.config.

specifically:

# WORKLOAD_SCORE_TMAX_VALUE is the theoretical maximum throughput rate for each
# workload. Comment these values out if you do not want to normalize scores to
# the theoretical max. Setting the value to 0 has the effect of not using this
# workload's score in calculating the result.

WORKLOAD_SCORE_TMAX_VALUE[0] = 174.30
WORKLOAD_SCORE_TMAX_VALUE[1] = 179.98
WORKLOAD_SCORE_TMAX_VALUE[2] = 143.60
WORKLOAD_SCORE_TMAX_VALUE[3] = 0

...So in your case,
App: 166.42 / 174.30. = 0.9547
Web: 179.43 / 179.98 = 0.9969
Mail: 126.95 / 143.60 = 0.8841
-----------------------------------
Average=                       .9453

0.9453 * 100 = 94.53  (score for that tile)
6
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by Miles on February 01, 2018, 12:51:15 PM »
Hi
What is the calculation formula for overall score?

For example, below is the result of tile-1

Code: [Select]
Tile #, Pct Load, Application,  Web,  Mail,  Batch,  Per-Tile Score
   1        100%     166.42    179.43 126.95 PASSED   94.53

How to calculate to get 94.53 through the score of each workload?

Thanks.
7
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by Miles on January 22, 2018, 08:36:16 PM »
Hi
Now I know I need more runs to get the most tiles

Thanks for your reply.
8
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by ChrisFloyd on January 22, 2018, 07:12:25 PM »
Determining how many Tiles your environment can support is actually somewhat of an 'advanced' topic.   ;)

However, once you are running a few tiles, you may want to check the CPU utilization of the host, and get a rough idea as to how many more Tiles you could support.  Note, many environments don't scale-up/scale-out linearly - so your maximum Tile limit may also be bounded by the performance capabilities of your disk-subsystem, SUT network, and host memory (among other things, including even the client/driver CPU or network capacity).
9
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by Miles on January 17, 2018, 09:07:17 AM »
Hi
Thanks for reply.

Now I have a rookie question.
"How do I know how many tiles I can build on my SUT?"
Is there a method to predict at the first?

I just predict through
  1.how much memory allocated on the SUT and 
  2.how much vRAM each tile needs
to determine the number of tiles to build.

Any method more precise?

Thanks.
10
SPECvirt_sc2013 / Re: Validation Errors after SPECvirt run completed
« Last post by ChrisFloyd on January 10, 2018, 09:55:49 PM »
Miles,

The QoS values for your app server are very low (e.g., under 0.95) which is indicative of a system that is either in need of further tuning or possibly at the maximum load it can support.  For example, a SPECjAppServer QoS score of .96 means that 4% of the transactions are NOT meeting the required response time criteria (i.e., the transactions are taking too long - for whatever reason).   A QoS that is failing (typically under ~95% for the three QoS constrained workloads) is an indication that you should be either *decreasing* (not increasing) the Tile count, or tuning the OS/Hypervisor and/or guest software stack to address the excessive transaction response times for the affected workload(s).

*Note, the guidance that we can provide on this forum is limited to assistance related to initial harness, guest VM, and the example guest software implementation. From your posts, it seems you have successfully run multiple Tiles on your testbed.  Scale-up performance tuning assistance is beyond the scope of our support capacity. Tuning such environments depend heavily on your particular hardware/software infrastructure and associated configuration.

I would recommend closely reviewing the details of the hardware and software tuning for published SPECvirt_sc2013 results and compare with your existing hardware and software setup.  Assuming you are using a similar hardware and software configuration, there should be enough information in the FDR and data collection .tgz to provide further tuning information.
Pages: [1] 2 3 ... 10