Recent Posts

Pages: 1 2 [3] 4 5 ... 10
21
SERT / Re: SERT 2.0.6,2.0.7
« Last post by Mr.Brown on September 13, 2023, 05:14:33 AM »
Hi pgalizia,

my first issue is resolved, seems like pending Windows Updates with integrated Driver Updates were the Problem for that. Now the Test is starting and running till the end.

But i have a new Problem, i have some error messages in my results, see the attached screenshot ( new issue ), furthermore i created the log files for that new issue.

Kind Regards
22
SERT / Re: SERT 2.0.6,2.0.7
« Last post by pgalizia on September 12, 2023, 08:34:19 AM »
Hello Mr.Brown,

Could you generate some log files using the collector scripts and attach those, so we can get a better look at what's going on with that setup?

See https://spec.org/sert2/SERT-userguide.pdf, Section 7.1.  That explains how to setup the log file collection, start the SERT run, and then find the resulting log files afterward.  That should give us a better idea of what the problem might be.

Thanks!
23
SERT / SERT 2.0.6,2.0.7
« Last post by Mr.Brown on September 12, 2023, 02:46:16 AM »
Hi,

currently i have some Problems with the SERT ( 2.0.6, 2.0.7 ) after quite some time I wanted to Test some more Systems.

First I had some Problems, with the Connection to the Host Disk Drives which I managed to fix, but now there is another Problem occurred.

When I start the Test a message with “attempting to start test suit” appears , see screenshot1.

After about 3-4 minutes the Test finishes, which is quite strange, see screenshot2.

When I look into the Results, I see that the workloads are configured but no results has been recorded for them, see screenshot3.

Hope you can help me with this Problem.

Kind regards
Mr.Brown
24
SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)
« Last post by Takumi Takahashi on August 23, 2023, 09:33:15 PM »
Sorry for the late reply. I will confirm the above 6 points.

Best regards,
25
SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)
« Last post by pgalizia on August 10, 2023, 08:49:27 AM »
No problem!

I know from other benchmarks that it doesn't take many changes to SSD configurations to cause a change in performance.  Some things you can check:
  • Did just the drive capacity change?
  • If this is a different drive, how do the hardware specifications compare to the original drive?  Different PCIe generations can and will perform differently, for example, or there could be a difference in firmware, even with the same manufacturer.
  • Was the original drive well-conditioned, and the new drive fairly unused?  There's good literature online about conditioning SSD drives so they give consistent results when benchmarking (as opposed to a brand-new drive that can give wildly-different results until conditioning is achieved).
  • Was the new drive placed in the exact same bay -- for example -- as the original?  Some systems do have different performance numbers based on what PCIe slot/bay is used for the drive.
  • Did the number of drives change?  Adding or removing the number of drives and their types will cause score changes.
  • And of course, were write caches disabled on the new drive?
26
SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)
« Last post by Takumi Takahashi on August 09, 2023, 08:17:22 PM »
Excuse me for continuing.

I changed the SSD capacity from 480GB to 240GB and the storage score changed significantly from about 60 to 300.

Other configurations were not changed. Is it possible to fluctuate so greatly?
27
SPECvirt_sc2013 / Re: Seeking Insights from the SPEC Community: Enhancing Performance Benchmarks
« Last post by Asibliver on July 20, 2023, 11:47:23 PM »
SPEC benchmarks are widely used to evaluate the performance of computer systems across various industries. SPEC benchmarks provide standardized and widely accepted metrics to assess various aspects of system performance, such as CPU, memory, disk, and graphics performance.
28
SPECvirt_sc2013 / Re: Seeking Insights from the SPEC Community: Enhancing Performance Benchmarks
« Last post by jnbut on July 20, 2023, 09:32:56 AM »
SPEC benchmarks, which are created by the Standard Performance Evaluation Corporation (SPEC), are extensively utilized in the industry for evaluating the performance of computer systems. These benchmarks offer standardized and widely accepted metrics to gauge different aspects of system performance, including CPU, memory, disk, and graphics capabilities. Their widespread adoption makes them an invaluable tool for accurately assessing the efficiency of computer systems.






29
SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)
« Last post by pgalizia on July 11, 2023, 11:41:10 AM »
Hello Takahashi-san,

You will need to run the Storage test with the disk write cache disabled (as per the SERT Run Rules section 2.4.5).  So that's correct.

As far as providing a score, we don't provide feedback on whether a score is in a normal range or not, since there are many variables involved, and any one of them can move the score one way or the other.  However, many vendors do publish their SERT scores, so you can look for other systems that are similarly configured to yours, and see if their scores appear similar.
30
SERT / Re: SERT2.0.6 Unable to establish status connection with director on port 8897
« Last post by Joseph on July 11, 2023, 03:15:30 AM »
Hi pgalizia

After checking log file:

"SEVERE: Exception while running the suite
org.spec.chauffeur.common.ChauffeurIOException: Two or more hosts had the same id 'user-02'.  Ensure that each host has a unique hostname, or specifies a unique host id on the command-line"

So far, the EUT can process test suit successfully, since I change the ID name for each device.

Thank you.
Pages: 1 2 [3] 4 5 ... 10