Recent Posts

11

SPECvirt_sc2013 / Re: Seeking Insights from the SPEC Community: Enhancing Performance Benchmarks

« Last post by Asibliver on July 20, 2023, 11:47:23 PM »

SPEC benchmarks are widely used to evaluate the performance of computer systems across various industries. SPEC benchmarks provide standardized and widely accepted metrics to assess various aspects of system performance, such as CPU, memory, disk, and graphics performance.

12

SPECvirt_sc2013 / Re: Seeking Insights from the SPEC Community: Enhancing Performance Benchmarks

« Last post by jnbut on July 20, 2023, 09:32:56 AM »

SPEC benchmarks, which are created by the Standard Performance Evaluation Corporation (SPEC), are extensively utilized in the industry for evaluating the performance of computer systems. These benchmarks offer standardized and widely accepted metrics to gauge different aspects of system performance, including CPU, memory, disk, and graphics capabilities. Their widespread adoption makes them an invaluable tool for accurately assessing the efficiency of computer systems.

13

SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)

« Last post by pgalizia on July 11, 2023, 11:41:10 AM »

Hello Takahashi-san,

You will need to run the Storage test with the disk write cache disabled (as per the SERT Run Rules section 2.4.5).  So that's correct.

As far as providing a score, we don't provide feedback on whether a score is in a normal range or not, since there are many variables involved, and any one of them can move the score one way or the other.  However, many vendors do publish their SERT scores, so you can look for other systems that are similarly configured to yours, and see if their scores appear similar.

14

SERT / Re: SERT2.0.6 Unable to establish status connection with director on port 8897

« Last post by Joseph on July 11, 2023, 03:15:30 AM »

Hi pgalizia

After checking log file:

"SEVERE: Exception while running the suite
org.spec.chauffeur.common.ChauffeurIOException: Two or more hosts had the same id 'user-02'.  Ensure that each host has a unique hostname, or specifies a unique host id on the command-line"

So far, the EUT can process test suit successfully, since I change the ID name for each device.

Thank you.

15

SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)

« Last post by Takumi Takahashi on July 10, 2023, 10:43:25 PM »

Thank you for your reply.

I checked and found that the disk write cache was disabled.

Please let me know if there are any other items I should check.

Also, is this storage score within the normal range? We would appreciate it if you could share any data that would be helpful.

16

SERT / Re: SERT2.0.6 Unable to establish status connection with director on port 8897

« Last post by pgalizia on July 07, 2023, 02:12:19 PM »

Hello Joseph,

Sorry for the problem.  Can you try to run with logging enabled, and forward the logfile?  See Section 3.1.3 in the SERT User Guide on where the logfile is located, and attach those files for analysis.

17

SERT / Re: SERT2.0.6 Unable to establish status connection with director on port 8897

« Last post by Joseph on July 06, 2023, 10:26:26 PM »

Hi pgalizia

Thank you for your reply
I've confirmed that nodes can pin each other and the firewall is already disabled.
still not resolves the issue.

18

SERT / Re: SERT 2.0.6 Workload Efficiency score (Storage)

« Last post by pgalizia on July 06, 2023, 10:16:48 AM »

Hello Takahashi-san,

Your Storage worklet score will vary, depending on the number of drives used, the types of drives (HDD, SDD, M.2, etc), and where they're located on the bus.

Also, be sure to disable your disk write caches as per section 4.1.2 of the SERT User Guide.

19

SERT / SERT 2.0.6 Workload Efficiency score (Storage)

« Last post by Takumi Takahashi on July 06, 2023, 05:07:42 AM »

In SERT 2.0.6, the storage score exceeded 300 when measured with the following OS and CPU combinations.

Is this result reasonable?

Please let me know if there is any missing information.

Windows Server 2019 / i3 -12100TE
Windows Server 2019 / Celeron G6900TE
Windows Server 2022 / Pentium Gold G7400TE

Best regards,

20

SPECvirt_sc2013 / Re: Seeking Insights from the SPEC Community: Enhancing Performance Benchmarks

« Last post by Orohui on July 06, 2023, 05:07:09 AM »

Make benchmarks and methodologies transparent, enabling users to replicate results and gain a clear understanding of the testing process. Document the benchmark setup, configuration, and measurement methodologies comprehensively. Continuously assess the relevance of benchmarks to emerging technologies, such as cloud computing, virtualization, AI/ML, and IoT. Regularly update benchmark suites to incorporate new technologies, frameworks, and hardware architectures. Foster a collaborative environment within the SPEC community to encourage feedback, suggestions, and contributions from users, researchers, and industry experts. Regularly engage in discussions, conferences, and workshops to gather insights and address evolving requirements.