SPEC Community

Product Support => SPECvirt_sc2013 => Topic started by: abond on October 17, 2014, 12:05:16 PM

Title: UPDATED: ExampleVM scripts and documentation available
Post by: abond on October 17, 2014, 12:05:16 PM
The members of SPEC's Virtualization Subcommittee are pleased to announce the availability of an ExampleVM environment for the SPECvirt_sc2013 benchmark.  This ExampleVM environment includes documentation and scripts to help configure the six virtual machines needed in a SPECvirt_sc2013 tile as well as a client virtual machine.  Even if the configuration is not exactly the same as one your are trying to set up, having a working example for comparison is a valuable tool to aid you in setting up your own environment.

Attached to this message you will find three files.  Start with the html document SPECvirt_sc2013-ExampleVM-Setup-Guide-v1.04.html and it will tell you how to use the other two files.

The versions of software referenced in the SPECvirt_sc2013-ExampleVM-Setup-Guide-v1.04.html document represent a known working combination of software and are used to build a working environment for example purposes only. SPEC does not endorse the software used in this example and the fact that these versions are used in this document does not mean they would be compliant for submitting an official SPECvirt_sc2013 result. Please consult the SPECvirt_sc2013 Run and Reporting Rules to check on software version compliance.

We hope you find this ExampleVM environment useful.

Sincerely,
The members of SPEC's Virtualization Subcommittee

NOTE:  The scripts below have been updated.  If you have previously downloaded the 1.00, 1.01, 1.02, or 1.03 versions of the ExampleVM documentation and scripts you will want to download and use the new 1.04 versions.
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: bluesky_129 on June 29, 2015, 06:59:12 AM
why this document not contain Multiple  tile? if i want to set up new tile (VM + client),what can i do?please provide extra scripts and document.Thanks!
 
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: lroderic on June 30, 2015, 01:40:57 PM
Thanks for this feedback. We're working on it now, so look for a reply here in the next day or so.

Lisa
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: bluesky_129 on July 03, 2015, 02:28:18 AM
Thanks for your reply!  the next day ? er...But three days have passed.
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: AnoopGupta on July 03, 2015, 04:33:45 AM
If you have the 1st tile configured and are able to do a complete successful run, to add a tile I recommend that you clone the VMs of the 1st tile; then update IP addresses for the new tile's VMs.

As mentioned in the section 2.3 of the User Guide at https://www.spec.org/virt_sc2013/docs/SPECvirt_UserGuide.html, you will have to run wafgen with appropriate TILEINDEX for each tile.

Update to example document and scripts may be delayed depending on support availability. The benchmark design document and user guides have all the information to setup and run the benchmark. The example document and scripts is to just help you setup the 1st tile to understand the benchmark design, setup steps, config, and result. If you have any specific issue getting the 2nd tile to work, please do not hesitate to start a new forum post.

Thank you for your patience.
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: lroderic on July 06, 2015, 02:25:28 PM
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: scharel on November 03, 2015, 04:41:36 AM
The Dovecot Download link (http://dl.atrpms.net/all/dovecot-2.2.10-1_14.el6.x86_64.rpm (http://dl.atrpms.net/all/dovecot-2.2.10-1_14.el6.x86_64.rpm)) in the Setup Guide isn't valid any more because the http://atrpms.net (http://atrpms.net) Server is down.
As a workaround I used http://web.archive.org/web/20141023233653/http://dl.atrpms.net/all/dovecot-2.2.10-1_14.el6.x86_64.rpm (http://web.archive.org/web/20141023233653/http://dl.atrpms.net/all/dovecot-2.2.10-1_14.el6.x86_64.rpm).
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: lroderic on November 03, 2015, 01:18:04 PM
Thanks for letting us know.
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: aakel on September 11, 2016, 02:10:34 AM
As far as I can tell, mod_fastcgi is no longer under active development or maintenance.  All the links for it in the documentation are broken.  Can we expect changes to the example VM setup for mod_proxy_fcgi?
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: lroderic on September 12, 2016, 12:14:37 PM
We provide mod_fastcgi with the SPECvirt kit under SPECweb2005/BeSim/fcgi-2.4.0.

We'll correct the documentation.
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: tdeneau on November 16, 2016, 02:06:49 PM
A suggestion:

For all the steps in SPECvirt_sc2013-ExampleVM-Setup-Guide-v1.02.html before 3.0 Workload VM Setup, make it clear whether they are done on the host or the guest template, or both.
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: lroderic on November 16, 2016, 02:31:05 PM
Will do. Thanks for this.
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: lroderic on December 05, 2016, 07:02:16 PM
Tom could you please clarify:

>A suggestion:
>
>For all the steps in SPECvirt_sc2013-ExampleVM-Setup-Guide-v1.02.html before 3.0 Workload VM Setup,
>make it clear whether they are done on the host or the guest template, or both.

The only things you need to do on the host are create a CentOS/RHEL VM and then clone it. Did you mean to be explicit with these two steps?

Lisa
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: tdeneau on December 15, 2016, 04:46:35 PM
Lisa --

For example I was not clear in 2.2 whether the SPECvirt_sc2013 kit itself had to be installed on the host and VMs or only on the VMs.  I guess in the beginning I did not know the client was also going to be a VM so maybe that answers my question.

-- Tom

Tom could you please clarify:

>A suggestion:
>
>For all the steps in SPECvirt_sc2013-ExampleVM-Setup-Guide-v1.02.html before 3.0 Workload VM Setup,
>make it clear whether they are done on the host or the guest template, or both.

The only things you need to do on the host are create a CentOS/RHEL VM and then clone it. Did you mean to be explicit with these two steps?

Lisa
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: tdeneau on December 15, 2016, 04:49:12 PM
A beginner's question.

When setting things up for tile 2, I might want to try one workload at a time but run that workload in both tile 1 and tile 2.  Is it legal to set up Control.config with NUM_TILES=2 and NUM_WORKLOADS=1?

-- Tom
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: ChrisFloyd on December 15, 2016, 04:51:22 PM
Tom,

Yes, that will work. 
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: tdeneau on December 16, 2016, 04:35:28 PM
When running 2 tiles using the Example VMs, I am trying to understand what to do with the clients.
Can I not drive the two tiles from a single client with that client having the full for set of IP addresses
for all the VMS in the 2 tiles?   I changed Control.config to have NUM_TILES=2
but when I start runspecvirt.sh, it is looking for a host called client2.

-- Tom


      The script documentation states that the goal of the scripts is to set up a single tile. We're glad to hear you were successful. I considered writing a script to automate this, but since you're in a hurry, we wrote up the steps instead.

      To clone a tile, you need to do the following.
      • Change the hostname (/etc/sysconfig/network) and IP addresses (/etc/sysconfig/network-scripts/ifcfg-eth0 and ifcfg-eth1).
      • Delete /etc/udev/rules.d/70-persistent-net.rules if it exists.
      • Edit the hosts file (/etc/hosts) to reflect the new hostname and IP addresses.
      • Reboot the VM. Log in and make sure you can ping other VMs.

      Extra for appserver:
      • Edit the hosts file (/etc/hosts) to make sure that the alias specdb points to the correct dbserver (up to four appservers for each dbserver). That is, the specdb alias for appserver1-4 points to dbserver1-int. The specdb alias for appserver5-8 points to dbserver2-int.

      Extra for infraserver:
      • Edit /etc/exports to change the tile number for webserver.

      Extra for webserver:
      • Edit /etc/fstab to change the tile number for infraserver. (You may want to use a VM internal network for this mount if available.)
      • Make sure that the support/downloads directory is mounted from the infraserver VM via NFS.
      • Go to the /opt/SPECweb2005/wafgen directory and edit the support wafgen files to set the TILEINDEX value for the tile you are creating:
      • Edit /opt/SPECweb2005/wafgen/unix/support_downloads_props.rc and set the parameter TILEINDEX equal to the tile number minus 1 (for example, set TILEINDEX=1 for tile 2).
      • Edit /opt/SPECweb2005/wafgen/unix/support_image_props.rc and set the parameter TILEINDEX equal to the tile number minus 1 (for example, set TILEINDEX=1 for tile 2)
      • Build the image files: ./Wafgen unix/support_image_props.rc
      • Build the support files: ./Wafgen unix/support_downloads_props.rc
Title: Re: NEW!! ExampleVM scripts and documentation now available
Post by: tdeneau on December 20, 2016, 03:33:05 PM
    "ScriptError: BeSim returned with an error number: 1"
My webserver/infraserver works fine on tile 1.
Any suggestions?

-- Tom


Extra for webserver:
  • Edit /etc/fstab to change the tile number for infraserver. (You may want to use a VM internal network for this mount if available.)
  • Make sure that the support/downloads directory is mounted from the infraserver VM via NFS.
  • Go to the /opt/SPECweb2005/wafgen directory and edit the support wafgen files to set the TILEINDEX value for the tile you are creating:
  • Edit /opt/SPECweb2005/wafgen/unix/support_downloads_props.rc and set the parameter TILEINDEX equal to the tile number minus 1 (for example, set TILEINDEX=1 for tile 2).
  • Edit /opt/SPECweb2005/wafgen/unix/support_image_props.rc and set the parameter TILEINDEX equal to the tile number minus 1 (for example, set TILEINDEX=1 for tile 2)
  • Build the image files: ./Wafgen unix/support_image_props.rc
  • Build the support files: ./Wafgen unix/support_downloads_props.rc
[/list][/list]
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: ChrisFloyd on December 20, 2016, 04:40:47 PM
Tom,

Technically, it is possible to run multiple clients on the same physical machine (i.e., OS), however, this can quickly become a complex and frustrating environment to maintain for more than a few tiles.   This is because the ports used for WORKLOAD_CLIENTS[Tile x][ Workload y], and the CLIENT_APP[Tile x][workload y] must all be unique. I suspect this may be the problem you are encountering. Most folks find using virtual clients (which can be cloned, replicated, and then edited only for /etc/hostname numerical IPs) a much simpler implementation.
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: tdeneau on December 20, 2016, 05:16:43 PM
Thanks, Chris.
Yes, since posting this, I have switched to running each client in its own VM now.

My main problem seems to be the webserver on tile 2.
Digging down, I see that there is no /tmp/besim_support.globals on infraserver2 (unlike on infraserver1).
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: tdeneau on December 20, 2016, 05:38:08 PM
Meant to also add, using tcpdump, the error message I see coming back from BeSim is ""access to globals failed"

In a related question, even on infraserver1 I only see besim_support.globals, not besim_ecommerce.globals or besim_banking.globals.

-- Tom

Thanks, Chris.
Yes, since posting this, I have switched to running each client in its own VM now.

My main problem seems to be the webserver on tile 2.
Digging down, I see that there is no /tmp/besim_support.globals on infraserver2 (unlike on infraserver1).
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: tdeneau on December 20, 2016, 06:31:00 PM
I noticed that if I copy /tmp/besim_support.globals from infraserver1 to infraserver2 and chown to apache:apache, the webserver2/support page does come up without an error.  Still have to see if the whole workload passes.

-- Tom


My main problem seems to be the webserver on tile 2.
Digging down, I see that there is no /tmp/besim_support.globals on infraserver2 (unlike on infraserver1).
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: johnnyli on May 30, 2018, 03:20:40 AM
The latest v1.03 example has the note it does not support Centos7.x and RHEL7.x as below.
NOTE: The scripts and steps described in this guide work with CentOS 6.x and RHEL 6.x. They do not work with the systemd architecture-based CentOS 7.x or RHEL 7.x.

But in the script there are many systemctl command not supported by 6.x which is enabled in Centos and RHEL from 7.X only.  As a result, i can not try the example in Centos 6.x and RHEL 6.x

What I misunderstand here?
Can I use this example for SPECvirt_sc2013-1_1p1.iso?
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: johnnyli on May 31, 2018, 12:51:32 AM
Download v1.04 and failed to uncompress  the tgz file:(


[root@mailserver Downloads]# tar xzf optdirs-sc2013-v1.04.tgz
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors
[root@mailserver Downloads]# tar xzf helper-sc2013-v1.04.tgz
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors
[root@mailserver Downloads]# ls -l
total 8
-rw-r--r-- 1 root root 1820 May 31 00:47 helper-sc2013-v1.04.tgz
-rw-r--r-- 1 root root 1663 May 31 00:47 optdirs-sc2013-v1.04.tgz
[root@mailserver Downloads]# md5sum optdirs-sc2013-v1.04.tgz
d0f5e7817c6e611f8923753ee140f2d4  optdirs-sc2013-v1.04.tgz
[root@mailserver Downloads]# md5sum helper-sc2013-v1.04.tgz
ff0a24bf0fe9d71cfcba84374d50bf59  helper-sc2013-v1.04.tgz
[root@mailserver Downloads]#
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: lroderic on May 31, 2018, 10:27:47 AM
These are good - sorry for the delay. Please retry.
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: johnnyli on June 01, 2018, 04:25:08 AM
yes, it works now. I'm playing with it. Will come back to you in new topic thread for any issue, thanks in advance
Title: Re: UPDATED: ExampleVM scripts and documentation available
Post by: Leslierichardson on November 02, 2022, 06:22:41 AM
Include a README file that contains. Allow issue tracker for others. Write an API documentation. Document your code. Apply coding conventions, such as file organization, comments, naming conventions, programming practices, etc. Include information for contributors.