Getting started¶
This document assumes that a tester has read the SPEC Cloud IaaS 2016 Benchmark design and run rules documents.
Obtaining the Kit¶
The SPEC Cloud IaaS 2016 Benchmark kit is available as a zip file. Please see the order page for more details.
In the machine where benchmark harness will be set up, change to the home directory:
cd ~/
Upload the kit zip file in the home directory of this machine.
Unzip in your home directory:
unzip spec_cloud_iaas_2016*.zip
The directory contains CBTOOL, baseline and elasticity drivers and report generators, as well as HiBench and YCSB workloads. The directory also includes the Cassandra (2.1.11) and Hadoop (2.7.1) source code and packages (deb/rpm) for the versions . The tester must use the version of CBTOOL that ships with the kit for a compliant run. The tester must also use the version of Cassandra and Hadoop packages or source code that ships with the kit.
Some quick links:
Setup benchmark harness, including CBTOOL, in a virtual machine (VM)
Configure CBTOOL with an OpenStack cloud
Run the benchmark with a simulated cloud
Upload images, launch a virtual machine and an application instance
Run baseline phase for the first time
Using Git (for development)¶
Go to your home directory:
cd ~/
Get the driver and CBTOOL code from SPEC git:
git clone --recursive https://[YOUR SPEC USERNAME]@git.spec.org/repos/osgcloud
The above command will check out all code in HOMECLOUD/osgcloud.
NOTE: osgcloud is obtained from SPEC git repository. CBTOOL is added as a submodule to osgcloud and is obtained from CBTOOL github.com repository.
Check out the latest version of CBTOOL:
cd ~/osgcloud/cbtool
git pull origin master
Download workloads:
mkdir ~/workloads
cd ~/workloads
KMeans/HiBench:
git clone -b yarn https://github.com/ibmcb/HiBench.git
YCSB:
wget https://github.com/brianfrankcooper/YCSB/releases/download/0.4.0/ycsb-0.4.0.tar.gz
If you already have a version of osgcloud and CBTOOL code, and want to update them, please run the following commands:
cd ~/osgcloud
git pull
cd ~/osgcloud/cbtool
git pull origin master
Workload Images¶
The tester needs to build images from scratch for their cloud. The instructions for building images for various clouds are described in later sections.
