somthing wrong with getVmSysTimes(),thanks.

[xxltomail]

[root@client1 SPECvirt]# cat Clientmgr1_1098.out

Messages from: client1:1098
-> 2015-03-20 16:34:42:514 Looking up SPECvirt controller: client1
-> 2015-03-20 16:34:42:617 masterID: 0, tile: 0, workload: 0
-> 2015-03-20 16:34:42:617 hostname: client1
-> Hostname of prime client: client1
-> 2015-03-20 16:34:42:641 Fri Mar 20 16:30:48 CST 2015
-> 2015-03-20 16:34:42:684 RMI server started: client1:9900
-> 2015-03-20 16:34:42:701 Total clients: 1
-> 2015-03-20 16:34:42:701 Adding host client1:1091
-> 2015-03-20 16:34:42:709 Setting up clients...
-> 2015-03-20 16:34:43:419 calling getHostVM() on jappclient...
-> 2015-03-20 16:36:58:385 Starting drivers and waiting for Steady State...
-> 2015-03-20 16:37:18:477 call to getVmSysTimes() returned Faulty response. Check jappclient's console output for more information on the cause of this error. Aborting.
-> 2015-03-20 16:37:18:477 Benchmark run failed!
-> 2015-03-20 16:37:18:480 abortTest() signal sent...
-> 2015-03-20 16:37:18:480 clientsRunning = true
-> 2015-03-20 16:37:18:480 calling client.exit()...
-> 2015-03-20 16:37:18:480 terminating job processing...
-> 2015-03-20 16:37:18:482 jappserver: done!
2015-03-20 16:37:23:224 Terminating processes. Please wait...
2015-03-20 16:37:23:224 Killing master procs ...
2015-03-20 16:37:23:225 Done killing procs ...



but the ntpdate is correct.

[root@appserver ~]# ntpdate client1
23 Mar 09:38:22 ntpdate[12456]: adjust time server 101.1.1.19 offset -0.028278 sec
[root@appserver ~]#

[ChrisFloyd]

Can you please share the Clientmgr1_1088.out from the same run, as well as the output from the prime controller (primecontrol.out) ? 

Thanks,

-Chris

[xxltomail]

here is the file.
Clientmgr1_1088.out and primecontrol.out
thanks

[ChrisFloyd]

OK.  Those look fine.  I suspect the polling client is failing to communicate to either the app or db VM.  Can you please check the output of /tmp/pollme.out  on both the app and DB VM (or wherever you are sending the poll client output). 

Thanks,

-Chris Floyd

[xxltomail]

the db VM:
[root@dbserver tmp]# cat pollme.out
Creating RMI listener using RMI Registry port 8001
[ERROR] RMI server bind fails: java.rmi.UnknownHostException: Unknown host: dbserver-int; nested exception is:
        java.net.UnknownHostException: dbserver-int
java.rmi.UnknownHostException: Unknown host: dbserver-int; nested exception is:
        java.net.UnknownHostException: dbserver-int
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:616)
        at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
        at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
        at sun.rmi.registry.RegistryImpl_Stub.rebind(Unknown Source)
        at java.rmi.Naming.rebind(Naming.java:177)
        at org.spec.specpoll.pollme.main(pollme.java:195)
Caused by: java.net.UnknownHostException: dbserver-int
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
        at java.net.Socket.connect(Socket.java:579)
        at java.net.Socket.connect(Socket.java:528)
        at java.net.Socket.<init>(Socket.java:425)
        at java.net.Socket.<init>(Socket.java:208)
        at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
        at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
        ... 6 more
[root@dbserver tmp]#
[root@dbserver tmp]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
##
# Defaults used for the SPECvirt_sc2013 Example VM Setup Guide.

# External VM-to-client communications
101.1.1.11     infraserver infraserver1
101.1.1.12     webserver webserver1
101.1.1.13     mailserver mailserver1
101.1.1.14     appserver appserver1 specdelivery specemulator
101.1.1.15     dbserver dbserver1
101.1.1.16     batchserver batchserver1

101.1.1.19      client1 specdriver

# Internal VM-to-VM only communications
10.10.1.1       infraserver1-int
10.10.1.2       webserver1-int
10.10.1.4       appserver1-int
10.10.1.5       dbserver1-int specdb

[root@dbserver tmp]#

the app VM:
[root@appserver ~]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
##
# Defaults used for the SPECvirt_sc2013 Example VM Setup Guide.

# External VM-to-client communications
101.1.1.11     infraserver infraserver1
101.1.1.12     webserver webserver1
101.1.1.13     mailserver mailserver1
101.1.1.14     appserver appserver1 specdelivery specemulator
101.1.1.15     dbserver dbserver1
101.1.1.16     batchserver batchserver1

101.1.1.19      client1 specdriver

# Internal VM-to-VM only communications
10.10.1.1       infraserver1-int
10.10.1.2       webserver1-int
10.10.1.4       appserver1-int
10.10.1.5       dbserver1-int specdb

[root@appserver ~]#

need i to change the "dbserver1-int" to "dbserver-int" in hosts file?
thanks

[xxltomail]

sorry,the db VM's pollme.out is old.

the app VM's pollme.out :

[root@appserver bin]# cat /tmp/pollme.out
Creating RMI listener using RMI Registry port 8001
appserver/101.1.1.14:8001 ready...
2015-03-20 15:39:24:505 contacting host 'specdb'...
2015-03-20 15:39:24:519 Name lookup for specdb:8001 failed. Exception was:
java.rmi.ConnectException: Connection refused to host: specdb; nested exception is:
        java.net.ConnectException: Connection refused
2015-03-20 16:37:17:605 contacting host 'specdb'...
2015-03-20 16:37:17:616 Name lookup for specdb:8001 failed. Exception was:
java.rmi.ConnectException: Connection refused to host: specdb; nested exception is:
        java.net.ConnectException: Connection refused
2015-03-23 15:16:17:855 contacting host 'specdb'...
2015-03-23 15:16:17:867 Name lookup for specdb:8001 failed. Exception was:
java.rmi.ConnectException: Connection refused to host: specdb; nested exception is:
        java.net.ConnectException: Connection refused

[lroderic]

You can see the error in Clientmgr_1088.out:

-> 2015-03-20 16:37:18:424 Looking up polling host: specdelivery:8001
-> 2015-03-20 16:37:18:477 RMI call setConfig() failed on spec delivery
-2015-03-20 16:37:21:215 Terminating processes. Please wait...

Please post the line that starts the pollme.jar process in /etc/rc.local. There might be a typo in the script we provide.

[xxltomail]

thanks all of you
reason is that the db VM's specpoll procedure isn't running(port 8001).when i restart the db VM,the problem is disappear.