Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 941720 Details for
Bug 1147085
Memory volumes not deleted when removing a vm with snapshots
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine log
engine.log (text/plain), 754.59 KB, created by
Nir Soffer
on 2014-09-26 21:01:27 UTC
(
hide
)
Description:
engine log
Filename:
MIME Type:
Creator:
Nir Soffer
Created:
2014-09-26 21:01:27 UTC
Size:
754.59 KB
patch
obsolete
>2014-09-26 22:01:26,238 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp--127.0.0.1-8702-9) Invalid locale found in configuration: >2014-09-26 22:01:26,238 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp--127.0.0.1-8702-9) Invalid locale found in configuration: >2014-09-26 22:01:28,478 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp--127.0.0.1-8702-3) Invalid locale found in configuration: >2014-09-26 22:01:28,502 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp--127.0.0.1-8702-3) Invalid locale found in configuration: >2014-09-26 22:01:36,631 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp--127.0.0.1-8702-10) Running command: LoginAdminUserCommand internal: false. >2014-09-26 22:01:36,641 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-26 22:01:36,694 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp--127.0.0.1-8702-10) Running command: LoginUserCommand internal: false. >2014-09-26 22:05:51,968 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8702-3) [473085b7] Lock Acquired to object EngineLock [exclusiveLocks= key: 45462850-a02c-4eeb-8527-292e15e5cb54 value: VDS >, sharedLocks= ] >2014-09-26 22:05:52,043 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 22:05:52,044 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] Before acquiring lock in order to prevent monitoring for host voodoo6 from data-center iscsi-el7 >2014-09-26 22:05:52,045 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] Lock acquired, from now a monitoring of host will be skipped for host voodoo6 from data-center iscsi-el7 >2014-09-26 22:05:52,049 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] START, SetVdsStatusVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 6db3f770 >2014-09-26 22:05:52,059 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] FINISH, SetVdsStatusVDSCommand, log id: 6db3f770 >2014-09-26 22:05:52,092 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] Activate finished. Lock released. Monitoring can run now for host voodoo6 from data-center iscsi-el7 >2014-09-26 22:05:52,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-33) [473085b7] Correlation ID: 473085b7, Job ID: 8401434c-a98d-4bf9-9bcf-4510b691ff1f, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 was activated by admin. >2014-09-26 22:05:52,109 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-33) [473085b7] Lock freed to object EngineLock [exclusiveLocks= key: 45462850-a02c-4eeb-8527-292e15e5cb54 value: VDS >, sharedLocks= ] >2014-09-26 22:05:54,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 22:05:54,555 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-74) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:05:54,577 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-74) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:05:54,593 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-74) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:05:54,607 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-74) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-09-26 22:05:57,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 22:05:57,929 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-1) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:05:57,935 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:05:57,954 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-1) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-09-26 22:06:01,086 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 22:06:01,086 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-15) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:06:01,134 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-15) Server failed to respond, vds_id = 45462850-a02c-4eeb-8527-292e15e5cb54, vds_name = voodoo6, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.ConnectException: Connection refused >2014-09-26 22:06:01,171 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) >, Custom Event ID: -1, Message: Host voodoo6 is non responsive. >2014-09-26 22:06:01,186 INFO [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-8-thread-8) ResourceManager::vdsNotResponding entered for Host 45462850-a02c-4eeb-8527-292e15e5cb54, voodoo6.tlv.redhat.com >2014-09-26 22:06:01,212 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:06:01,237 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-8) [3a26869e] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:06:01,239 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-8) [3a26869e] Opening SSH Soft Fencing session on host voodoo6.tlv.redhat.com >2014-09-26 22:06:01,959 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-8) [3a26869e] Executing SSH Soft Fencing command on host voodoo6.tlv.redhat.com >2014-09-26 22:06:03,415 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-8) [3a26869e] Correlation ID: 3a26869e, Job ID: 76204e4a-2dbe-4a90-bd92-4516a850bcf5, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:06:04,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-61) [4fd1df5] START, GetHardwareInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]), log id: 40d06a32 >2014-09-26 22:06:05,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-61) [4fd1df5] FINISH, GetHardwareInfoVDSCommand, log id: 40d06a32 >2014-09-26 22:06:05,073 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-61) [7a2c117e] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:06:05,167 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-61) [20193c97] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:06:05,183 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-61) [7796fdbd] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:06:05,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-61) [7796fdbd] START, ConnectStorageServerVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2c3ce339 >2014-09-26 22:06:07,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-61) [7796fdbd] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 2c3ce339 >2014-09-26 22:06:07,347 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-61) [7796fdbd] Host voodoo6 storage connection was succeeded >2014-09-26 22:06:07,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-31) START, ConnectStoragePoolVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vdsId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 8a6c1de >2014-09-26 22:06:08,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-31) FINISH, ConnectStoragePoolVDSCommand, log id: 8a6c1de >2014-09-26 22:06:08,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-61) [7796fdbd] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54), log id: 552447ca >2014-09-26 22:06:08,356 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-61) [7796fdbd] FINISH, SetMOMPolicyParametersVDSCommand, log id: 552447ca >2014-09-26 22:06:08,393 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-61) [7796fdbd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo6 was set to Up. >2014-09-26 22:06:08,398 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-61) [7796fdbd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo6. >2014-09-26 22:06:08,409 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-61) [7796fdbd] Correlation ID: 20193c97, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:06:08,430 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-61) [37598b68] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:06:14,524 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-87) hostFromVds::selectedVds - voodoo6, spmStatus Free, storage pool iscsi-el7 >2014-09-26 22:06:14,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-87) starting spm on vds voodoo6, storage pool iscsi-el7, prevId -1, LVER -1 >2014-09-26 22:06:14,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-87) START, SpmStartVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: ce35ea >2014-09-26 22:06:14,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-87) spmStart polling started: taskId = 2ccc9ee2-1647-44b7-a62e-6999b28920de >2014-09-26 22:06:31,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-87) spmStart polling ended: taskId = 2ccc9ee2-1647-44b7-a62e-6999b28920de task status = finished >2014-09-26 22:06:31,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-87) spmStart polling ended, spm status: SPM >2014-09-26 22:06:31,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-87) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=2ccc9ee2-1647-44b7-a62e-6999b28920de), log id: 567cba02 >2014-09-26 22:06:31,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, HSMClearTaskVDSCommand, log id: 567cba02 >2014-09-26 22:06:31,435 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@28437534, log id: ce35ea >2014-09-26 22:06:31,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-87) Initialize Irs proxy from vds: voodoo6.tlv.redhat.com >2014-09-26 22:06:31,493 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-87) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host voodoo6 (Address: voodoo6.tlv.redhat.com). >2014-09-26 22:06:31,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false), log id: a03d48 >2014-09-26 22:06:31,670 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-87) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:06:31,673 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) -- executeIrsBrokerCommand: Attempting on storage pool b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 22:06:31,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) START, HSMGetAllTasksInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54), log id: 4132463c >2014-09-26 22:06:31,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 4132463c >2014-09-26 22:06:31,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: a03d48 >2014-09-26 22:06:31,766 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-49) Discovered no tasks on Storage Pool iscsi-el7 >2014-09-26 22:06:42,138 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-43) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:06:52,915 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-27) [a9d115a] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:06:52,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [a9d115a] START, GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2), log id: 76862bb >2014-09-26 22:06:52,941 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-39) [361df8f1] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: Storage >2014-09-26 22:06:52,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-39) [361df8f1] START, GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc), log id: 4ea07a93 >2014-09-26 22:06:52,957 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) [305586a0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Warning, Low disk space.jumbo-57 domain has 5 GB of free space >2014-09-26 22:06:53,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-39) [361df8f1] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2, volumeGroupId=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=b9c2b835-cdbd-48ea-8d69-7a33042c79b1, storageDomainName=null]], log id: 4ea07a93 >2014-09-26 22:06:53,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [a9d115a] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=rcVaHv-bvMo-SCTY-hAf2-Iase-boq2-0l71SQ, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=GJPq30-Rp3Y-xz4T-V8wJ-CVtg-7wR4-cC3K40, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null]], log id: 76862bb >2014-09-26 22:07:23,797 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp--127.0.0.1-8702-10) [560fdbdf] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 22:07:23,827 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 22:07:23,829 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] START, SetVdsStatusVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 43e8d6a6 >2014-09-26 22:07:23,830 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] VDS voodoo6 is spm and moved from up calling resetIrs. >2014-09-26 22:07:23,831 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] START, ResetIrsVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, vdsId = 45462850-a02c-4eeb-8527-292e15e5cb54, ignoreStopFailed = false), log id: 370c1cc4 >2014-09-26 22:07:23,832 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] START, SpmStopVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e), log id: 7129418c >2014-09-26 22:07:23,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] SpmStopVDSCommand::Stopping SPM on vds voodoo6, pool id b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 22:07:24,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] FINISH, SpmStopVDSCommand, log id: 7129418c >2014-09-26 22:07:24,119 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] FINISH, ResetIrsVDSCommand, log id: 370c1cc4 >2014-09-26 22:07:24,208 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] FINISH, SetVdsStatusVDSCommand, log id: 43e8d6a6 >2014-09-26 22:07:24,239 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 22:07:24,300 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:07:24,324 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-20) [560fdbdf] Correlation ID: 560fdbdf, Job ID: 75b89026-5ab4-42ba-8ff0-d48642c82425, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 was switched to Maintenance mode by admin. >2014-09-26 22:07:26,212 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-71) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6 >2014-09-26 22:07:26,314 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-26) Clearing cache of pool: b86b687a-d073-497a-ac8a-249025419a3e for problematic entities of VDS: voodoo6. >2014-09-26 22:07:26,314 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-26) Removing vds [45462850-a02c-4eeb-8527-292e15e5cb54] from the domain in maintenance cache >2014-09-26 22:07:26,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-26) Removing host(s) [45462850-a02c-4eeb-8527-292e15e5cb54] from hosts unseen domain report cache >2014-09-26 22:07:26,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-71) START, DisconnectStoragePoolVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, vds_spm_id = 2), log id: 1621a29b >2014-09-26 22:07:32,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, DisconnectStoragePoolVDSCommand, log id: 1621a29b >2014-09-26 22:07:32,018 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-71) [3a58d02c] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:07:32,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-71) [3a58d02c] START, DisconnectStorageServerVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7e32fcad >2014-09-26 22:07:33,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-71) [3a58d02c] FINISH, DisconnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 7e32fcad >2014-09-26 22:07:33,911 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-19) [642360a6] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 04511d19-f03a-469a-9e31-ab51d6e75a56 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:07:34,015 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-19) [642360a6] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:07:34,024 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-19) [8e75a14] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:07:34,139 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [8e75a14] Correlation ID: 8e75a14, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting status to Non Responsive. >2014-09-26 22:08:50,683 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8702-5) [66ecec2d] Lock Acquired to object EngineLock [exclusiveLocks= key: 45462850-a02c-4eeb-8527-292e15e5cb54 value: VDS >, sharedLocks= ] >2014-09-26 22:08:50,753 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 22:08:50,754 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] Before acquiring lock in order to prevent monitoring for host voodoo6 from data-center iscsi-el7 >2014-09-26 22:08:50,755 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] Lock acquired, from now a monitoring of host will be skipped for host voodoo6 from data-center iscsi-el7 >2014-09-26 22:08:50,772 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] START, SetVdsStatusVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 720cd030 >2014-09-26 22:08:50,786 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] FINISH, SetVdsStatusVDSCommand, log id: 720cd030 >2014-09-26 22:08:50,819 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] Activate finished. Lock released. Monitoring can run now for host voodoo6 from data-center iscsi-el7 >2014-09-26 22:08:50,827 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] Correlation ID: 66ecec2d, Job ID: 0df6bcda-5f52-4037-8092-a7cfd45574e6, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 was activated by admin. >2014-09-26 22:08:50,836 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-17) [66ecec2d] Lock freed to object EngineLock [exclusiveLocks= key: 45462850-a02c-4eeb-8527-292e15e5cb54 value: VDS >, sharedLocks= ] >2014-09-26 22:08:51,702 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [7974efa] Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:08:51,703 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-3) [7974efa] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:08:51,738 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) [7974efa] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:08:51,754 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-3) [7974efa] Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:08:54,796 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:08:54,797 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:08:54,861 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:08:54,861 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:08:54,870 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:08:57,889 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:08:57,889 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-40) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:08:57,924 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-40) Server failed to respond, vds_id = 45462850-a02c-4eeb-8527-292e15e5cb54, vds_name = voodoo6, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:08:57,984 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) >, Custom Event ID: -1, Message: Host voodoo6 is non responsive. >2014-09-26 22:08:58,000 INFO [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-8-thread-40) ResourceManager::vdsNotResponding entered for Host 45462850-a02c-4eeb-8527-292e15e5cb54, voodoo6.tlv.redhat.com >2014-09-26 22:08:58,025 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:08:58,050 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-40) [5d038fa6] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:08:58,053 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-40) [5d038fa6] Opening SSH Soft Fencing session on host voodoo6.tlv.redhat.com >2014-09-26 22:08:58,064 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-40) [5d038fa6] SSH Soft Fencing command failed on host voodoo6.tlv.redhat.com: null >Stdout: >Stderr: >Stacktrace: java.nio.channels.UnresolvedAddressException: java.nio.channels.UnresolvedAddressException > at sun.nio.ch.Net.checkAddress(Net.java:127) [rt.jar:1.7.0_65] > at sun.nio.ch.UnixAsynchronousSocketChannelImpl.implConnect(UnixAsynchronousSocketChannelImpl.java:301) [rt.jar:1.7.0_65] > at sun.nio.ch.AsynchronousSocketChannelImpl.connect(AsynchronousSocketChannelImpl.java:208) [rt.jar:1.7.0_65] > at org.apache.sshd.common.io.nio2.Nio2Connector.connect(Nio2Connector.java:47) > at org.apache.sshd.SshClient.connect(SshClient.java:334) > at org.apache.sshd.SshClient.connect(SshClient.java:320) > at org.apache.sshd.SshClient.connect(SshClient.java:310) > at org.ovirt.engine.core.uutils.ssh.SSHClient.connect(SSHClient.java:284) [uutils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:87) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:53) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1167) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1306) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1931) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1330) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:344) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:430) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:411) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:616) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:114) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:125) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:135) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:82) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$4.run(VdsEventListener.java:249) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:08:58,167 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-40) [5d038fa6] Correlation ID: 5d038fa6, Job ID: 2d6479fb-d555-4647-8cae-fc67e1a6034e, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:08:58,307 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-40) [520426f2] Lock Acquired to object EngineLock [exclusiveLocks= key: 45462850-a02c-4eeb-8527-292e15e5cb54 value: VDS_FENCE >, sharedLocks= ] >2014-09-26 22:08:58,308 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-40) [520426f2] Failed to run Fence script on vds:voodoo6. >2014-09-26 22:08:58,312 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-40) [520426f2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 became non responsive. It has no power management configured. Please check the host status, manually reboot it, and click "Confirm Host Has Been Rebooted" >2014-09-26 22:08:58,313 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-40) [520426f2] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VAR__ACTION__RESTART,VDS_FENCE_DISABLED >2014-09-26 22:08:58,313 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-40) [520426f2] Lock freed to object EngineLock [exclusiveLocks= key: 45462850-a02c-4eeb-8527-292e15e5cb54 value: VDS_FENCE >, sharedLocks= ] >2014-09-26 22:09:01,042 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:09:01,043 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 120 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:09:01,048 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:09:05,068 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GetHardwareInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]), log id: 2e231d8e >2014-09-26 22:09:05,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GetHardwareInfoVDSCommand, log id: 2e231d8e >2014-09-26 22:09:05,209 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-15) [7e5df6a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:09:05,302 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-15) [13c2a70d] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:09:05,316 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-15) [2056d5bd] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:09:05,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-15) [2056d5bd] START, ConnectStorageServerVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bc368e6 >2014-09-26 22:09:07,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-15) [2056d5bd] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 7bc368e6 >2014-09-26 22:09:07,860 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-15) [2056d5bd] Host voodoo6 storage connection was succeeded >2014-09-26 22:09:07,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, ConnectStoragePoolVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vdsId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 5f41abbe >2014-09-26 22:09:08,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, ConnectStoragePoolVDSCommand, log id: 5f41abbe >2014-09-26 22:09:08,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-15) [2056d5bd] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54), log id: 35583825 >2014-09-26 22:09:08,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-15) [2056d5bd] FINISH, SetMOMPolicyParametersVDSCommand, log id: 35583825 >2014-09-26 22:09:08,901 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [2056d5bd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo6 was set to Up. >2014-09-26 22:09:08,907 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [2056d5bd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo6. >2014-09-26 22:09:08,918 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [2056d5bd] Correlation ID: 13c2a70d, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:09:08,944 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-15) [3943bcef] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:09:14,369 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-43) hostFromVds::selectedVds - voodoo6, spmStatus Free, storage pool iscsi-el7 >2014-09-26 22:09:14,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-43) starting spm on vds voodoo6, storage pool iscsi-el7, prevId -1, LVER -1 >2014-09-26 22:09:14,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) START, SpmStartVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 43fcbbd7 >2014-09-26 22:09:14,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) spmStart polling started: taskId = 62ece48a-18b6-4abf-89b1-2a9c08fed55e >2014-09-26 22:09:31,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) spmStart polling ended: taskId = 62ece48a-18b6-4abf-89b1-2a9c08fed55e task status = finished >2014-09-26 22:09:31,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) spmStart polling ended, spm status: SPM >2014-09-26 22:09:31,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-43) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=62ece48a-18b6-4abf-89b1-2a9c08fed55e), log id: 55608dbc >2014-09-26 22:09:31,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, HSMClearTaskVDSCommand, log id: 55608dbc >2014-09-26 22:09:31,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@162197, log id: 43fcbbd7 >2014-09-26 22:09:31,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-43) Initialize Irs proxy from vds: voodoo6.tlv.redhat.com >2014-09-26 22:09:31,556 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host voodoo6 (Address: voodoo6.tlv.redhat.com). >2014-09-26 22:09:31,565 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false), log id: 3adf1a6b >2014-09-26 22:09:31,847 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-28) [a07055f] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:09:31,854 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [a07055f] START, GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2), log id: 303afddf >2014-09-26 22:09:31,864 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-25) [3e33700a] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: Storage >2014-09-26 22:09:31,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [3e33700a] START, GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc), log id: 72ab311c >2014-09-26 22:09:31,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) -- executeIrsBrokerCommand: Attempting on storage pool b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 22:09:31,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) START, HSMGetAllTasksInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54), log id: 2e7d703d >2014-09-26 22:09:33,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [3e33700a] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2, volumeGroupId=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=b9c2b835-cdbd-48ea-8d69-7a33042c79b1, storageDomainName=null]], log id: 72ab311c >2014-09-26 22:09:33,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2e7d703d >2014-09-26 22:09:33,210 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 3adf1a6b >2014-09-26 22:09:33,210 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-40) Discovered no tasks on Storage Pool iscsi-el7 >2014-09-26 22:09:33,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [a07055f] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=rcVaHv-bvMo-SCTY-hAf2-Iase-boq2-0l71SQ, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=GJPq30-Rp3Y-xz4T-V8wJ-CVtg-7wR4-cC3K40, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null]], log id: 303afddf >2014-09-26 22:09:54,949 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-4) [64b2d75a] Lock Acquired to object EngineLock [exclusiveLocks= key: vm-created-on-el7 value: VM_NAME >, sharedLocks= ] >2014-09-26 22:09:54,979 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-4) [64b2d75a] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: ab1f5d39-0f7d-42da-82d3-1c0364f8c099 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-09-26 22:09:55,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [64b2d75a] Correlation ID: 64b2d75a, Job ID: 98b65bb1-f7ae-4f4e-9e41-b49182e7a231, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 was created by admin. >2014-09-26 22:09:55,120 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-4) [64b2d75a] Lock freed to object EngineLock [exclusiveLocks= key: vm-created-on-el7 value: VM_NAME >, sharedLocks= ] >2014-09-26 22:09:57,711 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp--127.0.0.1-8702-4) [c4b12b0] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: c0818d05-2a65-4541-a0a1-ee5c25c7ec57 Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-09-26 22:09:57,796 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp--127.0.0.1-8702-4) [1aa1ddea] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VM >2014-09-26 22:09:57,853 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [1aa1ddea] Correlation ID: 1aa1ddea, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm-created-on-el7. (User: admin) >2014-09-26 22:09:57,869 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [1aa1ddea] Correlation ID: c4b12b0, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm-created-on-el7. (User: admin) >2014-09-26 22:09:59,380 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp--127.0.0.1-8702-4) [5c07f9bc] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group CREATE_VM with role type USER >2014-09-26 22:09:59,426 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [5c07f9bc] Correlation ID: 5c07f9bc, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:10:27,238 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-8) [4816c4dc] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM_DISK_BOOT >, sharedLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >] >2014-09-26 22:10:27,265 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-8) [4816c4dc] Running command: AddDiskCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 22:10:27,315 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-8) [3d7ecb8f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:10:27,332 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-8) [3d7ecb8f] Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM_DISK_BOOT >, sharedLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >] >2014-09-26 22:10:27,333 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-8) [3d7ecb8f] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 06a99422-127c-4a81-a608-6b2950da7dcc, newImageDescription = ), log id: 47b254df >2014-09-26 22:10:27,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-8) [3d7ecb8f] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:10:27,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-8) [3d7ecb8f] FINISH, CreateImageVDSCommand, return: 06a99422-127c-4a81-a608-6b2950da7dcc, log id: 47b254df >2014-09-26 22:10:27,482 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-8) [3d7ecb8f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ebb6d1bc-445a-4875-9bd1-8a0c882d0414 >2014-09-26 22:10:27,482 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-8) [3d7ecb8f] CommandMultiAsyncTasks::AttachTask: Attaching task 86dcf000-549d-4a3f-b6b6-833ed1129926 to command ebb6d1bc-445a-4875-9bd1-8a0c882d0414. >2014-09-26 22:10:27,506 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-8) [3d7ecb8f] Adding task 86dcf000-549d-4a3f-b6b6-833ed1129926 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:10:27,630 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) [3d7ecb8f] Correlation ID: 4816c4dc, Job ID: 5732da8f-83ca-4b7f-9b23-97012f621bac, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm-created-on-el7_Disk1 was initiated on VM vm-created-on-el7 by admin. >2014-09-26 22:10:27,631 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-8) [3d7ecb8f] BaseAsyncTask::startPollingTask: Starting to poll task 86dcf000-549d-4a3f-b6b6-833ed1129926. >2014-09-26 22:10:31,642 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-09-26 22:10:31,855 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-25) SPMAsyncTask::PollTask: Polling task 86dcf000-549d-4a3f-b6b6-833ed1129926 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:10:31,888 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-25) BaseAsyncTask::onTaskEndSuccess: Task 86dcf000-549d-4a3f-b6b6-833ed1129926 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:10:31,888 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-25) CommandAsyncTask::endActionIfNecessary: All tasks of command ebb6d1bc-445a-4875-9bd1-8a0c882d0414 has ended -> executing endAction >2014-09-26 22:10:31,888 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-25) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: ebb6d1bc-445a-4875-9bd1-8a0c882d0414): calling endAction . >2014-09-26 22:10:31,889 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-45) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-09-26 22:10:31,912 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-45) [4816c4dc] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-09-26 22:10:31,946 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-45) [3d7ecb8f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 22:10:31,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-45) [3d7ecb8f] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageId = 06a99422-127c-4a81-a608-6b2950da7dcc), log id: 6d007ddc >2014-09-26 22:10:32,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-45) [3d7ecb8f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f847cbe6, log id: 6d007ddc >2014-09-26 22:10:32,136 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-45) Correlation ID: 4816c4dc, Call Stack: null, Custom Event ID: -1, Message: The disk vm-created-on-el7_Disk1 was successfully added to VM vm-created-on-el7. >2014-09-26 22:10:32,136 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-45) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-09-26 22:10:32,137 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-45) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-09-26 22:10:32,144 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 86dcf000-549d-4a3f-b6b6-833ed1129926 >2014-09-26 22:10:32,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-45) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 86dcf000-549d-4a3f-b6b6-833ed1129926), log id: 3c9455fc >2014-09-26 22:10:32,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-45) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=86dcf000-549d-4a3f-b6b6-833ed1129926), log id: 2e993276 >2014-09-26 22:10:32,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 2e993276 >2014-09-26 22:10:32,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 3c9455fc >2014-09-26 22:10:32,260 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-45) BaseAsyncTask::removeTaskFromDB: Removed task 86dcf000-549d-4a3f-b6b6-833ed1129926 from DataBase >2014-09-26 22:10:32,260 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-45) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ebb6d1bc-445a-4875-9bd1-8a0c882d0414 >2014-09-26 22:11:12,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler_Worker-61) [37598b68] Command GetStatsVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: org.apache.commons.httpclient.NoHttpResponseException: The server voodoo6.tlv.redhat.com failed to respond >2014-09-26 22:11:12,639 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) [37598b68] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:12,641 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-61) [37598b68] vds::refreshVdsStats Failed getVdsStats, vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, error = VDSNetworkException: org.apache.commons.httpclient.NoHttpResponseException: The server voodoo6.tlv.redhat.com failed to respond >2014-09-26 22:11:12,642 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-61) [37598b68] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: org.apache.commons.httpclient.NoHttpResponseException: The server voodoo6.tlv.redhat.com failed to respond > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsStats(VdsUpdateRunTimeInfo.java:680) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:634) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: org.apache.commons.httpclient.NoHttpResponseException: The server voodoo6.tlv.redhat.com failed to respond > at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodBase.readResponse(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodBase.execute(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsStats(Unknown Source) > at sun.reflect.GeneratedMethodAccessor104.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:11:12,684 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) [37598b68] Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >org.apache.commons.httpclient.NoHttpResponseException: The server voodoo6.tlv.redhat.com failed to respond >2014-09-26 22:11:15,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [362ac299] Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:15,699 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-28) [362ac299] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:15,701 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) [362ac299] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:11:15,709 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-28) [362ac299] Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:18,713 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:18,713 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-75) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:18,715 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:11:18,723 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-75) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:21,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:21,728 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-79) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:21,730 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-79) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:11:21,739 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-79) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:24,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:24,745 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-25) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:24,747 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:11:24,755 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-25) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:24,944 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp--127.0.0.1-8702-8) Invalid locale found in configuration: >2014-09-26 22:11:24,944 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp--127.0.0.1-8702-8) Invalid locale found in configuration: >2014-09-26 22:11:28,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) [78b77100] START, GetHardwareInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]), log id: 16fc69ce >2014-09-26 22:11:28,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) [78b77100] FINISH, GetHardwareInfoVDSCommand, log id: 16fc69ce >2014-09-26 22:11:28,399 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-66) [54376c8f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:11:28,493 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-66) [7d442ff4] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:11:28,506 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-66) [2864eed8] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:11:28,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-66) [2864eed8] START, ConnectStorageServerVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a38cfb2 >2014-09-26 22:11:28,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-66) [2864eed8] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 4a38cfb2 >2014-09-26 22:11:28,698 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-66) [2864eed8] Host voodoo6 storage connection was succeeded >2014-09-26 22:11:28,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-26) START, ConnectStoragePoolVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vdsId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 593b941f >2014-09-26 22:11:29,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-26) FINISH, ConnectStoragePoolVDSCommand, log id: 593b941f >2014-09-26 22:11:30,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-66) [2864eed8] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54), log id: 1f7716fe >2014-09-26 22:11:30,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-66) [2864eed8] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1f7716fe >2014-09-26 22:11:30,401 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [2864eed8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo6 was set to Up. >2014-09-26 22:11:30,404 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [2864eed8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo6. >2014-09-26 22:11:30,434 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [2864eed8] Correlation ID: 7d442ff4, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:11:30,453 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-66) [6631a2c7] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:11:58,991 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-60) Command ListVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:11:58,992 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-60) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:59,026 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-60) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:11:59,026 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:413) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.fetchRunningVms(VdsUpdateRunTimeInfo.java:982) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:931) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:649) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.list(Unknown Source) > at sun.reflect.GeneratedMethodAccessor98.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:11:59,043 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-60) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:01,641 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-86) [269fc23f] Setting new tasks map. The map contains now 0 tasks >2014-09-26 22:12:01,642 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-86) [269fc23f] Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 22:12:02,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:02,049 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:12:02,051 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:12:02,060 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:05,081 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [8e75a14] Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:05,081 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-19) [8e75a14] Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:12:05,084 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) [8e75a14] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:12:05,094 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-19) [8e75a14] Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:08,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) Command GetCapabilitiesVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:08,104 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) Host voodoo6 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:12:08,108 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-31) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo6.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:12:08,126 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) Failed to refresh VDS , vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:08,142 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-91) Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 04511d19-f03a-469a-9e31-ab51d6e75a56 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:12:08,178 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-91) Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:12:08,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-91) Command SpmStatusVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:08,189 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-91) [cf3404d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:12:08,202 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) [cf3404d] Correlation ID: cf3404d, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting Data Center status to Non Responsive (On host voodoo6, Error: Network error during communication with the Host.). >2014-09-26 22:12:08,535 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-49) [285eca7e] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:12:08,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) [285eca7e] START, GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2), log id: ea8f08f >2014-09-26 22:12:08,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) [285eca7e] Command GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:08,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) [285eca7e] FINISH, GetVGInfoVDSCommand, log id: ea8f08f >2014-09-26 22:12:08,544 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-49) [285eca7e] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 22:12:08,551 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-15) [645490c5] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: Storage >2014-09-26 22:12:08,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [645490c5] START, GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc), log id: 638be46 >2014-09-26 22:12:08,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [645490c5] Command GetVGInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com >2014-09-26 22:12:08,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [645490c5] FINISH, GetVGInfoVDSCommand, log id: 638be46 >2014-09-26 22:12:08,559 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-15) [645490c5] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo6.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 22:12:10,152 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-4) [4f39e2f1] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:12:10,178 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-4) [4f39e2f1] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_IMAGE_REPOSITORY_NOT_FOUND >2014-09-26 22:12:10,178 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-4) [4f39e2f1] Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:12:11,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GetHardwareInfoVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54]), log id: 2463fb83 >2014-09-26 22:12:11,727 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GetHardwareInfoVDSCommand, log id: 2463fb83 >2014-09-26 22:12:11,790 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-21) [4a10d0c6] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:12:11,883 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-21) [339a19e7] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:12:11,898 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-21) [47e48b38] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:12:11,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-21) [47e48b38] START, ConnectStorageServerVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2cfd5883 >2014-09-26 22:12:12,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-21) [47e48b38] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 2cfd5883 >2014-09-26 22:12:12,407 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-21) [47e48b38] Host voodoo6 storage connection was succeeded >2014-09-26 22:12:12,412 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-3) START, ConnectStoragePoolVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vdsId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 4bfe4d83 >2014-09-26 22:12:12,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-3) FINISH, ConnectStoragePoolVDSCommand, log id: 4bfe4d83 >2014-09-26 22:12:13,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-21) [47e48b38] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54), log id: 347330c3 >2014-09-26 22:12:13,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-21) [47e48b38] FINISH, SetMOMPolicyParametersVDSCommand, log id: 347330c3 >2014-09-26 22:12:13,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [47e48b38] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo6 was set to Up. >2014-09-26 22:12:13,526 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [47e48b38] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo6. >2014-09-26 22:12:13,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [47e48b38] Correlation ID: 339a19e7, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:12:13,556 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-21) [16ced8a9] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:12:34,329 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-1) [6b3fdf41] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:12:34,346 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-1) [6b3fdf41] START, IsVmDuringInitiatingVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c), log id: 3d89d938 >2014-09-26 22:12:34,347 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-1) [6b3fdf41] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3d89d938 >2014-09-26 22:12:34,433 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] Running command: RunVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:12:34,480 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] START, UpdateVmDynamicDataVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@995fb2cf), log id: 3ec84ace >2014-09-26 22:12:34,491 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] FINISH, UpdateVmDynamicDataVDSCommand, log id: 3ec84ace >2014-09-26 22:12:34,496 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] START, CreateVmVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]), log id: 63d6802e >2014-09-26 22:12:34,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] START, CreateVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]), log id: 3e4e9f30 >2014-09-26 22:12:34,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=512,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=preferred},maxVCpus=16,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=52997aa3-aa16-481b-9f42-47dd3875df43}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=bb306c70-0178-4b00-9524-f08988e2d828}, {shared=false, index=0, volumeID=06a99422-127c-4a81-a608-6b2950da7dcc, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=1, domainID=04511d19-f03a-469a-9e31-ab51d6e75a56, imageID=ecca2542-c4f0-4bfc-8a34-f775ba207720, specParams={}, optional=false, device=disk, poolID=b86b687a-d073-497a-ac8a-249025419a3e, readonly=false, deviceId=ecca2542-c4f0-4bfc-8a34-f775ba207720}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:ab:e1:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=bea24164-8385-44ea-b14a-350a478f1d8b}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=0d9a4f5c-5f33-48d5-88f1-52350377c09b}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=93ecc55a-e39b-4f2f-8d9d-0c22d95bb3f2}, {specParams={}, device=virtio-serial, type=controller, deviceId=d1ac2864-ba6c-48d4-a6e0-a25872974d75}],vmName=vm-created-on-el7,cpuType=Haswell,fileTransferEnable=true >2014-09-26 22:12:34,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] FINISH, CreateVDSCommand, log id: 3e4e9f30 >2014-09-26 22:12:34,791 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 63d6802e >2014-09-26 22:12:34,791 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:12:34,807 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [6b3fdf41] Correlation ID: 6b3fdf41, Job ID: b4a092e7-507c-46ab-b59f-86ddffb0b244, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 was started by admin (Host: voodoo6). >2014-09-26 22:12:35,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-70) [51303d41] START, FullListVdsCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54], vmIds=[e25d2e73-22be-47e6-8214-2fd94d2f2e6c]), log id: 6c0f5c91 >2014-09-26 22:12:35,988 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-70) [51303d41] FINISH, FullListVdsCommand, return: [{displaySecurePort=-1, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.110, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=-1, vmType=kvm, emulatedMachine=rhel6.5.0, status=WaitForLaunch, memGuaranteedSize=512, display=qxl, pid=0, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@26fc02fe, vmName=vm-created-on-el7, fileTransferEnable=true, cpuType=Haswell}], log id: 6c0f5c91 >2014-09-26 22:12:35,990 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a memballoon Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {specParams={model=virtio}, target=1048576, device=memballoon, type=balloon, deviceId=0d9a4f5c-5f33-48d5-88f1-52350377c09b} >2014-09-26 22:12:35,991 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a scsi Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {model=virtio-scsi, index=0, specParams={}, device=scsi, type=controller, deviceId=93ecc55a-e39b-4f2f-8d9d-0c22d95bb3f2} >2014-09-26 22:12:35,991 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a virtio-serial Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {specParams={}, device=virtio-serial, type=controller, deviceId=d1ac2864-ba6c-48d4-a6e0-a25872974d75} >2014-09-26 22:12:35,992 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a qxl Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=52997aa3-aa16-481b-9f42-47dd3875df43} >2014-09-26 22:12:35,992 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a spice Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.110}, device=spice, type=graphics} >2014-09-26 22:12:35,993 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a bridge Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {nicModel=pv, specParams={outbound={}, inbound={}}, device=bridge, macAddr=00:1a:4a:ab:e1:01, linkActive=true, type=interface, deviceId=bea24164-8385-44ea-b14a-350a478f1d8b, filter=vdsm-no-mac-spoofing, network=ovirtmgmt} >2014-09-26 22:12:35,993 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a cdrom Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=bb306c70-0178-4b00-9524-f08988e2d828} >2014-09-26 22:12:35,994 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [51303d41] Received a disk Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {shared=false, volumeID=06a99422-127c-4a81-a608-6b2950da7dcc, index=0, propagateErrors=off, format=cow, type=disk, truesize=1073741824, reqsize=0, bootOrder=1, iface=virtio, volumeChain=[Ljava.lang.Object;@70f3bb17, imageID=ecca2542-c4f0-4bfc-8a34-f775ba207720, domainID=04511d19-f03a-469a-9e31-ab51d6e75a56, specParams={}, optional=false, volumeInfo={volumeID=06a99422-127c-4a81-a608-6b2950da7dcc, leasePath=/dev/04511d19-f03a-469a-9e31-ab51d6e75a56/leases, imageID=ecca2542-c4f0-4bfc-8a34-f775ba207720, domainID=04511d19-f03a-469a-9e31-ab51d6e75a56, path=/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/images/ecca2542-c4f0-4bfc-8a34-f775ba207720/06a99422-127c-4a81-a608-6b2950da7dcc, leaseOffset=113246208, volType=path}, path=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/04511d19-f03a-469a-9e31-ab51d6e75a56/images/ecca2542-c4f0-4bfc-8a34-f775ba207720/06a99422-127c-4a81-a608-6b2950da7dcc, device=disk, poolID=b86b687a-d073-497a-ac8a-249025419a3e, readonly=false, deviceId=ecca2542-c4f0-4bfc-8a34-f775ba207720, apparentsize=1073741824} >2014-09-26 22:12:39,285 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) VM vm-created-on-el7 e25d2e73-22be-47e6-8214-2fd94d2f2e6c moved from WaitForLaunch --> PoweringUp >2014-09-26 22:12:39,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-43) START, FullListVdsCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54], vmIds=[e25d2e73-22be-47e6-8214-2fd94d2f2e6c]), log id: 1ac2a484 >2014-09-26 22:12:39,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-43) FINISH, FullListVdsCommand, return: [{displaySecurePort=5900, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.110, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=-1, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=7550, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@1064c075, vmName=vm-created-on-el7, fileTransferEnable=true, cpuType=Haswell}], log id: 1ac2a484 >2014-09-26 22:12:39,466 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) Received a spice Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.110}, device=spice, tlsPort=5900, type=graphics} >2014-09-26 22:12:49,500 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The Balloon device on VM vm-created-on-el7 on host voodoo6 is inflated but the device cannot be controlled (guest agent is down). >2014-09-26 22:13:02,452 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-1) [172e23d0] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:13:02,595 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-22) Command 801a2162-4be2-4431-be17-e23b70d9e2ca persisting async task placeholder for child command 72339887-3f26-41d1-9344-753d9eea3041 >2014-09-26 22:13:02,768 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-22) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-09-26 22:13:02,793 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 22:13:02,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] START, CreateSnapshotVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 171bb930-a3b6-4d31-8e87-a75aac784b61, newImageDescription = , imageId = 06a99422-127c-4a81-a608-6b2950da7dcc, sourceImageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720), log id: 5f1c5b65 >2014-09-26 22:13:02,799 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:13:02,934 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] FINISH, CreateSnapshotVDSCommand, return: 171bb930-a3b6-4d31-8e87-a75aac784b61, log id: 5f1c5b65 >2014-09-26 22:13:02,968 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 801a2162-4be2-4431-be17-e23b70d9e2ca >2014-09-26 22:13:02,969 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] CommandMultiAsyncTasks::AttachTask: Attaching task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 to command 801a2162-4be2-4431-be17-e23b70d9e2ca. >2014-09-26 22:13:02,992 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) [3fe3d384] Adding task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:13:03,049 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = b9c2b835-cdbd-48ea-8d69-7a33042c79b1, imageGroupId = 5b283cc9-db03-4ec4-a73f-a3b6756ae5dc, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 9e4b8a51-3fa3-42da-8b75-d9f9561c1522, newImageDescription = ), log id: 6fc799c6 >2014-09-26 22:13:03,051 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:13:03,274 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, CreateImageVDSCommand, return: 9e4b8a51-3fa3-42da-8b75-d9f9561c1522, log id: 6fc799c6 >2014-09-26 22:13:03,300 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) CommandMultiAsyncTasks::AttachTask: Attaching task 6b07033f-e296-46f6-be53-e0338f202089 to command 801a2162-4be2-4431-be17-e23b70d9e2ca. >2014-09-26 22:13:03,315 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) Adding task 6b07033f-e296-46f6-be53-e0338f202089 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:13:03,325 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = b9c2b835-cdbd-48ea-8d69-7a33042c79b1, imageGroupId = e9cc0f76-8880-4d9b-a84a-5286257445c8, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = cbfca187-ef51-4088-9534-76a4c06a82c6, newImageDescription = ), log id: 51dde13b >2014-09-26 22:13:03,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:13:03,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, CreateImageVDSCommand, return: cbfca187-ef51-4088-9534-76a4c06a82c6, log id: 51dde13b >2014-09-26 22:13:03,498 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) CommandMultiAsyncTasks::AttachTask: Attaching task 074e916e-1e7a-4029-bd91-8c60c309c9ae to command 801a2162-4be2-4431-be17-e23b70d9e2ca. >2014-09-26 22:13:03,514 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) Adding task 074e916e-1e7a-4029-bd91-8c60c309c9ae (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:13:03,556 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-22) Correlation ID: 172e23d0, Job ID: 0661c5ee-68a8-418e-8f99-8751545379a6, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'created-on-el7' creation for VM 'vm-created-on-el7' was initiated by admin. >2014-09-26 22:13:03,557 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75. >2014-09-26 22:13:03,557 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task 6b07033f-e296-46f6-be53-e0338f202089. >2014-09-26 22:13:03,557 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task 074e916e-1e7a-4029-bd91-8c60c309c9ae. >2014-09-26 22:13:11,892 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-19) [8e75a14] Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-09-26 22:13:11,984 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] SPMAsyncTask::PollTask: Polling task 074e916e-1e7a-4029-bd91-8c60c309c9ae (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:13:12,011 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] BaseAsyncTask::onTaskEndSuccess: Task 074e916e-1e7a-4029-bd91-8c60c309c9ae (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:13:12,012 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-19) [8e75a14] Task with DB Task ID 68d5a20a-e809-4e27-b3f9-cacfcd093508 and VDSM Task ID 6b07033f-e296-46f6-be53-e0338f202089 is in state Polling. End action for command 801a2162-4be2-4431-be17-e23b70d9e2ca will proceed when all the entitys tasks are completed. >2014-09-26 22:13:12,013 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] SPMAsyncTask::PollTask: Polling task 6b07033f-e296-46f6-be53-e0338f202089 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:13:12,028 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] BaseAsyncTask::onTaskEndSuccess: Task 6b07033f-e296-46f6-be53-e0338f202089 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:13:12,029 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-19) [8e75a14] Task with DB Task ID 462a811a-1c48-43a2-a435-c76fb41ac452 and VDSM Task ID 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 is in state Polling. End action for command 801a2162-4be2-4431-be17-e23b70d9e2ca will proceed when all the entitys tasks are completed. >2014-09-26 22:13:12,030 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] SPMAsyncTask::PollTask: Polling task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:13:12,037 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] BaseAsyncTask::onTaskEndSuccess: Task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:13:12,038 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] CommandAsyncTask::endActionIfNecessary: All tasks of command 801a2162-4be2-4431-be17-e23b70d9e2ca has ended -> executing endAction >2014-09-26 22:13:12,038 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 801a2162-4be2-4431-be17-e23b70d9e2ca): calling endAction . >2014-09-26 22:13:12,039 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-16) [8e75a14] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-09-26 22:13:12,094 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-16) [8e75a14] Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-09-26 22:13:12,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-16) [8e75a14] START, SnapshotVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c), log id: 8fc1d09 >2014-09-26 22:13:13,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-16) [8e75a14] FINISH, SnapshotVDSCommand, log id: 8fc1d09 >2014-09-26 22:13:13,626 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-16) [3fe3d384] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-09-26 22:13:13,630 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-16) [3fe3d384] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageId = 171bb930-a3b6-4d31-8e87-a75aac784b61), log id: 6683caee >2014-09-26 22:13:13,730 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-16) [3fe3d384] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@4777b2b8, log id: 6683caee >2014-09-26 22:13:13,764 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-16) Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:13:13,792 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-16) Correlation ID: 172e23d0, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'created-on-el7' creation for VM 'vm-created-on-el7' has been completed. >2014-09-26 22:13:13,793 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-16) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-09-26 22:13:13,794 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-16) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-09-26 22:13:13,809 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 074e916e-1e7a-4029-bd91-8c60c309c9ae >2014-09-26 22:13:13,810 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 074e916e-1e7a-4029-bd91-8c60c309c9ae), log id: 7aab2b34 >2014-09-26 22:13:13,812 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=074e916e-1e7a-4029-bd91-8c60c309c9ae), log id: 7ba1a1d6 >2014-09-26 22:13:13,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, HSMClearTaskVDSCommand, log id: 7ba1a1d6 >2014-09-26 22:13:13,918 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, SPMClearTaskVDSCommand, log id: 7aab2b34 >2014-09-26 22:13:13,933 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) BaseAsyncTask::removeTaskFromDB: Removed task 074e916e-1e7a-4029-bd91-8c60c309c9ae from DataBase >2014-09-26 22:13:13,934 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6b07033f-e296-46f6-be53-e0338f202089 >2014-09-26 22:13:13,934 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 6b07033f-e296-46f6-be53-e0338f202089), log id: 473f4c67 >2014-09-26 22:13:13,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=6b07033f-e296-46f6-be53-e0338f202089), log id: cb122bc >2014-09-26 22:13:14,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, HSMClearTaskVDSCommand, log id: cb122bc >2014-09-26 22:13:14,037 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, SPMClearTaskVDSCommand, log id: 473f4c67 >2014-09-26 22:13:14,049 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) BaseAsyncTask::removeTaskFromDB: Removed task 6b07033f-e296-46f6-be53-e0338f202089 from DataBase >2014-09-26 22:13:14,050 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 >2014-09-26 22:13:14,051 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 0bc7274a-617c-4f97-95f3-a3e6c5b42f75), log id: 461f5438 >2014-09-26 22:13:14,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=0bc7274a-617c-4f97-95f3-a3e6c5b42f75), log id: 32d24c7f >2014-09-26 22:13:14,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, HSMClearTaskVDSCommand, log id: 32d24c7f >2014-09-26 22:13:14,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, SPMClearTaskVDSCommand, log id: 461f5438 >2014-09-26 22:13:14,165 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) BaseAsyncTask::removeTaskFromDB: Removed task 0bc7274a-617c-4f97-95f3-a3e6c5b42f75 from DataBase >2014-09-26 22:13:14,166 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-16) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 801a2162-4be2-4431-be17-e23b70d9e2ca >2014-09-26 22:13:15,867 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-16) START, FullListVdsCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vds=Host[voodoo6,45462850-a02c-4eeb-8527-292e15e5cb54], vmIds=[e25d2e73-22be-47e6-8214-2fd94d2f2e6c]), log id: 5f2b8066 >2014-09-26 22:13:16,045 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-16) FINISH, FullListVdsCommand, return: [{displaySecurePort=5900, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.110, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=-1, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=7550, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@36f78f78, vmName=vm-created-on-el7, fileTransferEnable=true, cpuType=Haswell}], log id: 5f2b8066 >2014-09-26 22:13:16,051 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-16) Received a spice Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.110}, device=spice, tlsPort=5900, type=graphics} >2014-09-26 22:13:36,172 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) [7503e370] VM vm-created-on-el7 e25d2e73-22be-47e6-8214-2fd94d2f2e6c moved from PoweringUp --> Up >2014-09-26 22:13:36,246 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-96) [7503e370] Correlation ID: 6b3fdf41, Job ID: b4a092e7-507c-46ab-b59f-86ddffb0b244, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 started on Host voodoo6 >2014-09-26 22:14:31,643 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) [6485af9b] Setting new tasks map. The map contains now 0 tasks >2014-09-26 22:14:31,644 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) [6485af9b] Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 22:15:09,821 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:15:09,822 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] Entered (VM vm-created-on-el7). >2014-09-26 22:15:09,823 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] Sending shutdown command for VM vm-created-on-el7. >2014-09-26 22:15:09,824 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] START, DestroyVmVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=30, gracefully=true, reason=), log id: 5f0ed201 >2014-09-26 22:15:09,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] START, DestroyVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=30, gracefully=true, reason=), log id: 2b3ac3b9 >2014-09-26 22:15:09,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] FINISH, DestroyVDSCommand, log id: 2b3ac3b9 >2014-09-26 22:15:09,962 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-35) [c569e13] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 5f0ed201 >2014-09-26 22:15:09,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-35) [c569e13] Correlation ID: c569e13, Job ID: 228707c7-535c-4cd6-90fb-1bf3f35a2ad4, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm-created-on-el7 (Host: voodoo6) (Reason: Not Specified). >2014-09-26 22:15:36,706 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-32) [696cf419] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:15:36,708 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-32) [696cf419] Entered (VM vm-created-on-el7). >2014-09-26 22:15:36,708 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-32) [696cf419] Cannot shutdown VM vm-created-on-el7, status is not up. Stopping instead. >2014-09-26 22:15:36,830 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-32) [4e267373] Running command: StopVmCommand internal: true. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:15:36,832 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-32) [4e267373] START, DestroyVmVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=0, gracefully=false, reason=), log id: aba1b3d >2014-09-26 22:15:36,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-32) [4e267373] START, DestroyVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=0, gracefully=false, reason=), log id: 7a81e97a >2014-09-26 22:15:37,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-32) [4e267373] FINISH, DestroyVDSCommand, log id: 7a81e97a >2014-09-26 22:15:37,369 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-32) [4e267373] FINISH, DestroyVmVDSCommand, return: Down, log id: aba1b3d >2014-09-26 22:15:37,385 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-32) [4e267373] Correlation ID: 4e267373, Job ID: cdb6de45-8e32-4740-b145-cd040a50185e, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 was powered off ungracefully by admin (Host: voodoo6) (Reason: Not Specified). >2014-09-26 22:15:37,391 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-26) [15387959] Running command: ProcessDownVmCommand internal: true. >2014-09-26 22:15:51,823 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (ajp--127.0.0.1-8702-1) Command c4d305e7-ec1f-4ebc-853b-cdd8487b4a5c persisting async task placeholder for child command 396767f0-807c-4892-854a-dd3dce2b8e28 >2014-09-26 22:15:51,922 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (ajp--127.0.0.1-8702-1) Running command: AddVmTemplateCommand internal: false. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePoolAction group CREATE_TEMPLATE with role type USER >2014-09-26 22:15:51,924 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8702-1) START, SetVmStatusVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, status = ImageLocked, exit status = Normal), log id: 5c2075ed >2014-09-26 22:15:51,927 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8702-1) FINISH, SetVmStatusVDSCommand, log id: 5c2075ed >2014-09-26 22:15:51,956 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (ajp--127.0.0.1-8702-1) [39757ba6] Running command: CreateImageTemplateCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:15:51,964 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-1) [39757ba6] START, CopyImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageId = 171bb930-a3b6-4d31-8e87-a75aac784b61, dstImageGroupId = 93c945c7-1bb0-443a-a433-98eb2660c985, vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, dstImageId = d8c2e738-b166-4c73-8c18-afac71e2b5a1, imageDescription = Active VM, dstStorageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, copyVolumeType = SharedVol, volumeFormat = COW, preallocate = Sparse, postZero = false, force = false), log id: 5fe5cdd >2014-09-26 22:15:51,967 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-1) [39757ba6] -- executeIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2014-09-26 22:15:51,967 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-1) [39757ba6] -- copyImage parameters: > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > vmGUID=e25d2e73-22be-47e6-8214-2fd94d2f2e6c > srcImageGUID=ecca2542-c4f0-4bfc-8a34-f775ba207720 > srcVolUUID=171bb930-a3b6-4d31-8e87-a75aac784b61 > dstImageGUID=93c945c7-1bb0-443a-a433-98eb2660c985 > dstVolUUID=d8c2e738-b166-4c73-8c18-afac71e2b5a1 > descr=Active VM > dstSdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 >2014-09-26 22:15:52,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-1) [39757ba6] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 5fe5cdd >2014-09-26 22:15:52,248 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-1) [39757ba6] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command c4d305e7-ec1f-4ebc-853b-cdd8487b4a5c >2014-09-26 22:15:52,249 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-1) [39757ba6] CommandMultiAsyncTasks::AttachTask: Attaching task d6c20301-fc35-4230-9bfd-9c3758079f5c to command c4d305e7-ec1f-4ebc-853b-cdd8487b4a5c. >2014-09-26 22:15:52,287 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-1) [39757ba6] Adding task d6c20301-fc35-4230-9bfd-9c3758079f5c (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:15:52,378 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) Correlation ID: 4f8c1d6f, Job ID: b48e81cd-8561-4a0c-a5db-4fceea2b6f80, Call Stack: null, Custom Event ID: -1, Message: Creation of Template created-on-el7 from VM vm-created-on-el7 was initiated by admin. >2014-09-26 22:15:52,379 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-1) BaseAsyncTask::startPollingTask: Starting to poll task d6c20301-fc35-4230-9bfd-9c3758079f5c. >2014-09-26 22:16:02,045 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-31) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-09-26 22:16:02,137 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) SPMAsyncTask::PollTask: Polling task d6c20301-fc35-4230-9bfd-9c3758079f5c (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:16:02,169 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) BaseAsyncTask::onTaskEndSuccess: Task d6c20301-fc35-4230-9bfd-9c3758079f5c (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:16:02,170 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-31) CommandAsyncTask::endActionIfNecessary: All tasks of command c4d305e7-ec1f-4ebc-853b-cdd8487b4a5c has ended -> executing endAction >2014-09-26 22:16:02,171 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-31) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: c4d305e7-ec1f-4ebc-853b-cdd8487b4a5c): calling endAction . >2014-09-26 22:16:02,173 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-41) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddVmTemplate, executionIndex: 0 >2014-09-26 22:16:02,260 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (org.ovirt.thread.pool-8-thread-41) [4f8c1d6f] Ending command successfully: org.ovirt.engine.core.bll.AddVmTemplateCommand >2014-09-26 22:16:02,277 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (org.ovirt.thread.pool-8-thread-41) [39757ba6] Ending command successfully: org.ovirt.engine.core.bll.CreateImageTemplateCommand >2014-09-26 22:16:02,284 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-41) [39757ba6] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = 93c945c7-1bb0-443a-a433-98eb2660c985, imageId = d8c2e738-b166-4c73-8c18-afac71e2b5a1), log id: 74a70f0e >2014-09-26 22:16:02,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-41) [39757ba6] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@b5f99ded, log id: 74a70f0e >2014-09-26 22:16:02,407 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, SetVmStatusVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, status = Down, exit status = Normal), log id: 56c7c35 >2014-09-26 22:16:02,412 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, SetVmStatusVDSCommand, log id: 56c7c35 >2014-09-26 22:16:02,451 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-41) Correlation ID: 4f8c1d6f, Call Stack: null, Custom Event ID: -1, Message: Creation of Template created-on-el7 from VM vm-created-on-el7 has been completed. >2014-09-26 22:16:02,452 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-41) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddVmTemplate completed, handling the result. >2014-09-26 22:16:02,453 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-41) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddVmTemplate succeeded, clearing tasks. >2014-09-26 22:16:02,467 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-41) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d6c20301-fc35-4230-9bfd-9c3758079f5c >2014-09-26 22:16:02,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = d6c20301-fc35-4230-9bfd-9c3758079f5c), log id: 52795ac >2014-09-26 22:16:02,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, HSMClearTaskVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, taskId=d6c20301-fc35-4230-9bfd-9c3758079f5c), log id: 69d351d8 >2014-09-26 22:16:02,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, HSMClearTaskVDSCommand, log id: 69d351d8 >2014-09-26 22:16:02,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, SPMClearTaskVDSCommand, log id: 52795ac >2014-09-26 22:16:02,583 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-41) BaseAsyncTask::removeTaskFromDB: Removed task d6c20301-fc35-4230-9bfd-9c3758079f5c from DataBase >2014-09-26 22:16:02,584 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-41) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity c4d305e7-ec1f-4ebc-853b-cdd8487b4a5c >2014-09-26 22:16:47,004 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8702-6) [615018eb] Lock Acquired to object EngineLock [exclusiveLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS >, sharedLocks= ] >2014-09-26 22:16:47,269 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-46) [615018eb] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 22:16:47,271 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-46) [615018eb] Before acquiring lock in order to prevent monitoring for host voodoo1 from data-center iscsi-el7 >2014-09-26 22:16:47,271 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-46) [615018eb] Lock acquired, from now a monitoring of host will be skipped for host voodoo1 from data-center iscsi-el7 >2014-09-26 22:16:47,276 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-46) [615018eb] START, SetVdsStatusVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3a9e2e94 >2014-09-26 22:16:47,286 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-46) [615018eb] FINISH, SetVdsStatusVDSCommand, log id: 3a9e2e94 >2014-09-26 22:16:47,319 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-46) Activate finished. Lock released. Monitoring can run now for host voodoo1 from data-center iscsi-el7 >2014-09-26 22:16:47,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-46) Correlation ID: 615018eb, Job ID: e0c7b295-84df-42eb-b5ff-b221260180b6, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 was activated by admin. >2014-09-26 22:16:47,336 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-46) Lock freed to object EngineLock [exclusiveLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS >, sharedLocks= ] >2014-09-26 22:17:31,644 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-83) [6b07189b] Setting new tasks map. The map contains now 0 tasks >2014-09-26 22:17:31,645 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-83) [6b07189b] Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 22:17:45,234 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp--127.0.0.1-8702-10) [293afa08] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 22:17:45,250 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 22:17:45,252 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] START, SetVdsStatusVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 7538f3d0 >2014-09-26 22:17:45,549 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] VDS voodoo6 is spm and moved from up calling resetIrs. >2014-09-26 22:17:45,550 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] START, ResetIrsVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, vdsId = 45462850-a02c-4eeb-8527-292e15e5cb54, ignoreStopFailed = false), log id: 711dcf33 >2014-09-26 22:17:45,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] START, SpmStopVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e), log id: 2daebfe0 >2014-09-26 22:17:45,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] SpmStopVDSCommand::Stopping SPM on vds voodoo6, pool id b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 22:17:45,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] FINISH, SpmStopVDSCommand, log id: 2daebfe0 >2014-09-26 22:17:45,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] FINISH, ResetIrsVDSCommand, log id: 711dcf33 >2014-09-26 22:17:45,805 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] FINISH, SetVdsStatusVDSCommand, log id: 7538f3d0 >2014-09-26 22:17:45,823 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 22:17:45,855 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-8-thread-13) [293afa08] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 45462850-a02c-4eeb-8527-292e15e5cb54 Type: VDS >2014-09-26 22:17:45,863 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-13) [293afa08] Correlation ID: 293afa08, Job ID: a098d5b2-7312-4f81-8d4d-6b420d9a811f, Call Stack: null, Custom Event ID: -1, Message: Host voodoo6 was switched to Maintenance mode by admin. >2014-09-26 22:17:48,847 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 45462850-a02c-4eeb-8527-292e15e5cb54 : voodoo6 >2014-09-26 22:17:48,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-20) Clearing cache of pool: b86b687a-d073-497a-ac8a-249025419a3e for problematic entities of VDS: voodoo6. >2014-09-26 22:17:48,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-20) Removing vds [45462850-a02c-4eeb-8527-292e15e5cb54] from the domain in maintenance cache >2014-09-26 22:17:48,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-20) Removing host(s) [45462850-a02c-4eeb-8527-292e15e5cb54] from hosts unseen domain report cache >2014-09-26 22:17:48,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-14) START, DisconnectStoragePoolVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, vds_spm_id = 2), log id: 76ebff72 >2014-09-26 22:17:51,849 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-27) [305586a0] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 04511d19-f03a-469a-9e31-ab51d6e75a56 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:17:51,885 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-27) [305586a0] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:17:51,895 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-27) [38a4fb6c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:17:51,910 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) [38a4fb6c] Correlation ID: 38a4fb6c, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting status to Non Responsive. >2014-09-26 22:17:52,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, DisconnectStoragePoolVDSCommand, log id: 76ebff72 >2014-09-26 22:17:52,599 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-14) [7c391780] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:17:52,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-14) [7c391780] START, DisconnectStorageServerVDSCommand(HostName = voodoo6, HostId = 45462850-a02c-4eeb-8527-292e15e5cb54, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 64f16e2f >2014-09-26 22:17:54,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-14) [7c391780] FINISH, DisconnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 64f16e2f >2014-09-26 22:19:48,904 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [6631a2c7] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.util.concurrent.TimeoutException >2014-09-26 22:19:48,905 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-66) [6631a2c7] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:19:48,921 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [6631a2c7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:19:48,938 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) [6631a2c7] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.util.concurrent.TimeoutException > at java.util.concurrent.FutureTask.get(FutureTask.java:201) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy.invoke(XmlRpcUtils.java:200) [vdsbroker.jar:] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsServerWrapper.getCapabilities(VdsServerWrapper.java:151) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > ... 12 more > >2014-09-26 22:19:48,943 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-66) [6631a2c7] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.util.concurrent.TimeoutException >2014-09-26 22:19:52,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetHardwareInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]), log id: 2d1fe119 >2014-09-26 22:19:53,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetHardwareInfoVDSCommand, log id: 2d1fe119 >2014-09-26 22:19:53,388 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [405a5f48] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 22:19:53,561 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-23) [53c65b3e] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:19:53,580 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [5a076fb9] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:19:53,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [5a076fb9] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17a5c511 >2014-09-26 22:19:55,820 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [5a076fb9] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 17a5c511 >2014-09-26 22:19:55,821 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [5a076fb9] Host voodoo1 storage connection was succeeded >2014-09-26 22:19:55,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 60e3167f >2014-09-26 22:19:56,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, ConnectStoragePoolVDSCommand, log id: 60e3167f >2014-09-26 22:19:57,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [5a076fb9] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 54bbe826 >2014-09-26 22:19:57,478 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [5a076fb9] FINISH, SetMOMPolicyParametersVDSCommand, log id: 54bbe826 >2014-09-26 22:19:57,519 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [5a076fb9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo1 was set to Up. >2014-09-26 22:19:57,526 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [5a076fb9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo1. >2014-09-26 22:19:57,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [5a076fb9] Correlation ID: 53c65b3e, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:19:57,561 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-23) [695e8687] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 22:20:02,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-7) hostFromVds::selectedVds - voodoo1, spmStatus Free, storage pool iscsi-el7 >2014-09-26 22:20:02,273 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-7) starting spm on vds voodoo1, storage pool iscsi-el7, prevId -1, LVER -1 >2014-09-26 22:20:02,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) START, SpmStartVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3c3110cb >2014-09-26 22:20:02,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) spmStart polling started: taskId = 1940385e-1db6-4a84-a3dd-712fed2c20f1 >2014-09-26 22:20:20,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) spmStart polling ended: taskId = 1940385e-1db6-4a84-a3dd-712fed2c20f1 task status = finished >2014-09-26 22:20:20,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) spmStart polling ended, spm status: SPM >2014-09-26 22:20:20,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-7) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=1940385e-1db6-4a84-a3dd-712fed2c20f1), log id: 65ff042e >2014-09-26 22:20:21,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, HSMClearTaskVDSCommand, log id: 65ff042e >2014-09-26 22:20:21,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3f56a9be, log id: 3c3110cb >2014-09-26 22:20:21,101 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-7) Initialize Irs proxy from vds: voodoo1.tlv.redhat.com >2014-09-26 22:20:21,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host voodoo1 (Address: voodoo1.tlv.redhat.com). >2014-09-26 22:20:21,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-24) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false), log id: 7e5b2304 >2014-09-26 22:20:21,508 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-13) [5d77a494] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:20:21,518 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [5d77a494] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2), log id: dbbcff5 >2014-09-26 22:20:21,525 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-19) [744f43ba] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: Storage >2014-09-26 22:20:21,531 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-24) -- executeIrsBrokerCommand: Attempting on storage pool b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 22:20:21,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-24) START, HSMGetAllTasksInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 4e8d1501 >2014-09-26 22:20:21,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-19) [744f43ba] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc), log id: 30b2d74a >2014-09-26 22:20:23,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [5d77a494] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=rcVaHv-bvMo-SCTY-hAf2-Iase-boq2-0l71SQ, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=GJPq30-Rp3Y-xz4T-V8wJ-CVtg-7wR4-cC3K40, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null]], log id: dbbcff5 >2014-09-26 22:20:23,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-24) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 4e8d1501 >2014-09-26 22:20:23,262 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-24) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 7e5b2304 >2014-09-26 22:20:23,262 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-24) Discovered no tasks on Storage Pool iscsi-el7 >2014-09-26 22:20:23,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-19) [744f43ba] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2, volumeGroupId=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=b9c2b835-cdbd-48ea-8d69-7a33042c79b1, storageDomainName=null]], log id: 30b2d74a >2014-09-26 22:20:44,918 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-10) [306c9f5e] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:20:44,948 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-10) [306c9f5e] START, IsVmDuringInitiatingVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c), log id: 4ad41c12 >2014-09-26 22:20:44,949 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-10) [306c9f5e] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4ad41c12 >2014-09-26 22:20:45,054 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] Running command: RunVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:20:45,101 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] START, UpdateVmDynamicDataVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@6adef305), log id: 4ce549f9 >2014-09-26 22:21:48,514 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-10) [768b0f56] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:21:48,550 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-10) [768b0f56] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_OBJECT_LOCKED >2014-09-26 22:23:07,247 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Command ListVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.util.concurrent.TimeoutException >2014-09-26 22:23:07,249 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:23:07,284 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:23:07,286 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:413) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.fetchRunningVms(VdsUpdateRunTimeInfo.java:982) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:931) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:649) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.util.concurrent.TimeoutException > at java.util.concurrent.FutureTask.get(FutureTask.java:201) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy.invoke(XmlRpcUtils.java:200) [vdsbroker.jar:] > at com.sun.proxy.$Proxy83.list(Unknown Source) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsServerWrapper.list(VdsServerWrapper.java:128) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand.executeVdsBrokerCommand(ListVDSCommand.java:23) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > ... 14 more > >2014-09-26 22:23:07,311 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.util.concurrent.TimeoutException >2014-09-26 22:23:07,318 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] FINISH, UpdateVmDynamicDataVDSCommand, log id: 4ce549f9 >2014-09-26 22:23:07,325 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] START, CreateVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]), log id: 3f14c4f1 >2014-09-26 22:23:07,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] START, CreateVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]), log id: 38ad2450 >2014-09-26 22:23:07,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c,acpiEnable=true,custom={device_8d9af46c-74f4-4485-954c-cec11239835b=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=8d9af46c-74f4-4485-954c-cec11239835b, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07device_e172895a-a370-40b3-831e-8036ddc78302=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=e172895a-a370-40b3-831e-8036ddc78302, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=2cc1fbdb-036c-4f46-805c-076e0bc61b07, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=b38ef8e0-9492-42ac-8f8e-15095afc54c4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=512,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=preferred},maxVCpus=16,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=52997aa3-aa16-481b-9f42-47dd3875df43}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=bb306c70-0178-4b00-9524-f08988e2d828}, {shared=false, index=0, volumeID=171bb930-a3b6-4d31-8e87-a75aac784b61, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=04511d19-f03a-469a-9e31-ab51d6e75a56, imageID=ecca2542-c4f0-4bfc-8a34-f775ba207720, specParams={}, optional=false, device=disk, poolID=b86b687a-d073-497a-ac8a-249025419a3e, readonly=false, deviceId=ecca2542-c4f0-4bfc-8a34-f775ba207720}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:ab:e1:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=bea24164-8385-44ea-b14a-350a478f1d8b}, {address={bus=0x00, domain=0x0000, slot=0x07, type=pci, function=0x0}, specParams={model=virtio}, device=memballoon, type=balloon, deviceId=0d9a4f5c-5f33-48d5-88f1-52350377c09b}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=93ecc55a-e39b-4f2f-8d9d-0c22d95bb3f2}, {address={bus=0x00, domain=0x0000, slot=0x05, type=pci, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=d1ac2864-ba6c-48d4-a6e0-a25872974d75}],vmName=vm-created-on-el7,cpuType=Haswell,fileTransferEnable=true >2014-09-26 22:23:07,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] Command CreateVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:07,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] FINISH, CreateVDSCommand, log id: 38ad2450 >2014-09-26 22:23:07,559 ERROR [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] VDS::create Failed creating vm vm-created-on-el7 in vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1 error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:07,561 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] FINISH, CreateVmVDSCommand, return: Down, log id: 3f14c4f1 >2014-09-26 22:23:07,562 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:23:07,563 ERROR [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] Command org.ovirt.engine.core.bll.RunVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 22:23:07,608 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [306c9f5e] Correlation ID: 306c9f5e, Job ID: 1fa732f2-5594-4772-bcf2-3cbd63d40b49, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm-created-on-el7 (User: admin). >2014-09-26 22:23:10,046 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-23) [695e8687] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 04511d19-f03a-469a-9e31-ab51d6e75a56 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:23:10,067 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-23) [695e8687] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 status from Active to Unknown, reason : no reporting hosts >2014-09-26 22:23:10,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-23) [695e8687] Command SpmStatusVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:10,082 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-23) [1d2512cb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:23:10,100 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [1d2512cb] Correlation ID: 1d2512cb, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting Data Center status to Non Responsive (On host voodoo1, Error: Network error during communication with the Host.). >2014-09-26 22:23:10,308 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-21) [61318ee4] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:23:10,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-21) [61318ee4] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2), log id: 26199379 >2014-09-26 22:23:10,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-21) [61318ee4] Command GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:10,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-21) [61318ee4] FINISH, GetVGInfoVDSCommand, log id: 26199379 >2014-09-26 22:23:10,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:10,317 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-21) [61318ee4] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 22:23:10,318 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-32) Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:23:10,321 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-32) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:23:10,324 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-36) [15ef6091] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: Storage >2014-09-26 22:23:10,331 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-32) Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:10,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [15ef6091] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc), log id: 385c548 >2014-09-26 22:23:10,336 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [15ef6091] Command GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:10,336 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [15ef6091] FINISH, GetVGInfoVDSCommand, log id: 385c548 >2014-09-26 22:23:10,337 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-36) [15ef6091] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 22:23:13,334 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:13,335 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-65) Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:23:13,354 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-65) Server failed to respond, vds_id = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds_name = voodoo1, vm_count = 0, spm_status = SPM, non-responsive_timeout (seconds) = 80, error = java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:13,413 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) >, Custom Event ID: -1, Message: Host voodoo1 is non responsive. >2014-09-26 22:23:13,419 INFO [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-8-thread-31) ResourceManager::vdsNotResponding entered for Host 114c2cc6-5123-45bc-8900-5c875b0543c4, voodoo1.tlv.redhat.com >2014-09-26 22:23:13,446 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:23:13,471 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-31) [50f65dd3] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 22:23:13,473 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-31) [50f65dd3] Opening SSH Soft Fencing session on host voodoo1.tlv.redhat.com >2014-09-26 22:23:13,482 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-8-thread-31) [50f65dd3] SSH Soft Fencing command failed on host voodoo1.tlv.redhat.com: null >Stdout: >Stderr: >Stacktrace: java.nio.channels.UnresolvedAddressException: java.nio.channels.UnresolvedAddressException > at sun.nio.ch.Net.checkAddress(Net.java:127) [rt.jar:1.7.0_65] > at sun.nio.ch.UnixAsynchronousSocketChannelImpl.implConnect(UnixAsynchronousSocketChannelImpl.java:301) [rt.jar:1.7.0_65] > at sun.nio.ch.AsynchronousSocketChannelImpl.connect(AsynchronousSocketChannelImpl.java:208) [rt.jar:1.7.0_65] > at org.apache.sshd.common.io.nio2.Nio2Connector.connect(Nio2Connector.java:47) > at org.apache.sshd.SshClient.connect(SshClient.java:334) > at org.apache.sshd.SshClient.connect(SshClient.java:320) > at org.apache.sshd.SshClient.connect(SshClient.java:310) > at org.ovirt.engine.core.uutils.ssh.SSHClient.connect(SSHClient.java:284) [uutils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:87) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:53) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1167) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1306) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1931) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1330) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:344) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:430) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:411) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:616) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:114) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:125) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:135) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:82) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$4.run(VdsEventListener.java:249) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:23:13,513 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [50f65dd3] Correlation ID: 50f65dd3, Job ID: 9021c2b0-d320-4bc3-8c70-46187c937c10, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:23:13,538 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-31) [33af5b96] Lock Acquired to object EngineLock [exclusiveLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_FENCE >, sharedLocks= ] >2014-09-26 22:23:13,538 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-31) [33af5b96] Fence failed on vds voodoo1 which is spm of pool b86b687a-d073-497a-ac8a-249025419a3e - moving pool to non operational >2014-09-26 22:23:13,541 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] The message key SetStoragePoolStatus is missing from bundles/ExecutionMessages >2014-09-26 22:23:13,571 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:23:13,572 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 04511d19-f03a-469a-9e31-ab51d6e75a56 status from Active to Unknown, reason : null >2014-09-26 22:23:13,573 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 status from Active to Unknown, reason : null >2014-09-26 22:23:13,587 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Correlation ID: 36ce47b5, Job ID: fdd67acb-63de-42a2-8942-e32b3454b173, Call Stack: null, Custom Event ID: -1, Message: Fencing failed on Storage Pool Manager voodoo1 for Data Center iscsi-el7. Setting status to Non-Operational. >2014-09-26 22:23:13,596 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Lock freed to object EngineLock [exclusiveLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_FENCE >, sharedLocks= ] >2014-09-26 22:23:13,596 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Failed to run Fence script on vds:voodoo1. >2014-09-26 22:23:13,599 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 became non responsive. It has no power management configured. Please check the host status, manually reboot it, and click "Confirm Host Has Been Rebooted" >2014-09-26 22:23:13,599 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VAR__ACTION__RESTART,VDS_FENCE_DISABLED >2014-09-26 22:23:13,599 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Trying to release exclusive lock which does not exist, lock key: 114c2cc6-5123-45bc-8900-5c875b0543c4VDS_FENCE >2014-09-26 22:23:13,600 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-8-thread-31) [36ce47b5] Lock freed to object EngineLock [exclusiveLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_FENCE >, sharedLocks= ] >2014-09-26 22:23:16,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [765ca739] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 22:23:16,472 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-55) [765ca739] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 160 seconds and after that an attempt to fence the host will be issued. >2014-09-26 22:23:16,520 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) [765ca739] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 22:23:20,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-89) [5118ab42] START, GetHardwareInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]), log id: 3ea79c34 >2014-09-26 22:23:20,468 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-89) [5118ab42] FINISH, GetHardwareInfoVDSCommand, log id: 3ea79c34 >2014-09-26 22:23:20,622 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-89) [62c52c7f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 22:23:21,006 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-89) [6d2ad9d3] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:23:21,018 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-89) [111dd2bb] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 22:23:21,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-89) [111dd2bb] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1a0ef6f2 >2014-09-26 22:23:21,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-89) [111dd2bb] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 1a0ef6f2 >2014-09-26 22:23:21,339 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-89) [111dd2bb] Host voodoo1 storage connection was succeeded >2014-09-26 22:23:21,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-18) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: ef0b643 >2014-09-26 22:23:22,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-18) FINISH, ConnectStoragePoolVDSCommand, log id: ef0b643 >2014-09-26 22:23:22,493 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-89) [111dd2bb] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 163bc08e >2014-09-26 22:23:22,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-89) [111dd2bb] FINISH, SetMOMPolicyParametersVDSCommand, log id: 163bc08e >2014-09-26 22:23:23,029 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) [111dd2bb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo1 was set to Up. >2014-09-26 22:23:23,037 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) [111dd2bb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo1. >2014-09-26 22:23:23,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) [111dd2bb] Correlation ID: 6d2ad9d3, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:23:23,076 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-89) [388cc622] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 22:23:30,791 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-48) [5d4227ec] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:23:30,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-48) [5d4227ec] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2), log id: 35f5bda7 >2014-09-26 22:23:30,807 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-25) [23b32c0] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: Storage >2014-09-26 22:23:30,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [23b32c0] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc), log id: 35f4312e >2014-09-26 22:23:32,253 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [23b32c0] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2, volumeGroupId=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=b9c2b835-cdbd-48ea-8d69-7a33042c79b1, storageDomainName=null]], log id: 35f4312e >2014-09-26 22:23:32,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-48) [5d4227ec] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=rcVaHv-bvMo-SCTY-hAf2-Iase-boq2-0l71SQ, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=GJPq30-Rp3Y-xz4T-V8wJ-CVtg-7wR4-cC3K40, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56, storageDomainName=null]], log id: 35f5bda7 >2014-09-26 22:24:01,535 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-1) [48b6456b] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:24:01,568 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-1) [48b6456b] START, IsVmDuringInitiatingVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c), log id: 470f768f >2014-09-26 22:24:01,569 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-1) [48b6456b] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 470f768f >2014-09-26 22:24:01,793 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] Running command: RunVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:24:01,840 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] START, UpdateVmDynamicDataVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@6adef305), log id: 16413b8b >2014-09-26 22:24:01,851 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] FINISH, UpdateVmDynamicDataVDSCommand, log id: 16413b8b >2014-09-26 22:24:01,855 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] START, CreateVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]), log id: 431d9786 >2014-09-26 22:24:01,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] START, CreateVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, vm=VM [vm-created-on-el7]), log id: 4f73568d >2014-09-26 22:24:01,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c,acpiEnable=true,custom={device_8d9af46c-74f4-4485-954c-cec11239835b=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=8d9af46c-74f4-4485-954c-cec11239835b, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07device_e172895a-a370-40b3-831e-8036ddc78302=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=e172895a-a370-40b3-831e-8036ddc78302, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=2cc1fbdb-036c-4f46-805c-076e0bc61b07, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=b38ef8e0-9492-42ac-8f8e-15095afc54c4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=512,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=preferred},maxVCpus=16,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=52997aa3-aa16-481b-9f42-47dd3875df43}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=bb306c70-0178-4b00-9524-f08988e2d828}, {shared=false, index=0, volumeID=171bb930-a3b6-4d31-8e87-a75aac784b61, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=04511d19-f03a-469a-9e31-ab51d6e75a56, imageID=ecca2542-c4f0-4bfc-8a34-f775ba207720, specParams={}, optional=false, device=disk, poolID=b86b687a-d073-497a-ac8a-249025419a3e, readonly=false, deviceId=ecca2542-c4f0-4bfc-8a34-f775ba207720}, {nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:ab:e1:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=bea24164-8385-44ea-b14a-350a478f1d8b}, {address={bus=0x00, domain=0x0000, slot=0x07, type=pci, function=0x0}, specParams={model=virtio}, device=memballoon, type=balloon, deviceId=0d9a4f5c-5f33-48d5-88f1-52350377c09b}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=93ecc55a-e39b-4f2f-8d9d-0c22d95bb3f2}, {address={bus=0x00, domain=0x0000, slot=0x05, type=pci, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=d1ac2864-ba6c-48d4-a6e0-a25872974d75}],vmName=vm-created-on-el7,cpuType=Haswell,fileTransferEnable=true >2014-09-26 22:24:02,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] FINISH, CreateVDSCommand, log id: 4f73568d >2014-09-26 22:24:02,547 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 431d9786 >2014-09-26 22:24:02,548 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-19) [48b6456b] Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:24:02,613 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-19) [48b6456b] Correlation ID: 48b6456b, Job ID: c46a08f8-9453-42fe-8a71-a9af53266722, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 was started by admin (Host: voodoo1). >2014-09-26 22:24:06,159 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) [783d3a2d] VM vm-created-on-el7 e25d2e73-22be-47e6-8214-2fd94d2f2e6c moved from WaitForLaunch --> PoweringUp >2014-09-26 22:24:06,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-84) [783d3a2d] START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[e25d2e73-22be-47e6-8214-2fd94d2f2e6c]), log id: 738f3b88 >2014-09-26 22:24:06,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-84) [783d3a2d] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, acpiEnable=true, custom={device_8d9af46c-74f4-4485-954c-cec11239835b=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=8d9af46c-74f4-4485-954c-cec11239835b, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07device_e172895a-a370-40b3-831e-8036ddc78302=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=e172895a-a370-40b3-831e-8036ddc78302, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=2cc1fbdb-036c-4f46-805c-076e0bc61b07, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=b38ef8e0-9492-42ac-8f8e-15095afc54c4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=14528, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@b02552e, vmName=vm-created-on-el7, fileTransferEnable=true, cpuType=Haswell}], log id: 738f3b88 >2014-09-26 22:24:06,349 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) [783d3a2d] Received a spice Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 22:24:17,174 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-37) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The Balloon device on VM vm-created-on-el7 on host voodoo1 is inflated but the device cannot be controlled (guest agent is down). >2014-09-26 22:24:46,186 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-10) [6f0ac877] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:24:46,263 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Command 8d66eaf7-b527-4305-b97c-df63c55f89fb persisting async task placeholder for child command d4b513f9-5f8a-4bd1-af1f-a9dd84e446ad >2014-09-26 22:24:46,337 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-09-26 22:24:46,362 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 22:24:46,365 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] START, CreateSnapshotVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 8dea46b4-2730-4796-8932-1d7e95b7ffd9, newImageDescription = , imageId = 171bb930-a3b6-4d31-8e87-a75aac784b61, sourceImageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720), log id: 1c2b6d68 >2014-09-26 22:24:46,367 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:24:46,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] FINISH, CreateSnapshotVDSCommand, return: 8dea46b4-2730-4796-8932-1d7e95b7ffd9, log id: 1c2b6d68 >2014-09-26 22:24:46,653 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 8d66eaf7-b527-4305-b97c-df63c55f89fb >2014-09-26 22:24:46,654 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] CommandMultiAsyncTasks::AttachTask: Attaching task 7bf69c73-0af2-4a73-b9af-2336b47734e3 to command 8d66eaf7-b527-4305-b97c-df63c55f89fb. >2014-09-26 22:24:46,710 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-7) [1eb01ca1] Adding task 7bf69c73-0af2-4a73-b9af-2336b47734e3 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:24:46,759 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = a72819b7-e7a3-4cd7-8186-43141be994f1, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = b525cb6f-f963-418a-a3d6-0eaf89b1f6a7, newImageDescription = ), log id: 643c2434 >2014-09-26 22:24:46,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:24:47,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, CreateImageVDSCommand, return: b525cb6f-f963-418a-a3d6-0eaf89b1f6a7, log id: 643c2434 >2014-09-26 22:24:47,159 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-7) CommandMultiAsyncTasks::AttachTask: Attaching task 7540050d-72c8-46d9-a403-d31a1064ac7d to command 8d66eaf7-b527-4305-b97c-df63c55f89fb. >2014-09-26 22:24:47,174 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-7) Adding task 7540050d-72c8-46d9-a403-d31a1064ac7d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:24:47,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ef287be8-1856-4402-9f64-40da4c5cfe0d, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 9e5b80af-b008-4e29-82e7-19b633d876d3, newImageDescription = ), log id: 414235ea >2014-09-26 22:24:47,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:24:47,424 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, CreateImageVDSCommand, return: 9e5b80af-b008-4e29-82e7-19b633d876d3, log id: 414235ea >2014-09-26 22:24:47,457 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-7) CommandMultiAsyncTasks::AttachTask: Attaching task 8b60f045-fb27-4969-9c79-080e6a2da5a9 to command 8d66eaf7-b527-4305-b97c-df63c55f89fb. >2014-09-26 22:24:47,472 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-7) Adding task 8b60f045-fb27-4969-9c79-080e6a2da5a9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:24:47,522 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) Correlation ID: 6f0ac877, Job ID: 64221da1-8c0c-49b2-b2b7-04f27a274c4d, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'created-on-el6' creation for VM 'vm-created-on-el7' was initiated by admin. >2014-09-26 22:24:47,523 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::startPollingTask: Starting to poll task 7bf69c73-0af2-4a73-b9af-2336b47734e3. >2014-09-26 22:24:47,524 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::startPollingTask: Starting to poll task 7540050d-72c8-46d9-a403-d31a1064ac7d. >2014-09-26 22:24:47,524 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::startPollingTask: Starting to poll task 8b60f045-fb27-4969-9c79-080e6a2da5a9. >2014-09-26 22:24:52,186 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-09-26 22:24:52,364 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) SPMAsyncTask::PollTask: Polling task 8b60f045-fb27-4969-9c79-080e6a2da5a9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 22:24:52,364 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) SPMAsyncTask::PollTask: Polling task 7540050d-72c8-46d9-a403-d31a1064ac7d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 22:24:52,365 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) SPMAsyncTask::PollTask: Polling task 7bf69c73-0af2-4a73-b9af-2336b47734e3 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 22:24:52,365 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) Finished polling Tasks, will poll again in 10 seconds. >2014-09-26 22:25:02,555 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] SPMAsyncTask::PollTask: Polling task 8b60f045-fb27-4969-9c79-080e6a2da5a9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:25:02,621 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] BaseAsyncTask::onTaskEndSuccess: Task 8b60f045-fb27-4969-9c79-080e6a2da5a9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:25:02,622 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-89) [388cc622] Task with DB Task ID 8b4f8f81-e424-4342-a5a0-52e8f5b22bd1 and VDSM Task ID 7540050d-72c8-46d9-a403-d31a1064ac7d is in state Polling. End action for command 8d66eaf7-b527-4305-b97c-df63c55f89fb will proceed when all the entitys tasks are completed. >2014-09-26 22:25:02,624 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] SPMAsyncTask::PollTask: Polling task 7540050d-72c8-46d9-a403-d31a1064ac7d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:25:02,637 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] BaseAsyncTask::onTaskEndSuccess: Task 7540050d-72c8-46d9-a403-d31a1064ac7d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:25:02,638 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-89) [388cc622] Task with DB Task ID d0812971-db38-4833-9a63-6e63810c22dc and VDSM Task ID 7bf69c73-0af2-4a73-b9af-2336b47734e3 is in state Polling. End action for command 8d66eaf7-b527-4305-b97c-df63c55f89fb will proceed when all the entitys tasks are completed. >2014-09-26 22:25:02,640 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] SPMAsyncTask::PollTask: Polling task 7bf69c73-0af2-4a73-b9af-2336b47734e3 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:25:02,654 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] BaseAsyncTask::onTaskEndSuccess: Task 7bf69c73-0af2-4a73-b9af-2336b47734e3 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:25:02,655 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] CommandAsyncTask::endActionIfNecessary: All tasks of command 8d66eaf7-b527-4305-b97c-df63c55f89fb has ended -> executing endAction >2014-09-26 22:25:02,656 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-89) [388cc622] CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 8d66eaf7-b527-4305-b97c-df63c55f89fb): calling endAction . >2014-09-26 22:25:02,656 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) [388cc622] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-09-26 22:25:02,712 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-9) [388cc622] Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-09-26 22:25:02,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-9) [388cc622] START, SnapshotVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c), log id: 439c0db7 >2014-09-26 22:25:05,679 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-27) [38a4fb6c] VM vm-created-on-el7 e25d2e73-22be-47e6-8214-2fd94d2f2e6c moved from PoweringUp --> Paused >2014-09-26 22:25:06,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-9) [388cc622] FINISH, SnapshotVDSCommand, log id: 439c0db7 >2014-09-26 22:25:06,895 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-9) [1eb01ca1] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-09-26 22:25:06,900 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-9) [1eb01ca1] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageId = 8dea46b4-2730-4796-8932-1d7e95b7ffd9), log id: 516c8062 >2014-09-26 22:25:07,360 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-9) [1eb01ca1] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@5a613101, log id: 516c8062 >2014-09-26 22:25:07,403 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-9) Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:25:07,433 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-9) Correlation ID: 6f0ac877, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'created-on-el6' creation for VM 'vm-created-on-el7' has been completed. >2014-09-26 22:25:07,434 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-09-26 22:25:07,434 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-09-26 22:25:07,441 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7540050d-72c8-46d9-a403-d31a1064ac7d >2014-09-26 22:25:07,441 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 7540050d-72c8-46d9-a403-d31a1064ac7d), log id: 386dd470 >2014-09-26 22:25:07,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=7540050d-72c8-46d9-a403-d31a1064ac7d), log id: 32962201 >2014-09-26 22:25:07,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, HSMClearTaskVDSCommand, log id: 32962201 >2014-09-26 22:25:07,924 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, SPMClearTaskVDSCommand, log id: 386dd470 >2014-09-26 22:25:07,979 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) BaseAsyncTask::removeTaskFromDB: Removed task 7540050d-72c8-46d9-a403-d31a1064ac7d from DataBase >2014-09-26 22:25:07,980 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8b60f045-fb27-4969-9c79-080e6a2da5a9 >2014-09-26 22:25:07,981 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 8b60f045-fb27-4969-9c79-080e6a2da5a9), log id: 3ba0206 >2014-09-26 22:25:07,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=8b60f045-fb27-4969-9c79-080e6a2da5a9), log id: 28dad9d3 >2014-09-26 22:25:08,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, HSMClearTaskVDSCommand, log id: 28dad9d3 >2014-09-26 22:25:08,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, SPMClearTaskVDSCommand, log id: 3ba0206 >2014-09-26 22:25:08,526 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) BaseAsyncTask::removeTaskFromDB: Removed task 8b60f045-fb27-4969-9c79-080e6a2da5a9 from DataBase >2014-09-26 22:25:08,527 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7bf69c73-0af2-4a73-b9af-2336b47734e3 >2014-09-26 22:25:08,528 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 7bf69c73-0af2-4a73-b9af-2336b47734e3), log id: 7c48d123 >2014-09-26 22:25:09,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=7bf69c73-0af2-4a73-b9af-2336b47734e3), log id: 18e903f >2014-09-26 22:25:09,995 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) [3943bcef] VM vm-created-on-el7 e25d2e73-22be-47e6-8214-2fd94d2f2e6c moved from Paused --> Up >2014-09-26 22:25:09,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) [3943bcef] START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[e25d2e73-22be-47e6-8214-2fd94d2f2e6c]), log id: 74de6fc >2014-09-26 22:25:10,410 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, HSMClearTaskVDSCommand, log id: 18e903f >2014-09-26 22:25:10,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, SPMClearTaskVDSCommand, log id: 7c48d123 >2014-09-26 22:25:10,447 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) BaseAsyncTask::removeTaskFromDB: Removed task 7bf69c73-0af2-4a73-b9af-2336b47734e3 from DataBase >2014-09-26 22:25:10,447 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 8d66eaf7-b527-4305-b97c-df63c55f89fb >2014-09-26 22:25:10,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) [3943bcef] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, acpiEnable=true, custom={device_8d9af46c-74f4-4485-954c-cec11239835b=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=8d9af46c-74f4-4485-954c-cec11239835b, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07device_e172895a-a370-40b3-831e-8036ddc78302=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=e172895a-a370-40b3-831e-8036ddc78302, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4device_2cc1fbdb-036c-4f46-805c-076e0bc61b07=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=2cc1fbdb-036c-4f46-805c-076e0bc61b07, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_8d9af46c-74f4-4485-954c-cec11239835bdevice_b38ef8e0-9492-42ac-8f8e-15095afc54c4=VmDevice {vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, deviceId=b38ef8e0-9492-42ac-8f8e-15095afc54c4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=14528, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@35bb2a0, vmName=vm-created-on-el7, fileTransferEnable=true, cpuType=Haswell}], log id: 74de6fc >2014-09-26 22:25:10,580 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) [3943bcef] Received a spice Device without an address when processing VM e25d2e73-22be-47e6-8214-2fd94d2f2e6c devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 22:25:42,635 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:25:42,636 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] Entered (VM vm-created-on-el7). >2014-09-26 22:25:42,637 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] Sending shutdown command for VM vm-created-on-el7. >2014-09-26 22:25:42,638 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] START, DestroyVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=30, gracefully=true, reason=), log id: 30456fda >2014-09-26 22:25:42,657 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] START, DestroyVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=30, gracefully=true, reason=), log id: 45687525 >2014-09-26 22:25:42,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] FINISH, DestroyVDSCommand, log id: 45687525 >2014-09-26 22:25:42,858 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-42) [de9c76] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 30456fda >2014-09-26 22:25:42,875 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-42) [de9c76] Correlation ID: de9c76, Job ID: ddf6ee4a-f761-47d3-a771-30e21e97d672, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm-created-on-el7 (Host: voodoo1) (Reason: Not Specified). >2014-09-26 22:25:53,252 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-2) [3c036487] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:25:53,253 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-2) [3c036487] Entered (VM vm-created-on-el7). >2014-09-26 22:25:53,254 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-2) [3c036487] Cannot shutdown VM vm-created-on-el7, status is not up. Stopping instead. >2014-09-26 22:25:53,302 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-2) [3c068c4a] Running command: StopVmCommand internal: true. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:25:53,304 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-2) [3c068c4a] START, DestroyVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=0, gracefully=false, reason=), log id: 43ce1907 >2014-09-26 22:25:53,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-2) [3c068c4a] START, DestroyVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=e25d2e73-22be-47e6-8214-2fd94d2f2e6c, force=false, secondsToWait=0, gracefully=false, reason=), log id: 263e20b7 >2014-09-26 22:25:54,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-2) [3c068c4a] FINISH, DestroyVDSCommand, log id: 263e20b7 >2014-09-26 22:25:54,304 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-2) [3c068c4a] FINISH, DestroyVmVDSCommand, return: Down, log id: 43ce1907 >2014-09-26 22:25:54,307 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-9) [3aa13fb] Running command: ProcessDownVmCommand internal: true. >2014-09-26 22:25:54,321 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-2) [3c068c4a] Correlation ID: 3c068c4a, Job ID: ecc6e5b0-ad27-4133-8334-d72cb9111849, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 was powered off ungracefully by admin (Host: voodoo1) (Reason: Not Specified). >2014-09-26 22:26:07,325 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (ajp--127.0.0.1-8702-4) Command 24913c92-1b1d-4d80-912d-858c93a793e0 persisting async task placeholder for child command afd60dc2-895d-4e14-9b9c-667fa4e633f4 >2014-09-26 22:26:07,506 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (ajp--127.0.0.1-8702-4) Running command: AddVmTemplateCommand internal: false. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePoolAction group CREATE_TEMPLATE with role type USER >2014-09-26 22:26:07,508 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8702-4) START, SetVmStatusVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, status = ImageLocked, exit status = Normal), log id: 51857209 >2014-09-26 22:26:07,510 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8702-4) FINISH, SetVmStatusVDSCommand, log id: 51857209 >2014-09-26 22:26:07,531 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (ajp--127.0.0.1-8702-4) [762f8f73] Running command: CreateImageTemplateCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:26:07,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-4) [762f8f73] START, CopyImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, imageId = 8dea46b4-2730-4796-8932-1d7e95b7ffd9, dstImageGroupId = af82cc91-fdc5-4100-9468-1bd61a83aa29, vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, dstImageId = d6cd7b0d-aa5b-4edc-9e23-d1fc30bcaddd, imageDescription = Active VM, dstStorageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, copyVolumeType = SharedVol, volumeFormat = COW, preallocate = Sparse, postZero = false, force = false), log id: 1714db5e >2014-09-26 22:26:07,541 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-4) [762f8f73] -- executeIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2014-09-26 22:26:07,542 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-4) [762f8f73] -- copyImage parameters: > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > vmGUID=e25d2e73-22be-47e6-8214-2fd94d2f2e6c > srcImageGUID=ecca2542-c4f0-4bfc-8a34-f775ba207720 > srcVolUUID=8dea46b4-2730-4796-8932-1d7e95b7ffd9 > dstImageGUID=af82cc91-fdc5-4100-9468-1bd61a83aa29 > dstVolUUID=d6cd7b0d-aa5b-4edc-9e23-d1fc30bcaddd > descr=Active VM > dstSdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 >2014-09-26 22:26:08,240 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (ajp--127.0.0.1-8702-4) [762f8f73] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 1714db5e >2014-09-26 22:26:08,277 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-4) [762f8f73] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 24913c92-1b1d-4d80-912d-858c93a793e0 >2014-09-26 22:26:08,278 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-4) [762f8f73] CommandMultiAsyncTasks::AttachTask: Attaching task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 to command 24913c92-1b1d-4d80-912d-858c93a793e0. >2014-09-26 22:26:08,301 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-4) [762f8f73] Adding task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:26:08,401 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) Correlation ID: 43405174, Job ID: e85d3a61-d2e1-4f35-9d7c-43c07065c601, Call Stack: null, Custom Event ID: -1, Message: Creation of Template created-on-el6 from VM vm-created-on-el7 was initiated by admin. >2014-09-26 22:26:08,402 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-4) BaseAsyncTask::startPollingTask: Starting to poll task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68. >2014-09-26 22:26:12,658 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) [7c391780] Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-09-26 22:26:13,419 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) [7c391780] SPMAsyncTask::PollTask: Polling task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 22:26:13,420 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) [7c391780] Finished polling Tasks, will poll again in 10 seconds. >2014-09-26 22:26:23,888 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:26:23,907 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 (Parent Command AddVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:26:23,908 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endActionIfNecessary: All tasks of command 24913c92-1b1d-4d80-912d-858c93a793e0 has ended -> executing endAction >2014-09-26 22:26:23,910 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 24913c92-1b1d-4d80-912d-858c93a793e0): calling endAction . >2014-09-26 22:26:23,911 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-5) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddVmTemplate, executionIndex: 0 >2014-09-26 22:26:23,990 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (org.ovirt.thread.pool-8-thread-5) [43405174] Ending command successfully: org.ovirt.engine.core.bll.AddVmTemplateCommand >2014-09-26 22:26:24,007 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (org.ovirt.thread.pool-8-thread-5) [762f8f73] Ending command successfully: org.ovirt.engine.core.bll.CreateImageTemplateCommand >2014-09-26 22:26:24,015 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-5) [762f8f73] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = af82cc91-fdc5-4100-9468-1bd61a83aa29, imageId = d6cd7b0d-aa5b-4edc-9e23-d1fc30bcaddd), log id: 48306a57 >2014-09-26 22:26:24,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-5) [762f8f73] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@e8343ec8, log id: 48306a57 >2014-09-26 22:26:24,220 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-5) START, SetVmStatusVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, status = Down, exit status = Normal), log id: 277a823a >2014-09-26 22:26:24,225 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-5) FINISH, SetVmStatusVDSCommand, log id: 277a823a >2014-09-26 22:26:24,247 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) Correlation ID: 43405174, Call Stack: null, Custom Event ID: -1, Message: Creation of Template created-on-el6 from VM vm-created-on-el7 has been completed. >2014-09-26 22:26:24,248 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-5) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddVmTemplate completed, handling the result. >2014-09-26 22:26:24,249 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-5) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddVmTemplate succeeded, clearing tasks. >2014-09-26 22:26:24,264 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-5) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 >2014-09-26 22:26:24,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-5) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68), log id: 46f5db7c >2014-09-26 22:26:24,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-5) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=0a14b9b5-f4d4-4516-b2c3-64a3f8303e68), log id: 371cce49 >2014-09-26 22:26:24,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-5) FINISH, HSMClearTaskVDSCommand, log id: 371cce49 >2014-09-26 22:26:24,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-5) FINISH, SPMClearTaskVDSCommand, log id: 46f5db7c >2014-09-26 22:26:24,462 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-5) BaseAsyncTask::removeTaskFromDB: Removed task 0a14b9b5-f4d4-4516-b2c3-64a3f8303e68 from DataBase >2014-09-26 22:26:24,463 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-5) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 24913c92-1b1d-4d80-912d-858c93a793e0 >2014-09-26 22:26:31,651 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-57) Setting new tasks map. The map contains now 1 tasks >2014-09-26 22:26:59,901 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-39) [2f898f8f] Start running CanDoAction for command number 1/2 (Command type: RemoveVmTemplate) >2014-09-26 22:26:59,901 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-10) [3b34d38c] Start running CanDoAction for command number 2/2 (Command type: RemoveVmTemplate) >2014-09-26 22:26:59,904 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-10) [3b34d38c] Lock Acquired to object EngineLock [exclusiveLocks= key: e8e2c7f9-c321-4895-8547-bd03cdf81335 value: TEMPLATE >, sharedLocks= ] >2014-09-26 22:26:59,911 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-39) [2f898f8f] Lock Acquired to object EngineLock [exclusiveLocks= key: e53e9c5e-4b5f-4e54-9537-a927d5d1c2cd value: TEMPLATE >, sharedLocks= ] >2014-09-26 22:26:59,937 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-10) [3b34d38c] Finish handling CanDoAction for command number 2/2 (Command type: RemoveVmTemplate) >2014-09-26 22:26:59,945 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-39) [2f898f8f] Finish handling CanDoAction for command number 1/2 (Command type: RemoveVmTemplate) >2014-09-26 22:26:59,977 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-43) [2f898f8f] Running command: RemoveVmTemplateCommand internal: false. Entities affected : ID: e53e9c5e-4b5f-4e54-9537-a927d5d1c2cd Type: VmTemplateAction group DELETE_TEMPLATE with role type USER >2014-09-26 22:26:59,996 INFO [org.ovirt.engine.core.bll.RemoveAllVmTemplateImageTemplatesCommand] (org.ovirt.thread.pool-8-thread-43) [2f898f8f] Running command: RemoveAllVmTemplateImageTemplatesCommand internal: true. Entities affected : ID: e53e9c5e-4b5f-4e54-9537-a927d5d1c2cd Type: VmTemplate >2014-09-26 22:27:00,008 INFO [org.ovirt.engine.core.bll.RemoveTemplateSnapshotCommand] (org.ovirt.thread.pool-8-thread-43) [74b185ce] Running command: RemoveTemplateSnapshotCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:27:00,053 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-43) [74b185ce] START, DeleteImageGroupVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = af82cc91-fdc5-4100-9468-1bd61a83aa29, postZeros = false, forceDelete = false), log id: 46259487 >2014-09-26 22:27:00,840 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-43) [74b185ce] FINISH, DeleteImageGroupVDSCommand, log id: 46259487 >2014-09-26 22:27:00,914 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) [74b185ce] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 34a35706-e8c4-4fad-bfb4-d3b2b53cc932 >2014-09-26 22:27:00,915 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-43) [74b185ce] CommandMultiAsyncTasks::AttachTask: Attaching task 81f432f1-5d36-49ab-9293-57fab4a8da71 to command 34a35706-e8c4-4fad-bfb4-d3b2b53cc932. >2014-09-26 22:27:00,955 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-43) [74b185ce] Adding task 81f432f1-5d36-49ab-9293-57fab4a8da71 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:27:01,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-43) [74b185ce] Correlation ID: 2f898f8f, Job ID: bebd1c4f-7698-44ea-a733-7c77c5e3d137, Call Stack: null, Custom Event ID: -1, Message: Removal of Template created-on-el6 was initiated by admin. >2014-09-26 22:27:01,047 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) [74b185ce] BaseAsyncTask::startPollingTask: Starting to poll task 81f432f1-5d36-49ab-9293-57fab4a8da71. >2014-09-26 22:27:01,080 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-43) [3b34d38c] Running command: RemoveVmTemplateCommand internal: false. Entities affected : ID: e8e2c7f9-c321-4895-8547-bd03cdf81335 Type: VmTemplateAction group DELETE_TEMPLATE with role type USER >2014-09-26 22:27:01,090 INFO [org.ovirt.engine.core.bll.RemoveAllVmTemplateImageTemplatesCommand] (org.ovirt.thread.pool-8-thread-43) [3b34d38c] Running command: RemoveAllVmTemplateImageTemplatesCommand internal: true. Entities affected : ID: e8e2c7f9-c321-4895-8547-bd03cdf81335 Type: VmTemplate >2014-09-26 22:27:01,102 INFO [org.ovirt.engine.core.bll.RemoveTemplateSnapshotCommand] (org.ovirt.thread.pool-8-thread-43) [634e6df4] Running command: RemoveTemplateSnapshotCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:27:01,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-43) [634e6df4] START, DeleteImageGroupVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = 93c945c7-1bb0-443a-a433-98eb2660c985, postZeros = false, forceDelete = false), log id: 3781805b >2014-09-26 22:27:01,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-43) [634e6df4] FINISH, DeleteImageGroupVDSCommand, log id: 3781805b >2014-09-26 22:27:02,016 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) [634e6df4] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command e42f161c-b20a-4b67-8a64-27da73b912c0 >2014-09-26 22:27:02,016 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-43) [634e6df4] CommandMultiAsyncTasks::AttachTask: Attaching task e23577e5-72cc-4f73-a3fa-04555be1aee9 to command e42f161c-b20a-4b67-8a64-27da73b912c0. >2014-09-26 22:27:02,040 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-43) [634e6df4] Adding task e23577e5-72cc-4f73-a3fa-04555be1aee9 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:27:02,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-43) [634e6df4] Correlation ID: 3b34d38c, Job ID: 9e0ee628-f9d0-4d17-ad07-14d7ca4e41e1, Call Stack: null, Custom Event ID: -1, Message: Removal of Template created-on-el7 was initiated by admin. >2014-09-26 22:27:02,132 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) [634e6df4] BaseAsyncTask::startPollingTask: Starting to poll task e23577e5-72cc-4f73-a3fa-04555be1aee9. >2014-09-26 22:27:03,912 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-72) [33584788] Polling and updating Async Tasks: 3 tasks, 2 tasks to poll now >2014-09-26 22:27:04,083 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] SPMAsyncTask::PollTask: Polling task 81f432f1-5d36-49ab-9293-57fab4a8da71 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:27:04,119 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] BaseAsyncTask::onTaskEndSuccess: Task 81f432f1-5d36-49ab-9293-57fab4a8da71 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:27:04,120 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] CommandAsyncTask::endActionIfNecessary: All tasks of command 34a35706-e8c4-4fad-bfb4-d3b2b53cc932 has ended -> executing endAction >2014-09-26 22:27:04,120 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 34a35706-e8c4-4fad-bfb4-d3b2b53cc932): calling endAction . >2014-09-26 22:27:04,120 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] SPMAsyncTask::PollTask: Polling task e23577e5-72cc-4f73-a3fa-04555be1aee9 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:27:04,120 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [33584788] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVmTemplate, executionIndex: 0 >2014-09-26 22:27:04,127 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] BaseAsyncTask::onTaskEndSuccess: Task e23577e5-72cc-4f73-a3fa-04555be1aee9 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:27:04,128 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] CommandAsyncTask::endActionIfNecessary: All tasks of command e42f161c-b20a-4b67-8a64-27da73b912c0 has ended -> executing endAction >2014-09-26 22:27:04,128 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-72) [33584788] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: e42f161c-b20a-4b67-8a64-27da73b912c0): calling endAction . >2014-09-26 22:27:04,129 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) [33584788] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVmTemplate, executionIndex: 0 >2014-09-26 22:27:04,152 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-48) [33584788] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmTemplateCommand >2014-09-26 22:27:04,156 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-48) [33584788] Lock freed to object EngineLock [exclusiveLocks= key: e53e9c5e-4b5f-4e54-9537-a927d5d1c2cd value: TEMPLATE >, sharedLocks= ] >2014-09-26 22:27:04,161 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-40) [33584788] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmTemplateCommand >2014-09-26 22:27:04,164 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-40) [33584788] Lock freed to object EngineLock [exclusiveLocks= key: e8e2c7f9-c321-4895-8547-bd03cdf81335 value: TEMPLATE >, sharedLocks= ] >2014-09-26 22:27:04,186 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-48) [33584788] Correlation ID: 2f898f8f, Call Stack: null, Custom Event ID: -1, Message: Removal of Template created-on-el6 has been completed. >2014-09-26 22:27:04,186 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [33584788] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate completed, handling the result. >2014-09-26 22:27:04,187 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [33584788] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate succeeded, clearing tasks. >2014-09-26 22:27:04,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-40) [33584788] Correlation ID: 3b34d38c, Call Stack: null, Custom Event ID: -1, Message: Removal of Template created-on-el7 has been completed. >2014-09-26 22:27:04,195 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) [33584788] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate completed, handling the result. >2014-09-26 22:27:04,195 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) [33584788] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate succeeded, clearing tasks. >2014-09-26 22:27:04,202 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) [33584788] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 81f432f1-5d36-49ab-9293-57fab4a8da71 >2014-09-26 22:27:04,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33584788] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 81f432f1-5d36-49ab-9293-57fab4a8da71), log id: 411fb7ca >2014-09-26 22:27:04,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33584788] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=81f432f1-5d36-49ab-9293-57fab4a8da71), log id: 95b502d >2014-09-26 22:27:04,210 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-40) [33584788] SPMAsyncTask::ClearAsyncTask: Attempting to clear task e23577e5-72cc-4f73-a3fa-04555be1aee9 >2014-09-26 22:27:04,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) [33584788] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = e23577e5-72cc-4f73-a3fa-04555be1aee9), log id: 36d8dfb9 >2014-09-26 22:27:04,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33584788] FINISH, HSMClearTaskVDSCommand, log id: 95b502d >2014-09-26 22:27:04,380 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33584788] FINISH, SPMClearTaskVDSCommand, log id: 411fb7ca >2014-09-26 22:27:04,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) [33584788] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=e23577e5-72cc-4f73-a3fa-04555be1aee9), log id: 13bcb746 >2014-09-26 22:27:04,393 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) [33584788] BaseAsyncTask::removeTaskFromDB: Removed task 81f432f1-5d36-49ab-9293-57fab4a8da71 from DataBase >2014-09-26 22:27:04,393 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [33584788] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 34a35706-e8c4-4fad-bfb4-d3b2b53cc932 >2014-09-26 22:27:04,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) [33584788] FINISH, HSMClearTaskVDSCommand, log id: 13bcb746 >2014-09-26 22:27:04,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) [33584788] FINISH, SPMClearTaskVDSCommand, log id: 36d8dfb9 >2014-09-26 22:27:04,658 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-40) [33584788] BaseAsyncTask::removeTaskFromDB: Removed task e23577e5-72cc-4f73-a3fa-04555be1aee9 from DataBase >2014-09-26 22:27:04,658 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) [33584788] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity e42f161c-b20a-4b67-8a64-27da73b912c0 >2014-09-26 22:27:27,950 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8702-4) [394bafb6] Lock Acquired to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:27:28,080 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-26) [394bafb6] Running command: RemoveVmCommand internal: false. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VMAction group DELETE_VM with role type USER >2014-09-26 22:27:28,081 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-26) [394bafb6] START, SetVmStatusVDSCommand( vmId = e25d2e73-22be-47e6-8214-2fd94d2f2e6c, status = ImageLocked, exit status = Normal), log id: 25f9a21 >2014-09-26 22:27:28,084 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-26) [394bafb6] FINISH, SetVmStatusVDSCommand, log id: 25f9a21 >2014-09-26 22:27:28,096 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-26) [394bafb6] Lock freed to object EngineLock [exclusiveLocks= key: e25d2e73-22be-47e6-8214-2fd94d2f2e6c value: VM >, sharedLocks= ] >2014-09-26 22:27:28,101 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-26) [17116726] Running command: RemoveMemoryVolumesCommand internal: true. >2014-09-26 22:27:28,102 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-26) [2e2337c6] Running command: RemoveMemoryVolumesCommand internal: true. >2014-09-26 22:27:28,115 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-26) [7a42a1d2] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: e25d2e73-22be-47e6-8214-2fd94d2f2e6c Type: VM >2014-09-26 22:27:28,120 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-26) [38d573d0] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 22:27:28,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-26) [38d573d0] START, DeleteImageGroupVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = ecca2542-c4f0-4bfc-8a34-f775ba207720, postZeros = false, forceDelete = false), log id: 426e8a7b >2014-09-26 22:27:29,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-26) [38d573d0] FINISH, DeleteImageGroupVDSCommand, log id: 426e8a7b >2014-09-26 22:27:29,223 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) [38d573d0] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command e5c8e660-ab56-47a0-ba59-293041354779 >2014-09-26 22:27:29,223 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-26) [38d573d0] CommandMultiAsyncTasks::AttachTask: Attaching task 0b0d6885-221c-4e2e-a157-ac336359682d to command e5c8e660-ab56-47a0-ba59-293041354779. >2014-09-26 22:27:29,248 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) [38d573d0] Adding task 0b0d6885-221c-4e2e-a157-ac336359682d (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:27:29,372 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-26) [38d573d0] Correlation ID: 394bafb6, Job ID: 3a02984c-f3f0-4eff-9c47-2a00b7f27dfd, Call Stack: null, Custom Event ID: -1, Message: VM vm-created-on-el7 was successfully removed. >2014-09-26 22:27:29,373 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) [38d573d0] BaseAsyncTask::startPollingTask: Starting to poll task 0b0d6885-221c-4e2e-a157-ac336359682d. >2014-09-26 22:27:31,651 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-45) [5683a545] Setting new tasks map. The map contains now 3 tasks >2014-09-26 22:27:34,130 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-58) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-09-26 22:27:34,343 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task 0b0d6885-221c-4e2e-a157-ac336359682d (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:27:34,399 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) BaseAsyncTask::onTaskEndSuccess: Task 0b0d6885-221c-4e2e-a157-ac336359682d (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:27:34,400 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-58) CommandAsyncTask::endActionIfNecessary: All tasks of command e5c8e660-ab56-47a0-ba59-293041354779 has ended -> executing endAction >2014-09-26 22:27:34,400 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-58) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: e5c8e660-ab56-47a0-ba59-293041354779): calling endAction . >2014-09-26 22:27:34,401 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-29) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-09-26 22:27:34,424 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-29) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-09-26 22:27:34,425 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-29) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-09-26 22:27:34,425 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-29) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-09-26 22:27:34,432 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-29) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0b0d6885-221c-4e2e-a157-ac336359682d >2014-09-26 22:27:34,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-29) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 0b0d6885-221c-4e2e-a157-ac336359682d), log id: 9582afc >2014-09-26 22:27:34,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-29) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=0b0d6885-221c-4e2e-a157-ac336359682d), log id: 6b714956 >2014-09-26 22:27:34,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-29) FINISH, HSMClearTaskVDSCommand, log id: 6b714956 >2014-09-26 22:27:34,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-29) FINISH, SPMClearTaskVDSCommand, log id: 9582afc >2014-09-26 22:27:34,647 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-29) BaseAsyncTask::removeTaskFromDB: Removed task 0b0d6885-221c-4e2e-a157-ac336359682d from DataBase >2014-09-26 22:27:34,648 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-29) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity e5c8e660-ab56-47a0-ba59-293041354779 >2014-09-26 22:28:31,651 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-78) [68d3b50c] Setting new tasks map. The map contains now 1 tasks >2014-09-26 22:29:01,651 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-54) Setting new tasks map. The map contains now 0 tasks >2014-09-26 22:29:01,652 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-54) Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 22:30:22,782 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [6cfe63c6] Lock Acquired to object EngineLock [exclusiveLocks= key: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 value: STORAGE >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 22:30:22,842 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:30:22,850 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] START, DeactivateStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = b9c2b835-cdbd-48ea-8d69-7a33042c79b1, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 4), log id: 4d7f3a >2014-09-26 22:30:25,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] FINISH, DeactivateStorageDomainVDSCommand, log id: 4d7f3a >2014-09-26 22:30:25,217 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] Lock freed to object EngineLock [exclusiveLocks= key: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 value: STORAGE >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 22:30:25,225 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-12) After deactivate treatment vds: voodoo1,pool iscsi-el7 >2014-09-26 22:30:25,228 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 2610fef8 >2014-09-26 22:30:26,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, ConnectStoragePoolVDSCommand, log id: 2610fef8 >2014-09-26 22:30:26,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = []), log id: 570be291 >2014-09-26 22:30:26,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 570be291 >2014-09-26 22:30:26,700 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 will remain in PreparingForMaintenance status until deactivated on all hosts >2014-09-26 22:30:26,742 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-40) [6cfe63c6] Correlation ID: 6cfe63c6, Job ID: a40f132d-0009-48d9-8835-ed56faeaafb0, Call Stack: null, Custom Event ID: -1, Message: Storage Domain jumbo-57 (Data Center iscsi-el7) was deactivated by admin >2014-09-26 22:30:41,926 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-4) Adding domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 to the domains in maintenance cache >2014-09-26 22:30:47,583 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-27) Moving domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 to maintenance >2014-09-26 22:30:59,680 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:30:59,681 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Start detach storage domain >2014-09-26 22:30:59,688 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Detach storage domain: before connect >2014-09-26 22:30:59,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-46) [9ad76e7] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 63a971df >2014-09-26 22:31:00,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-46) [9ad76e7] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0}, log id: 63a971df >2014-09-26 22:31:00,259 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Detach storage domain: after connect >2014-09-26 22:31:00,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] START, DetachStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = b9c2b835-cdbd-48ea-8d69-7a33042c79b1, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 4, force = false), log id: 5e655994 >2014-09-26 22:31:02,293 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] FINISH, DetachStorageDomainVDSCommand, log id: 5e655994 >2014-09-26 22:31:02,293 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Detach storage domain: after detach in vds >2014-09-26 22:31:02,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: b3aac1e >2014-09-26 22:31:03,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, ConnectStoragePoolVDSCommand, log id: b3aac1e >2014-09-26 22:31:03,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = []), log id: 2e44dde3 >2014-09-26 22:31:03,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 2e44dde3 >2014-09-26 22:31:03,693 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Detach storage domain: after disconnect storage >2014-09-26 22:31:03,796 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] End detach storage domain >2014-09-26 22:31:03,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [9ad76e7] Correlation ID: 9ad76e7, Job ID: 0f0f1c69-e8ab-45e4-8bdd-a33cd6dc4fe9, Call Stack: null, Custom Event ID: -1, Message: Storage Domain jumbo-57 was detached from Data Center iscsi-el7 by admin >2014-09-26 22:31:14,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-32) Removing domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 from the domains in maintenance cache >2014-09-26 22:31:37,089 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-11) [529a286e] Lock Acquired to object EngineLock [exclusiveLocks= key: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 value: STORAGE >, sharedLocks= ] >2014-09-26 22:31:37,117 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-11) [529a286e] Running command: RemoveStorageDomainCommand internal: false. Entities affected : ID: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:31:37,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [529a286e] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3b52364d >2014-09-26 22:31:38,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [529a286e] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0}, log id: 3b52364d >2014-09-26 22:31:38,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FormatStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [529a286e] START, FormatStorageDomainVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=b9c2b835-cdbd-48ea-8d69-7a33042c79b1), log id: 40321a67 >2014-09-26 22:31:44,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FormatStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [529a286e] FINISH, FormatStorageDomainVDSCommand, log id: 40321a67 >2014-09-26 22:31:44,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [529a286e] START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = []), log id: 3802cfaf >2014-09-26 22:31:44,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [529a286e] FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 3802cfaf >2014-09-26 22:31:44,546 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [529a286e] Correlation ID: 529a286e, Job ID: 0d83908f-9c09-4d94-baa6-ef408918a557, Call Stack: null, Custom Event ID: -1, Message: Storage Domain jumbo-57 was removed by admin >2014-09-26 22:31:44,555 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-11) [529a286e] Lock freed to object EngineLock [exclusiveLocks= key: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 value: STORAGE >, sharedLocks= ] >2014-09-26 22:32:21,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-8) START, GetDeviceListVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageType=ISCSI), log id: 3160e97c >2014-09-26 22:32:23,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-8) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600144f09dbd05000000522dde040011, physicalVolumeId=rruR7s-ZNAz-sIdl-W2i1-DcYy-h1JN-yBZySR, volumeGroupId=CFkTff-6ILJ-lJTb-WEAX-GxKp-ZNdS-SHbdf5, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=0, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sda=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde050012, physicalVolumeId=qF3qAT-PtX0-905c-7xKI-IVLc-Arte-WVdssA, volumeGroupId=ukxDj4-9BaM-GP8D-AXdt-icem-PGsw-a0uZXO, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=1, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8503b0005, physicalVolumeId=dw14Tv-1xGi-zGN0-gj1V-906n-m208-VvTfZI, volumeGroupId=YmPPiJ-nsar-EpWR-S4y5-QHYd-FOpA-xfHz6S, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=6, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdg=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a850500006, physicalVolumeId=fFnf8e-Lbg4-Iria-ZKlD-dZZO-9t4p-TMICbQ, volumeGroupId=Dc4f6x-2Yx0-Mnfa-853m-n2y6-34GW-tVc5sS, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=7, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdh=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde090014, physicalVolumeId=geNqgS-JdBu-CUVc-G0I4-6gTv-lvIo-LCQx4C, volumeGroupId=Xfr6cg-7A02-v7zc-1Jpe-yA3N-elId-3tJU4m, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=3, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sdd=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde070013, physicalVolumeId=iSI207-25SC-3NPO-Ql7y-EVUG-nDoT-fN200C, volumeGroupId=gtUcgN-7pS0-wDP5-DZFo-MKmV-00iP-kD7hY6, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=2, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84f4d0004, physicalVolumeId=cC58lC-m5Yd-oU23-rcYH-fvwi-Z4Nz-04nR1d, volumeGroupId=Dc4f6x-2Yx0-Mnfa-853m-n2y6-34GW-tVc5sS, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=5, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdf=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde0a0015, physicalVolumeId=9F5gEE-km8v-1h40-fWnP-sBw2-xCbp-LPotcU, volumeGroupId=XqaLau-A5pN-HHTe-sgvc-5HH4-cTl4-2fxqsI, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=4, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sde=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8505b0007, physicalVolumeId=PW3aOV-WRG5-AWVP-fRRM-hLvU-AUw1-BzSYTr, volumeGroupId=YmPPiJ-nsar-EpWR-S4y5-QHYd-FOpA-xfHz6S, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=8, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdi=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=rcVaHv-bvMo-SCTY-hAf2-Iase-boq2-0l71SQ, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8506c0009, physicalVolumeId=SDcbfm-4n1X-vVO2-eTm8-GGjd-xYsl-msjVqt, volumeGroupId=xF8Qxw-CSeu-Imb4-W4kr-Wa7n-1MLI-pMrvBM, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=10, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdk=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84cba0002, physicalVolumeId=EIl407-2zEB-qLGe-FA0I-qQog-BR9J-VejhH0, volumeGroupId=b6Fw5g-DodS-CE0X-BjVa-P5xC-i7q1-UfEwF1, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=76, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdn=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a850640008, physicalVolumeId=v0Knck-p7e3-vNSS-0FZO-F77b-FVbY-nZZthk, volumeGroupId=b6Fw5g-DodS-CE0X-BjVa-P5xC-i7q1-UfEwF1, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=9, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdj=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=GJPq30-Rp3Y-xz4T-V8wJ-CVtg-7wR4-cC3K40, volumeGroupId=5WMdhs-5OgY-hjPY-BzI3-Wbl2-0PHi-EQg9R2, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8507f000b, physicalVolumeId=Sgrdsi-5pXP-o9in-Sazo-o6Bp-wWcI-jR3Bph, volumeGroupId=xF8Qxw-CSeu-Imb4-W4kr-Wa7n-1MLI-pMrvBM, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=12, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdm=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060004, physicalVolumeId=dfBGy9-NjDz-aL8l-nu3h-9ZVo-zDvf-jtc1bp, volumeGroupId=8dKDGs-7otV-nWIb-peEF-rmLc-voUk-NzdUOK, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=4, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sds=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060001, physicalVolumeId=BBndGf-i0Wl-hsgh-YcuO-lBfL-kZqm-wENrKV, volumeGroupId=0VpbLa-58Uu-qMUL-7Bb8-CQo2-8frg-s5HNoW, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=1, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdp=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060002, physicalVolumeId=9U0BGz-o8Q1-pcnX-M9Bu-0lUS-7Gh3-lKl4s9, volumeGroupId=61j97h-EX2m-M5HM-cEJy-3CjC-qXif-UkIvx1, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=2, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdq=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060003, physicalVolumeId=Eo0hUR-Z6TZ-K1nu-TVnG-O5JS-fGpu-dcEnNP, volumeGroupId=BWat9o-8edB-LYxE-TwgR-BLHN-2jG0-1qJDpS, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=3, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdr=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060005, physicalVolumeId=NrP5TL-4Nc3-CnVz-XoPw-cdd3-sF3y-WUeLVa, volumeGroupId=rA7V1C-re8w-hT5f-lmMV-L1JH-CPvx-BNZYz5, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=5, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdt=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060007, physicalVolumeId=NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2, volumeGroupId=, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060006, physicalVolumeId=U0SmWM-kIo1-NG9w-IY42-iQfY-QBvc-Jy88I8, volumeGroupId=z8kei9-9cZ6-OnZS-djIG-veMx-XQcp-zDxNjl, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=6, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdu=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060008, physicalVolumeId=KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU, volumeGroupId=Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=8, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdw=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060009, physicalVolumeId=rycNJ2-vKhe-V7GW-tTs9-RFy0-ZvLm-Po36Oq, volumeGroupId=, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=9, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdx=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_0006000a, physicalVolumeId=FGNReY-p6zg-10rV-ZopZ-1A2g-uhJh-BRwegu, volumeGroupId=Sya3KR-q4RW-LvnG-dLVq-hCJN-u1Eq-eabeXE, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=10, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdy=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 3160e97c >2014-09-26 22:32:39,848 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:32:39,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] START, CreateVGVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050, deviceList=[1IET_00060007], force=false), log id: 1481e977 >2014-09-26 22:32:40,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] FINISH, CreateVGVDSCommand, return: 1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8, log id: 1481e977 >2014-09-26 22:32:40,735 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] START, CreateStorageDomainVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@216b23dc, args=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8), log id: 65348bf >2014-09-26 22:32:47,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] FINISH, CreateStorageDomainVDSCommand, log id: 65348bf >2014-09-26 22:32:47,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] START, GetStorageDomainStatsVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050), log id: 643755bb >2014-09-26 22:32:47,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@a038db02, log id: 643755bb >2014-09-26 22:32:48,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8), log id: 698b9d9b >2014-09-26 22:32:48,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-11) [7b62a5c6] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb, volumeGroupId=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050, storageDomainName=null]], log id: 698b9d9b >2014-09-26 22:32:48,313 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [7b62a5c6] Correlation ID: 7b62a5c6, Job ID: 81574bbb-d67f-4d3f-b80b-d12786198ef8, Call Stack: null, Custom Event ID: -1, Message: Storage Domain jumbo57 was added by admin >2014-09-26 22:32:48,769 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:32:48,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-20) [4becaa6e] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7e720c94 >2014-09-26 22:32:49,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-20) [4becaa6e] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0}, log id: 7e720c94 >2014-09-26 22:32:49,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] START, HSMGetStorageDomainInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050), log id: 7c27d768 >2014-09-26 22:32:50,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] FINISH, HSMGetStorageDomainInfoVDSCommand, return: <org.ovirt.engine.core.common.businessentities.StorageDomainStatic@74e31335, null>, log id: 7c27d768 >2014-09-26 22:32:50,340 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] START, AttachStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050), log id: 6c039726 >2014-09-26 22:33:14,342 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] FINISH, AttachStorageDomainVDSCommand, log id: 6c039726 >2014-09-26 22:33:14,351 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] START, GetImagesListVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, sdUUID = ff559f46-c495-4f6b-901c-2a624042a050), log id: 19f3d748 >2014-09-26 22:33:15,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-11) [4becaa6e] FINISH, GetImagesListVDSCommand, return: [], log id: 19f3d748 >2014-09-26 22:33:15,390 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-11) There are no OVF_STORE disks on storage domain id ff559f46-c495-4f6b-901c-2a624042a050 >2014-09-26 22:33:15,444 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [b80b3ed] Lock Acquired to object EngineLock [exclusiveLocks= key: ff559f46-c495-4f6b-901c-2a624042a050 value: STORAGE >, sharedLocks= ] >2014-09-26 22:33:15,457 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [b80b3ed] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:33:15,473 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [b80b3ed] Lock freed to object EngineLock [exclusiveLocks= key: ff559f46-c495-4f6b-901c-2a624042a050 value: STORAGE >, sharedLocks= ] >2014-09-26 22:33:15,475 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [b80b3ed] ActivateStorage Domain. Before Connect all hosts to pool. Time:9/26/14 10:33 PM >2014-09-26 22:33:15,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-42) [b80b3ed] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5540408d >2014-09-26 22:33:16,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-42) [b80b3ed] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0}, log id: 5540408d >2014-09-26 22:33:16,694 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (ajp--127.0.0.1-8702-11) [2718ab16] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:33:16,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-11) [2718ab16] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8), log id: 8fb692d >2014-09-26 22:33:17,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-11) [2718ab16] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb, volumeGroupId=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050, storageDomainName=null]], log id: 8fb692d >2014-09-26 22:33:17,332 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [2718ab16] START, ActivateStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050), log id: 6f0fcd62 >2014-09-26 22:33:19,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-11) [2718ab16] FINISH, ActivateStorageDomainVDSCommand, log id: 6f0fcd62 >2014-09-26 22:33:19,072 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [2718ab16] ActivateStorage Domain. After Connect all hosts to pool. Time:9/26/14 10:33 PM >2014-09-26 22:33:19,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 4), log id: 7e6f7839 >2014-09-26 22:33:19,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, ConnectStoragePoolVDSCommand, log id: 7e6f7839 >2014-09-26 22:33:19,980 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-41) Refreshed vds voodoo1 in pool iscsi-el7 >2014-09-26 22:33:19,981 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [2718ab16] ActivateStorage Domain. After change storage pool status in vds. Time:9/26/14 10:33 PM >2014-09-26 22:33:20,036 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [2718ab16] Correlation ID: b80b3ed, Call Stack: null, Custom Event ID: -1, Message: Storage Domain jumbo57 (Data Center iscsi-el7) was activated by <UNKNOWN> >2014-09-26 22:33:20,053 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [2718ab16] Correlation ID: 4becaa6e, Job ID: 99f6fc36-0339-477f-8200-6c17fe8cb633, Call Stack: null, Custom Event ID: -1, Message: Storage Domain jumbo57 was attached to Data Center iscsi-el7 by admin >2014-09-26 22:34:34,102 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [7503e370] Attempting to update VMs/Templates Ovf. >2014-09-26 22:34:34,199 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [64065d2c] Lock Acquired to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >key: f775e8bf-7873-4691-8102-a56b526f7bf3 value: DISK >key: 7f94fad2-3572-4450-9fa5-c307cda4b747 value: DISK >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 22:34:34,205 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [64065d2c] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:34:34,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [64065d2c] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = f775e8bf-7873-4691-8102-a56b526f7bf3, imageId = 1d4daa00-ea38-4904-826b-2b3e58c84d4e), log id: 4b9da95d >2014-09-26 22:34:34,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [64065d2c] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:34,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [64065d2c] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > imageGroupGUID=f775e8bf-7873-4691-8102-a56b526f7bf3 > volUUID=1d4daa00-ea38-4904-826b-2b3e58c84d4e > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"04511d19-f03a-469a-9e31-ab51d6e75a56"}],"Last Updated":"Fri Sep 26 01:42:42 IDT 2014"} > >2014-09-26 22:34:34,515 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [64065d2c] FINISH, SetVolumeDescriptionVDSCommand, log id: 4b9da95d >2014-09-26 22:34:34,647 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] Running command: UploadStreamCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:34:34,648 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] START, UploadStreamVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 28a809de >2014-09-26 22:34:34,649 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] -- executeVdsBrokerCommand: >2014-09-26 22:34:34,649 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] -- parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > imageGUID=f775e8bf-7873-4691-8102-a56b526f7bf3 > volUUID=1d4daa00-ea38-4904-826b-2b3e58c84d4e > size=10,240 > >2014-09-26 22:34:36,429 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] FINISH, UploadStreamVDSCommand, log id: 28a809de >2014-09-26 22:34:36,430 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-96) [415828f3] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 84686fbc-e3bd-4d3f-a14d-cd5334f9190a >2014-09-26 22:34:36,431 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-96) [415828f3] CommandMultiAsyncTasks::AttachTask: Attaching task 2b119712-8c8a-468f-bb08-5bb82bf2758d to command 84686fbc-e3bd-4d3f-a14d-cd5334f9190a. >2014-09-26 22:34:36,610 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-96) [415828f3] Adding task 2b119712-8c8a-468f-bb08-5bb82bf2758d (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:34:36,627 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] Lock freed to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >key: f775e8bf-7873-4691-8102-a56b526f7bf3 value: DISK >key: 7f94fad2-3572-4450-9fa5-c307cda4b747 value: DISK >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 22:34:36,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = f775e8bf-7873-4691-8102-a56b526f7bf3, imageId = 1d4daa00-ea38-4904-826b-2b3e58c84d4e), log id: 1340a479 >2014-09-26 22:34:36,632 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:36,632 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > imageGroupGUID=f775e8bf-7873-4691-8102-a56b526f7bf3 > volUUID=1d4daa00-ea38-4904-826b-2b3e58c84d4e > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"04511d19-f03a-469a-9e31-ab51d6e75a56"}],"Last Updated":"Fri Sep 26 22:34:34 IDT 2014","Size":10240} > >2014-09-26 22:34:37,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] FINISH, SetVolumeDescriptionVDSCommand, log id: 1340a479 >2014-09-26 22:34:37,076 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = 7f94fad2-3572-4450-9fa5-c307cda4b747, imageId = 131f3820-1479-4f89-8af1-b7a73301a8b1), log id: 333a52b6 >2014-09-26 22:34:37,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:37,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > imageGroupGUID=7f94fad2-3572-4450-9fa5-c307cda4b747 > volUUID=131f3820-1479-4f89-8af1-b7a73301a8b1 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"04511d19-f03a-469a-9e31-ab51d6e75a56"}],"Last Updated":"Fri Sep 26 01:42:42 IDT 2014"} > >2014-09-26 22:34:37,379 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [415828f3] FINISH, SetVolumeDescriptionVDSCommand, log id: 333a52b6 >2014-09-26 22:34:37,447 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] Running command: UploadStreamCommand internal: true. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: Storage >2014-09-26 22:34:37,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] START, UploadStreamVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 46c6ad5e >2014-09-26 22:34:37,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] -- executeVdsBrokerCommand: >2014-09-26 22:34:37,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] -- parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > imageGUID=7f94fad2-3572-4450-9fa5-c307cda4b747 > volUUID=131f3820-1479-4f89-8af1-b7a73301a8b1 > size=10,240 > >2014-09-26 22:34:39,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] FINISH, UploadStreamVDSCommand, log id: 46c6ad5e >2014-09-26 22:34:39,162 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-96) [6639ee13] CommandMultiAsyncTasks::AttachTask: Attaching task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f to command 84686fbc-e3bd-4d3f-a14d-cd5334f9190a. >2014-09-26 22:34:39,235 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-96) [6639ee13] Adding task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:34:39,251 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) [6639ee13] Trying to release a shared lock for key: b86b687a-d073-497a-ac8a-249025419a3eOVF_UPDATE , but lock does not exist >2014-09-26 22:34:39,252 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) [6639ee13] Trying to release exclusive lock which does not exist, lock key: 04511d19-f03a-469a-9e31-ab51d6e75a56STORAGE >2014-09-26 22:34:39,253 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) [6639ee13] Trying to release exclusive lock which does not exist, lock key: f775e8bf-7873-4691-8102-a56b526f7bf3DISK >2014-09-26 22:34:39,253 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) [6639ee13] Trying to release exclusive lock which does not exist, lock key: 7f94fad2-3572-4450-9fa5-c307cda4b747DISK >2014-09-26 22:34:39,254 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] Lock freed to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >key: f775e8bf-7873-4691-8102-a56b526f7bf3 value: DISK >key: 7f94fad2-3572-4450-9fa5-c307cda4b747 value: DISK >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 22:34:39,257 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, imageGroupId = 7f94fad2-3572-4450-9fa5-c307cda4b747, imageId = 131f3820-1479-4f89-8af1-b7a73301a8b1), log id: 17303a79 >2014-09-26 22:34:40,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:40,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=04511d19-f03a-469a-9e31-ab51d6e75a56 > imageGroupGUID=7f94fad2-3572-4450-9fa5-c307cda4b747 > volUUID=131f3820-1479-4f89-8af1-b7a73301a8b1 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"04511d19-f03a-469a-9e31-ab51d6e75a56"}],"Last Updated":"Fri Sep 26 22:34:34 IDT 2014","Size":10240} > >2014-09-26 22:34:40,543 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-96) [6639ee13] FINISH, SetVolumeDescriptionVDSCommand, log id: 17303a79 >2014-09-26 22:34:40,584 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-96) [6639ee13] BaseAsyncTask::startPollingTask: Starting to poll task 2b119712-8c8a-468f-bb08-5bb82bf2758d. >2014-09-26 22:34:40,585 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-96) [6639ee13] BaseAsyncTask::startPollingTask: Starting to poll task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f. >2014-09-26 22:34:40,589 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [59d52bf4] Lock Acquired to object EngineLock [exclusiveLocks= key: ff559f46-c495-4f6b-901c-2a624042a050 value: STORAGE >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 22:34:40,592 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [59d52bf4] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:40,597 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [3fc04dec] Running command: CreateOvfStoresForStorageDomainCommand internal: true. >2014-09-26 22:34:40,599 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [5149d75b] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:40,606 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-96) [29da01ed] Running command: AddDiskCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 22:34:40,659 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-96) [1c5f379b] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:40,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-96) [1c5f379b] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 563f9e47-9f0e-4d8c-862a-0cd2b86f5d90, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 75b7d7b4-5c1a-48fe-a079-0f6529bd8968, newImageDescription = OVF_STORE), log id: 5e73c3b1 >2014-09-26 22:34:40,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-96) [1c5f379b] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:34:41,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-96) [1c5f379b] FINISH, CreateImageVDSCommand, return: 75b7d7b4-5c1a-48fe-a079-0f6529bd8968, log id: 5e73c3b1 >2014-09-26 22:34:41,029 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-96) [1c5f379b] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0ffdd615-7171-4ebe-808d-5970adb5332a >2014-09-26 22:34:41,029 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-96) [1c5f379b] CommandMultiAsyncTasks::AttachTask: Attaching task d653193b-d022-43ee-bdba-d31f585a8269 to command 0ffdd615-7171-4ebe-808d-5970adb5332a. >2014-09-26 22:34:41,065 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-96) [1c5f379b] Adding task d653193b-d022-43ee-bdba-d31f585a8269 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:34:41,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-96) [1c5f379b] Correlation ID: 29da01ed, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-09-26 22:34:41,124 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [1a565fb1] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:41,133 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-96) [27a71c98] Running command: AddDiskCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 22:34:41,173 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-96) [7368c5ca] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:41,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-96) [7368c5ca] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 4924a620-9443-4780-81f6-0cc702bdd967, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 3149a0f8-82d3-43a4-b7e6-d6033485afb0, newImageDescription = OVF_STORE), log id: 31489400 >2014-09-26 22:34:41,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-96) [7368c5ca] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:34:41,539 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-96) [7368c5ca] FINISH, CreateImageVDSCommand, return: 3149a0f8-82d3-43a4-b7e6-d6033485afb0, log id: 31489400 >2014-09-26 22:34:41,540 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-96) [7368c5ca] CommandMultiAsyncTasks::AttachTask: Attaching task 8ec445f5-1695-4730-b871-bde787b2a97a to command 0ffdd615-7171-4ebe-808d-5970adb5332a. >2014-09-26 22:34:41,579 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-96) [7368c5ca] Adding task 8ec445f5-1695-4730-b871-bde787b2a97a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:34:41,603 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-96) [7368c5ca] Correlation ID: 27a71c98, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-09-26 22:34:41,628 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-96) [7368c5ca] BaseAsyncTask::startPollingTask: Starting to poll task d653193b-d022-43ee-bdba-d31f585a8269. >2014-09-26 22:34:41,629 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-96) [7368c5ca] BaseAsyncTask::startPollingTask: Starting to poll task 8ec445f5-1695-4730-b871-bde787b2a97a. >2014-09-26 22:34:41,629 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-96) [7368c5ca] Lock freed to object EngineLock [exclusiveLocks= key: ff559f46-c495-4f6b-901c-2a624042a050 value: STORAGE >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 22:34:44,410 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] Polling and updating Async Tasks: 4 tasks, 4 tasks to poll now >2014-09-26 22:34:44,582 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] SPMAsyncTask::PollTask: Polling task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:34:44,583 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] BaseAsyncTask::onTaskEndSuccess: Task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:34:44,583 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] Task with DB Task ID 3ed41d19-978e-4cfa-8948-0cb175230c21 and VDSM Task ID 2b119712-8c8a-468f-bb08-5bb82bf2758d is in state Polling. End action for command 84686fbc-e3bd-4d3f-a14d-cd5334f9190a will proceed when all the entitys tasks are completed. >2014-09-26 22:34:44,584 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] SPMAsyncTask::PollTask: Polling task 2b119712-8c8a-468f-bb08-5bb82bf2758d (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:34:44,585 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] BaseAsyncTask::onTaskEndSuccess: Task 2b119712-8c8a-468f-bb08-5bb82bf2758d (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:34:44,586 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] CommandAsyncTask::endActionIfNecessary: All tasks of command 84686fbc-e3bd-4d3f-a14d-cd5334f9190a has ended -> executing endAction >2014-09-26 22:34:44,587 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 84686fbc-e3bd-4d3f-a14d-cd5334f9190a): calling endAction . >2014-09-26 22:34:44,588 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] SPMAsyncTask::PollTask: Polling task 8ec445f5-1695-4730-b871-bde787b2a97a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:34:44,588 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-30) [2b5cb4a] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-09-26 22:34:44,589 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] BaseAsyncTask::onTaskEndSuccess: Task 8ec445f5-1695-4730-b871-bde787b2a97a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:34:44,591 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] Task with DB Task ID 48628cf4-86f4-47c8-8a81-3e0b37965aca and VDSM Task ID d653193b-d022-43ee-bdba-d31f585a8269 is in state Polling. End action for command 0ffdd615-7171-4ebe-808d-5970adb5332a will proceed when all the entitys tasks are completed. >2014-09-26 22:34:44,592 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] SPMAsyncTask::PollTask: Polling task d653193b-d022-43ee-bdba-d31f585a8269 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:34:44,593 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] BaseAsyncTask::onTaskEndSuccess: Task d653193b-d022-43ee-bdba-d31f585a8269 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:34:44,594 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] CommandAsyncTask::endActionIfNecessary: All tasks of command 0ffdd615-7171-4ebe-808d-5970adb5332a has ended -> executing endAction >2014-09-26 22:34:44,595 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-36) [2b5cb4a] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 0ffdd615-7171-4ebe-808d-5970adb5332a): calling endAction . >2014-09-26 22:34:44,596 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2b5cb4a] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateOvfStoresForStorageDomain, executionIndex: 0 >2014-09-26 22:34:44,635 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-42) [3fc04dec] Ending command successfully: org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand >2014-09-26 22:34:44,643 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-09-26 22:34:44,644 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-30) [64065d2c] Trying to release a shared lock for key: b86b687a-d073-497a-ac8a-249025419a3eOVF_UPDATE , but lock does not exist >2014-09-26 22:34:44,645 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-30) [64065d2c] Trying to release exclusive lock which does not exist, lock key: 04511d19-f03a-469a-9e31-ab51d6e75a56STORAGE >2014-09-26 22:34:44,646 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-30) [64065d2c] Trying to release exclusive lock which does not exist, lock key: f775e8bf-7873-4691-8102-a56b526f7bf3DISK >2014-09-26 22:34:44,647 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-30) [64065d2c] Trying to release exclusive lock which does not exist, lock key: 7f94fad2-3572-4450-9fa5-c307cda4b747DISK >2014-09-26 22:34:44,648 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] Lock freed to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >key: f775e8bf-7873-4691-8102-a56b526f7bf3 value: DISK >key: 7f94fad2-3572-4450-9fa5-c307cda4b747 value: DISK >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 22:34:44,649 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-09-26 22:34:44,649 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-09-26 22:34:44,650 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2b119712-8c8a-468f-bb08-5bb82bf2758d >2014-09-26 22:34:44,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 2b119712-8c8a-468f-bb08-5bb82bf2758d), log id: 64049c41 >2014-09-26 22:34:44,651 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-42) [7368c5ca] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 22:34:44,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=2b119712-8c8a-468f-bb08-5bb82bf2758d), log id: 6f3bcc7c >2014-09-26 22:34:44,657 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-42) [7368c5ca] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 4924a620-9443-4780-81f6-0cc702bdd967, imageId = 3149a0f8-82d3-43a4-b7e6-d6033485afb0), log id: 7188f2ad >2014-09-26 22:34:44,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] FINISH, HSMClearTaskVDSCommand, log id: 6f3bcc7c >2014-09-26 22:34:44,829 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] FINISH, SPMClearTaskVDSCommand, log id: 64049c41 >2014-09-26 22:34:44,842 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] BaseAsyncTask::removeTaskFromDB: Removed task 2b119712-8c8a-468f-bb08-5bb82bf2758d from DataBase >2014-09-26 22:34:44,842 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] SPMAsyncTask::ClearAsyncTask: Attempting to clear task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f >2014-09-26 22:34:44,843 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = c5932d03-bfe0-4cc3-9c57-07081dcc1a0f), log id: 15ee7eee >2014-09-26 22:34:45,135 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-42) [7368c5ca] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@696f3de2, log id: 7188f2ad >2014-09-26 22:34:45,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=c5932d03-bfe0-4cc3-9c57-07081dcc1a0f), log id: 5ccf4681 >2014-09-26 22:34:45,173 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-42) [1c5f379b] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 22:34:45,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-42) [1c5f379b] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 563f9e47-9f0e-4d8c-862a-0cd2b86f5d90, imageId = 75b7d7b4-5c1a-48fe-a079-0f6529bd8968), log id: 58ed174e >2014-09-26 22:34:45,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] FINISH, HSMClearTaskVDSCommand, log id: 5ccf4681 >2014-09-26 22:34:45,313 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-30) [64065d2c] FINISH, SPMClearTaskVDSCommand, log id: 15ee7eee >2014-09-26 22:34:45,323 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] BaseAsyncTask::removeTaskFromDB: Removed task c5932d03-bfe0-4cc3-9c57-07081dcc1a0f from DataBase >2014-09-26 22:34:45,324 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-30) [64065d2c] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 84686fbc-e3bd-4d3f-a14d-cd5334f9190a >2014-09-26 22:34:45,679 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-42) [1c5f379b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@44fb3ce1, log id: 58ed174e >2014-09-26 22:34:45,720 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-42) [3fc04dec] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:45,731 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [3fc04dec] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 4924a620-9443-4780-81f6-0cc702bdd967, imageId = 3149a0f8-82d3-43a4-b7e6-d6033485afb0), log id: 20919d01 >2014-09-26 22:34:45,733 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [3fc04dec] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:45,734 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [3fc04dec] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=ff559f46-c495-4f6b-901c-2a624042a050 > imageGroupGUID=4924a620-9443-4780-81f6-0cc702bdd967 > volUUID=3149a0f8-82d3-43a4-b7e6-d6033485afb0 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"ff559f46-c495-4f6b-901c-2a624042a050"}],"Last Updated":null} > >2014-09-26 22:34:46,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [3fc04dec] FINISH, SetVolumeDescriptionVDSCommand, log id: 20919d01 >2014-09-26 22:34:46,168 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 22:34:46,184 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] Running command: UploadStreamCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:46,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] START, UploadStreamVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: e4f039d >2014-09-26 22:34:46,187 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] -- executeVdsBrokerCommand: >2014-09-26 22:34:46,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] -- parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=ff559f46-c495-4f6b-901c-2a624042a050 > imageGUID=4924a620-9443-4780-81f6-0cc702bdd967 > volUUID=3149a0f8-82d3-43a4-b7e6-d6033485afb0 > size=10,240 > >2014-09-26 22:34:47,331 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] FINISH, UploadStreamVDSCommand, log id: e4f039d >2014-09-26 22:34:47,334 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-42) [525920a] CommandMultiAsyncTasks::AttachTask: Attaching task 67cc079b-96b7-4cb0-9c72-c86cdc87869e to command 0ffdd615-7171-4ebe-808d-5970adb5332a. >2014-09-26 22:34:47,376 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-42) [525920a] Adding task 67cc079b-96b7-4cb0-9c72-c86cdc87869e (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:34:47,393 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 22:34:47,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 4924a620-9443-4780-81f6-0cc702bdd967, imageId = 3149a0f8-82d3-43a4-b7e6-d6033485afb0), log id: 276d4bd7 >2014-09-26 22:34:47,401 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:47,402 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=ff559f46-c495-4f6b-901c-2a624042a050 > imageGroupGUID=4924a620-9443-4780-81f6-0cc702bdd967 > volUUID=3149a0f8-82d3-43a4-b7e6-d6033485afb0 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"ff559f46-c495-4f6b-901c-2a624042a050"}],"Last Updated":"Fri Sep 26 22:34:45 IDT 2014","Size":10240} > >2014-09-26 22:34:47,817 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] FINISH, SetVolumeDescriptionVDSCommand, log id: 276d4bd7 >2014-09-26 22:34:47,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 563f9e47-9f0e-4d8c-862a-0cd2b86f5d90, imageId = 75b7d7b4-5c1a-48fe-a079-0f6529bd8968), log id: 7e94cfef >2014-09-26 22:34:47,836 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:47,837 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=ff559f46-c495-4f6b-901c-2a624042a050 > imageGroupGUID=563f9e47-9f0e-4d8c-862a-0cd2b86f5d90 > volUUID=75b7d7b4-5c1a-48fe-a079-0f6529bd8968 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"ff559f46-c495-4f6b-901c-2a624042a050"}],"Last Updated":null} > >2014-09-26 22:34:48,260 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [525920a] FINISH, SetVolumeDescriptionVDSCommand, log id: 7e94cfef >2014-09-26 22:34:48,421 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 22:34:48,436 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] Running command: UploadStreamCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:34:48,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] START, UploadStreamVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 19cd63e1 >2014-09-26 22:34:48,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] -- executeVdsBrokerCommand: >2014-09-26 22:34:48,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] -- parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=ff559f46-c495-4f6b-901c-2a624042a050 > imageGUID=563f9e47-9f0e-4d8c-862a-0cd2b86f5d90 > volUUID=75b7d7b4-5c1a-48fe-a079-0f6529bd8968 > size=10,240 > >2014-09-26 22:34:49,851 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] FINISH, UploadStreamVDSCommand, log id: 19cd63e1 >2014-09-26 22:34:49,853 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] CommandMultiAsyncTasks::AttachTask: Attaching task 02bb2566-3536-4888-b0e6-a213d6c4df85 to command 0ffdd615-7171-4ebe-808d-5970adb5332a. >2014-09-26 22:34:50,009 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] Adding task 02bb2566-3536-4888-b0e6-a213d6c4df85 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:34:50,026 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 22:34:50,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 563f9e47-9f0e-4d8c-862a-0cd2b86f5d90, imageId = 75b7d7b4-5c1a-48fe-a079-0f6529bd8968), log id: 6007d634 >2014-09-26 22:34:50,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 22:34:50,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=ff559f46-c495-4f6b-901c-2a624042a050 > imageGroupGUID=563f9e47-9f0e-4d8c-862a-0cd2b86f5d90 > volUUID=75b7d7b4-5c1a-48fe-a079-0f6529bd8968 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"ff559f46-c495-4f6b-901c-2a624042a050"}],"Last Updated":"Fri Sep 26 22:34:45 IDT 2014","Size":10240} > >2014-09-26 22:34:50,328 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] FINISH, SetVolumeDescriptionVDSCommand, log id: 6007d634 >2014-09-26 22:34:50,357 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] BaseAsyncTask::startPollingTask: Starting to poll task 67cc079b-96b7-4cb0-9c72-c86cdc87869e. >2014-09-26 22:34:50,357 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] BaseAsyncTask::startPollingTask: Starting to poll task 02bb2566-3536-4888-b0e6-a213d6c4df85. >2014-09-26 22:34:50,358 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain completed, handling the result. >2014-09-26 22:34:50,358 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain succeeded, clearing tasks. >2014-09-26 22:34:50,358 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8ec445f5-1695-4730-b871-bde787b2a97a >2014-09-26 22:34:50,359 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 8ec445f5-1695-4730-b871-bde787b2a97a), log id: 2f93ff4 >2014-09-26 22:34:51,004 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=8ec445f5-1695-4730-b871-bde787b2a97a), log id: 5cca6bad >2014-09-26 22:34:51,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] FINISH, HSMClearTaskVDSCommand, log id: 5cca6bad >2014-09-26 22:34:51,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] FINISH, SPMClearTaskVDSCommand, log id: 2f93ff4 >2014-09-26 22:34:51,210 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] BaseAsyncTask::removeTaskFromDB: Removed task 8ec445f5-1695-4730-b871-bde787b2a97a from DataBase >2014-09-26 22:34:51,211 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] SPMAsyncTask::ClearAsyncTask: Attempting to clear task d653193b-d022-43ee-bdba-d31f585a8269 >2014-09-26 22:34:51,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = d653193b-d022-43ee-bdba-d31f585a8269), log id: 69f86c7 >2014-09-26 22:34:51,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=d653193b-d022-43ee-bdba-d31f585a8269), log id: 53497636 >2014-09-26 22:34:51,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] FINISH, HSMClearTaskVDSCommand, log id: 53497636 >2014-09-26 22:34:51,506 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] FINISH, SPMClearTaskVDSCommand, log id: 69f86c7 >2014-09-26 22:34:51,524 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] BaseAsyncTask::removeTaskFromDB: Removed task d653193b-d022-43ee-bdba-d31f585a8269 from DataBase >2014-09-26 22:34:51,525 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-42) [2a6ed31f] [within thread]: Some of the tasks related to command id 0ffdd615-7171-4ebe-808d-5970adb5332a were not cleared yet (Task id 02bb2566-3536-4888-b0e6-a213d6c4df85 is in state Polling). >2014-09-26 22:34:54,597 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-70) [51303d41] Polling and updating Async Tasks: 6 tasks, 2 tasks to poll now >2014-09-26 22:34:54,909 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) [51303d41] SPMAsyncTask::PollTask: Polling task 02bb2566-3536-4888-b0e6-a213d6c4df85 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:34:54,910 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) [51303d41] BaseAsyncTask::onTaskEndSuccess: Task 02bb2566-3536-4888-b0e6-a213d6c4df85 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:34:54,910 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-70) [51303d41] Task with DB Task ID 497d6e0c-6398-41f0-bf1b-fea6385fca6d and VDSM Task ID 67cc079b-96b7-4cb0-9c72-c86cdc87869e is in state Polling. End action for command 0ffdd615-7171-4ebe-808d-5970adb5332a will proceed when all the entitys tasks are completed. >2014-09-26 22:34:54,911 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) [51303d41] SPMAsyncTask::PollTask: Polling task 67cc079b-96b7-4cb0-9c72-c86cdc87869e (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:34:54,911 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) [51303d41] BaseAsyncTask::onTaskEndSuccess: Task 67cc079b-96b7-4cb0-9c72-c86cdc87869e (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:34:54,912 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-70) [51303d41] CommandAsyncTask::endActionIfNecessary: All tasks of command 0ffdd615-7171-4ebe-808d-5970adb5332a has ended -> executing endAction >2014-09-26 22:34:54,913 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-70) [51303d41] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 0ffdd615-7171-4ebe-808d-5970adb5332a): calling endAction . >2014-09-26 22:34:54,913 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [51303d41] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-09-26 22:34:54,978 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-09-26 22:34:54,979 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-09-26 22:34:54,980 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-09-26 22:34:54,981 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 02bb2566-3536-4888-b0e6-a213d6c4df85 >2014-09-26 22:34:54,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 02bb2566-3536-4888-b0e6-a213d6c4df85), log id: 4224ec5e >2014-09-26 22:34:54,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=02bb2566-3536-4888-b0e6-a213d6c4df85), log id: 61a313f >2014-09-26 22:34:55,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] FINISH, HSMClearTaskVDSCommand, log id: 61a313f >2014-09-26 22:34:55,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] FINISH, SPMClearTaskVDSCommand, log id: 4224ec5e >2014-09-26 22:34:55,168 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] BaseAsyncTask::removeTaskFromDB: Removed task 02bb2566-3536-4888-b0e6-a213d6c4df85 from DataBase >2014-09-26 22:34:55,169 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 67cc079b-96b7-4cb0-9c72-c86cdc87869e >2014-09-26 22:34:55,169 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 67cc079b-96b7-4cb0-9c72-c86cdc87869e), log id: e0a60bd >2014-09-26 22:34:55,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=67cc079b-96b7-4cb0-9c72-c86cdc87869e), log id: 4b551f7e >2014-09-26 22:34:55,385 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] FINISH, HSMClearTaskVDSCommand, log id: 4b551f7e >2014-09-26 22:34:55,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] FINISH, SPMClearTaskVDSCommand, log id: e0a60bd >2014-09-26 22:34:55,401 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] BaseAsyncTask::removeTaskFromDB: Removed task 67cc079b-96b7-4cb0-9c72-c86cdc87869e from DataBase >2014-09-26 22:34:55,402 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [3fc04dec] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0ffdd615-7171-4ebe-808d-5970adb5332a >2014-09-26 22:36:01,653 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-60) Setting new tasks map. The map contains now 0 tasks >2014-09-26 22:36:01,654 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-60) Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 22:51:11,070 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [521f0d3c] Lock Acquired to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >, sharedLocks= ] >2014-09-26 22:51:11,132 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:51:11,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] START, DeactivateStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, masterDomainId = ff559f46-c495-4f6b-901c-2a624042a050, masterVersion = 5), log id: 423e6daa >2014-09-26 22:51:16,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] FINISH, DeactivateStorageDomainVDSCommand, log id: 423e6daa >2014-09-26 22:51:16,296 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] Lock freed to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >, sharedLocks= ] >2014-09-26 22:51:16,304 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-34) After deactivate treatment vds: voodoo1,pool iscsi-el7 >2014-09-26 22:51:16,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 5), log id: 6054f486 >2014-09-26 22:51:17,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, ConnectStoragePoolVDSCommand, log id: 6054f486 >2014-09-26 22:51:17,386 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = []), log id: a9b0aff >2014-09-26 22:51:17,387 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-50) Adding domain 04511d19-f03a-469a-9e31-ab51d6e75a56 to the domains in maintenance cache >2014-09-26 22:51:18,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: a9b0aff >2014-09-26 22:51:18,402 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] Domain 04511d19-f03a-469a-9e31-ab51d6e75a56 will remain in PreparingForMaintenance status until deactivated on all hosts >2014-09-26 22:51:18,480 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-27) [521f0d3c] Correlation ID: 521f0d3c, Job ID: 9eb59b26-cfc1-456b-83c4-f56f4eb6489f, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sasha15 (Data Center iscsi-el7) was deactivated by admin >2014-09-26 22:51:27,762 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-16) Moving domain 04511d19-f03a-469a-9e31-ab51d6e75a56 to maintenance >2014-09-26 22:51:38,954 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:51:38,955 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] Start detach storage domain >2014-09-26 22:51:38,962 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] Detach storage domain: before connect >2014-09-26 22:51:38,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-24) [7860f868] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1f8ed8ef >2014-09-26 22:51:40,051 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-24) [7860f868] FINISH, ConnectStorageServerVDSCommand, return: {af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 1f8ed8ef >2014-09-26 22:51:40,052 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] Detach storage domain: after connect >2014-09-26 22:51:40,053 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] START, DetachStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 04511d19-f03a-469a-9e31-ab51d6e75a56, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 5, force = false), log id: 439ec732 >2014-09-26 22:51:42,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] FINISH, DetachStorageDomainVDSCommand, log id: 439ec732 >2014-09-26 22:51:42,400 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] Detach storage domain: after detach in vds >2014-09-26 22:51:42,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-17) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 5), log id: 2f5c920d >2014-09-26 22:51:43,429 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-17) FINISH, ConnectStoragePoolVDSCommand, log id: 2f5c920d >2014-09-26 22:51:43,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-17) START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = []), log id: 58e2d77f >2014-09-26 22:51:43,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-17) FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 58e2d77f >2014-09-26 22:51:43,790 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] Detach storage domain: after disconnect storage >2014-09-26 22:51:43,975 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-19) [7860f868] End detach storage domain >2014-09-26 22:51:43,992 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-19) [7860f868] Correlation ID: 7860f868, Job ID: 2b40cc4b-f9a7-400c-a3f1-b98fddab2f8a, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sasha15 was detached from Data Center iscsi-el7 by admin >2014-09-26 22:51:50,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-33) Removing domain 04511d19-f03a-469a-9e31-ab51d6e75a56 from the domains in maintenance cache >2014-09-26 22:52:38,658 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-6) [67da2eec] Lock Acquired to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >, sharedLocks= ] >2014-09-26 22:52:38,674 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-6) [67da2eec] Running command: RemoveStorageDomainCommand internal: false. Entities affected : ID: 04511d19-f03a-469a-9e31-ab51d6e75a56 Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:52:38,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-6) [67da2eec] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 37ce1786 >2014-09-26 22:52:39,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-6) [67da2eec] FINISH, ConnectStorageServerVDSCommand, return: {af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 37ce1786 >2014-09-26 22:52:39,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FormatStorageDomainVDSCommand] (ajp--127.0.0.1-8702-6) [67da2eec] START, FormatStorageDomainVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=04511d19-f03a-469a-9e31-ab51d6e75a56), log id: 191b2cb3 >2014-09-26 22:52:43,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FormatStorageDomainVDSCommand] (ajp--127.0.0.1-8702-6) [67da2eec] FINISH, FormatStorageDomainVDSCommand, log id: 191b2cb3 >2014-09-26 22:52:43,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-6) [67da2eec] START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = []), log id: 4c87a249 >2014-09-26 22:52:43,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-6) [67da2eec] FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 4c87a249 >2014-09-26 22:52:44,000 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [67da2eec] Correlation ID: 67da2eec, Job ID: cb6b081f-837e-43ff-b77b-ae0cfa9147f7, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sasha15 was removed by admin >2014-09-26 22:52:44,009 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-6) [67da2eec] Lock freed to object EngineLock [exclusiveLocks= key: 04511d19-f03a-469a-9e31-ab51d6e75a56 value: STORAGE >, sharedLocks= ] >2014-09-26 22:53:02,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-10) START, GetDeviceListVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageType=ISCSI), log id: 7de0c8d5 >2014-09-26 22:53:04,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-10) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600144f09dbd05000000522dde040011, physicalVolumeId=rruR7s-ZNAz-sIdl-W2i1-DcYy-h1JN-yBZySR, volumeGroupId=CFkTff-6ILJ-lJTb-WEAX-GxKp-ZNdS-SHbdf5, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=0, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sda=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde050012, physicalVolumeId=qF3qAT-PtX0-905c-7xKI-IVLc-Arte-WVdssA, volumeGroupId=ukxDj4-9BaM-GP8D-AXdt-icem-PGsw-a0uZXO, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=1, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8503b0005, physicalVolumeId=dw14Tv-1xGi-zGN0-gj1V-906n-m208-VvTfZI, volumeGroupId=YmPPiJ-nsar-EpWR-S4y5-QHYd-FOpA-xfHz6S, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=6, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdg=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a850500006, physicalVolumeId=fFnf8e-Lbg4-Iria-ZKlD-dZZO-9t4p-TMICbQ, volumeGroupId=Dc4f6x-2Yx0-Mnfa-853m-n2y6-34GW-tVc5sS, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=7, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdh=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde090014, physicalVolumeId=geNqgS-JdBu-CUVc-G0I4-6gTv-lvIo-LCQx4C, volumeGroupId=Xfr6cg-7A02-v7zc-1Jpe-yA3N-elId-3tJU4m, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=3, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sdd=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde070013, physicalVolumeId=iSI207-25SC-3NPO-Ql7y-EVUG-nDoT-fN200C, volumeGroupId=gtUcgN-7pS0-wDP5-DZFo-MKmV-00iP-kD7hY6, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=2, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84f4d0004, physicalVolumeId=cC58lC-m5Yd-oU23-rcYH-fvwi-Z4Nz-04nR1d, volumeGroupId=Dc4f6x-2Yx0-Mnfa-853m-n2y6-34GW-tVc5sS, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=5, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdf=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd05000000522dde0a0015, physicalVolumeId=9F5gEE-km8v-1h40-fWnP-sBw2-xCbp-LPotcU, volumeGroupId=XqaLau-A5pN-HHTe-sgvc-5HH4-cTl4-2fxqsI, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=4, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=NEXENTA, pathsDictionary={sde=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8505b0007, physicalVolumeId=PW3aOV-WRG5-AWVP-fRRM-hLvU-AUw1-BzSYTr, volumeGroupId=YmPPiJ-nsar-EpWR-S4y5-QHYd-FOpA-xfHz6S, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=8, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdi=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=rcVaHv-bvMo-SCTY-hAf2-Iase-boq2-0l71SQ, volumeGroupId=, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8506c0009, physicalVolumeId=SDcbfm-4n1X-vVO2-eTm8-GGjd-xYsl-msjVqt, volumeGroupId=xF8Qxw-CSeu-Imb4-W4kr-Wa7n-1MLI-pMrvBM, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=10, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdk=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84cba0002, physicalVolumeId=EIl407-2zEB-qLGe-FA0I-qQog-BR9J-VejhH0, volumeGroupId=b6Fw5g-DodS-CE0X-BjVa-P5xC-i7q1-UfEwF1, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=76, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdn=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a850640008, physicalVolumeId=v0Knck-p7e3-vNSS-0FZO-F77b-FVbY-nZZthk, volumeGroupId=b6Fw5g-DodS-CE0X-BjVa-P5xC-i7q1-UfEwF1, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=9, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdj=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=GJPq30-Rp3Y-xz4T-V8wJ-CVtg-7wR4-cC3K40, volumeGroupId=, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a8507f000b, physicalVolumeId=Sgrdsi-5pXP-o9in-Sazo-o6Bp-wWcI-jR3Bph, volumeGroupId=xF8Qxw-CSeu-Imb4-W4kr-Wa7n-1MLI-pMrvBM, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=12, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdm=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060004, physicalVolumeId=dfBGy9-NjDz-aL8l-nu3h-9ZVo-zDvf-jtc1bp, volumeGroupId=8dKDGs-7otV-nWIb-peEF-rmLc-voUk-NzdUOK, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=4, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sds=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060001, physicalVolumeId=BBndGf-i0Wl-hsgh-YcuO-lBfL-kZqm-wENrKV, volumeGroupId=0VpbLa-58Uu-qMUL-7Bb8-CQo2-8frg-s5HNoW, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=1, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdp=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060002, physicalVolumeId=9U0BGz-o8Q1-pcnX-M9Bu-0lUS-7Gh3-lKl4s9, volumeGroupId=61j97h-EX2m-M5HM-cEJy-3CjC-qXif-UkIvx1, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=2, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdq=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060003, physicalVolumeId=Eo0hUR-Z6TZ-K1nu-TVnG-O5JS-fGpu-dcEnNP, volumeGroupId=BWat9o-8edB-LYxE-TwgR-BLHN-2jG0-1qJDpS, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=3, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdr=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060005, physicalVolumeId=NrP5TL-4Nc3-CnVz-XoPw-cdd3-sF3y-WUeLVa, volumeGroupId=rA7V1C-re8w-hT5f-lmMV-L1JH-CPvx-BNZYz5, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=5, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdt=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060007, physicalVolumeId=QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb, volumeGroupId=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060006, physicalVolumeId=U0SmWM-kIo1-NG9w-IY42-iQfY-QBvc-Jy88I8, volumeGroupId=z8kei9-9cZ6-OnZS-djIG-veMx-XQcp-zDxNjl, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=6, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdu=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060008, physicalVolumeId=KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU, volumeGroupId=Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=8, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdw=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_00060009, physicalVolumeId=rycNJ2-vKhe-V7GW-tTs9-RFy0-ZvLm-Po36Oq, volumeGroupId=, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=9, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdx=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1IET_0006000a, physicalVolumeId=FGNReY-p6zg-10rV-ZopZ-1A2g-uhJh-BRwegu, volumeGroupId=Sya3KR-q4RW-LvnG-dLVq-hCJN-u1Eq-eabeXE, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=10, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdy=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 7de0c8d5 >2014-09-26 22:53:35,966 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp--127.0.0.1-8702-10) [11f95329] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:53:35,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] START, CreateVGVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, deviceList=[3600144f09dbd0500000053a85076000a, 3600144f09dbd0500000053a84e730003], force=false), log id: 73ac6a03 >2014-09-26 22:53:36,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] FINISH, CreateVGVDSCommand, return: 0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, log id: 73ac6a03 >2014-09-26 22:53:36,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] START, CreateStorageDomainVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@d0333133, args=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w), log id: e9a9b8a >2014-09-26 22:53:43,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] FINISH, CreateStorageDomainVDSCommand, log id: e9a9b8a >2014-09-26 22:53:43,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] START, GetStorageDomainStatsVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c), log id: 36bd4c78 >2014-09-26 22:53:44,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@1498d0a4, log id: 36bd4c78 >2014-09-26 22:53:44,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w), log id: 28c22f77 >2014-09-26 22:53:44,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-10) [11f95329] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=OJXETa-XKwC-GizR-hnvw-Cr7H-UWmH-RQz7RG, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=KgqqOU-mqae-ikMS-Y8eV-8BLg-mdFL-YP4LfA, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null]], log id: 28c22f77 >2014-09-26 22:53:44,820 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) [11f95329] Correlation ID: 11f95329, Job ID: f53c3136-62d2-4ec8-949a-546eff8927fc, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sasha15 was added by admin >2014-09-26 22:53:45,416 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-10) [79f72602] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:53:45,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-16) [79f72602] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3ce23860 >2014-09-26 22:53:45,657 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-16) [79f72602] FINISH, ConnectStorageServerVDSCommand, return: {af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 3ce23860 >2014-09-26 22:53:45,660 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-10) [79f72602] START, HSMGetStorageDomainInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c), log id: 6b4e0f33 >2014-09-26 22:53:46,654 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-10) [79f72602] FINISH, HSMGetStorageDomainInfoVDSCommand, return: <org.ovirt.engine.core.common.businessentities.StorageDomainStatic@23ab208c, null>, log id: 6b4e0f33 >2014-09-26 22:53:46,654 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-10) [79f72602] START, AttachStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c), log id: 788cde7f >2014-09-26 22:54:11,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-10) [79f72602] FINISH, AttachStorageDomainVDSCommand, log id: 788cde7f >2014-09-26 22:54:11,807 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-10) [79f72602] START, GetImagesListVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, sdUUID = 3e419414-ee73-47e8-809d-60de4a88403c), log id: 37da1c35 >2014-09-26 22:54:12,995 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-10) [79f72602] FINISH, GetImagesListVDSCommand, return: [], log id: 37da1c35 >2014-09-26 22:54:13,000 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-10) There are no OVF_STORE disks on storage domain id 3e419414-ee73-47e8-809d-60de4a88403c >2014-09-26 22:54:13,033 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-10) [7e175449] Lock Acquired to object EngineLock [exclusiveLocks= key: 3e419414-ee73-47e8-809d-60de4a88403c value: STORAGE >, sharedLocks= ] >2014-09-26 22:54:13,040 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-10) [7e175449] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-09-26 22:54:13,048 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-10) [7e175449] Lock freed to object EngineLock [exclusiveLocks= key: 3e419414-ee73-47e8-809d-60de4a88403c value: STORAGE >, sharedLocks= ] >2014-09-26 22:54:13,049 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-10) [7e175449] ActivateStorage Domain. Before Connect all hosts to pool. Time:9/26/14 10:54 PM >2014-09-26 22:54:13,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7e175449] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69efca04 >2014-09-26 22:54:13,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7e175449] FINISH, ConnectStorageServerVDSCommand, return: {af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 69efca04 >2014-09-26 22:54:13,842 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (ajp--127.0.0.1-8702-10) [1937d953] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 22:54:13,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-10) [1937d953] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w), log id: 737a1e8a >2014-09-26 22:54:14,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-10) [1937d953] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=OJXETa-XKwC-GizR-hnvw-Cr7H-UWmH-RQz7RG, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=KgqqOU-mqae-ikMS-Y8eV-8BLg-mdFL-YP4LfA, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null]], log id: 737a1e8a >2014-09-26 22:54:14,522 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-10) [1937d953] START, ActivateStorageDomainVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c), log id: 7c1fce84 >2014-09-26 22:54:16,684 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-10) [1937d953] FINISH, ActivateStorageDomainVDSCommand, log id: 7c1fce84 >2014-09-26 22:54:16,685 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-10) [1937d953] ActivateStorage Domain. After Connect all hosts to pool. Time:9/26/14 10:54 PM >2014-09-26 22:54:16,725 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 5), log id: 68d04a >2014-09-26 22:54:17,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, ConnectStoragePoolVDSCommand, log id: 68d04a >2014-09-26 22:54:17,622 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-27) Refreshed vds voodoo1 in pool iscsi-el7 >2014-09-26 22:54:17,622 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-10) [1937d953] ActivateStorage Domain. After change storage pool status in vds. Time:9/26/14 10:54 PM >2014-09-26 22:54:17,687 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) [1937d953] Correlation ID: 7e175449, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sasha15 (Data Center iscsi-el7) was activated by <UNKNOWN> >2014-09-26 22:54:17,704 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) [1937d953] Correlation ID: 79f72602, Job ID: fc120811-f818-4ccd-aede-9aa3c31509cf, Call Stack: null, Custom Event ID: -1, Message: Storage Domain sasha15 was attached to Data Center iscsi-el7 by admin >2014-09-26 22:55:06,546 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-6) [17b843dc] Lock Acquired to object EngineLock [exclusiveLocks= key: iscsi-el7-vm01 value: VM_NAME >, sharedLocks= ] >2014-09-26 22:55:06,590 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-6) [17b843dc] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: ab1f5d39-0f7d-42da-82d3-1c0364f8c099 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-09-26 22:55:06,772 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [17b843dc] Correlation ID: 17b843dc, Job ID: c86543db-58e3-4b00-9646-b4e82da92484, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was created by admin. >2014-09-26 22:55:06,780 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-6) [17b843dc] Lock freed to object EngineLock [exclusiveLocks= key: iscsi-el7-vm01 value: VM_NAME >, sharedLocks= ] >2014-09-26 22:55:09,070 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp--127.0.0.1-8702-6) [4c5cbd1b] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 551b227c-eaf4-46cc-af32-e247348fa230 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: c0818d05-2a65-4541-a0a1-ee5c25c7ec57 Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-09-26 22:55:09,138 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp--127.0.0.1-8702-6) [53b2fd73] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 551b227c-eaf4-46cc-af32-e247348fa230 Type: VM >2014-09-26 22:55:09,165 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [53b2fd73] Correlation ID: 53b2fd73, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM iscsi-el7-vm01. (User: admin) >2014-09-26 22:55:09,182 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [53b2fd73] Correlation ID: 4c5cbd1b, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM iscsi-el7-vm01. (User: admin) >2014-09-26 22:55:09,569 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp--127.0.0.1-8702-6) [31439a29] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 551b227c-eaf4-46cc-af32-e247348fa230 Type: VMAction group CREATE_VM with role type USER >2014-09-26 22:55:09,589 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [31439a29] Correlation ID: 31439a29, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:56:48,493 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-1) [62265cf0] Lock Acquired to object EngineLock [exclusiveLocks= key: 551b227c-eaf4-46cc-af32-e247348fa230 value: VM_DISK_BOOT >, sharedLocks= key: 551b227c-eaf4-46cc-af32-e247348fa230 value: VM >] >2014-09-26 22:56:48,522 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-1) [62265cf0] Running command: AddDiskCommand internal: false. Entities affected : ID: 551b227c-eaf4-46cc-af32-e247348fa230 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 22:56:48,572 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-1) [5029bbb7] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:56:48,599 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-1) [5029bbb7] Lock freed to object EngineLock [exclusiveLocks= key: 551b227c-eaf4-46cc-af32-e247348fa230 value: VM_DISK_BOOT >, sharedLocks= key: 551b227c-eaf4-46cc-af32-e247348fa230 value: VM >] >2014-09-26 22:56:48,599 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-1) [5029bbb7] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = a256fc11-f9ab-4391-af78-2a96e27fe39b, imageSizeInBytes = 4294967296, volumeFormat = COW, newImageId = 96709bf3-cf37-4fca-b375-0cc28cddcf73, newImageDescription = ), log id: 25a5fcc7 >2014-09-26 22:56:48,601 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-1) [5029bbb7] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:56:48,877 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-1) [5029bbb7] FINISH, CreateImageVDSCommand, return: 96709bf3-cf37-4fca-b375-0cc28cddcf73, log id: 25a5fcc7 >2014-09-26 22:56:48,889 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-1) [5029bbb7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 529a4415-3bfc-4cad-8570-eedbf9d3b719 >2014-09-26 22:56:48,890 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-1) [5029bbb7] CommandMultiAsyncTasks::AttachTask: Attaching task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4 to command 529a4415-3bfc-4cad-8570-eedbf9d3b719. >2014-09-26 22:56:48,913 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-1) [5029bbb7] Adding task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:56:49,022 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) [5029bbb7] Correlation ID: 62265cf0, Job ID: d3378a1f-8f59-4c89-b102-d387660a61d4, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of iscsi-el7-vm01_Disk1 was initiated on VM iscsi-el7-vm01 by admin. >2014-09-26 22:56:49,022 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-1) [5029bbb7] BaseAsyncTask::startPollingTask: Starting to poll task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4. >2014-09-26 22:56:54,951 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) [16ced8a9] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-09-26 22:56:55,174 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [16ced8a9] SPMAsyncTask::PollTask: Polling task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:56:55,209 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [16ced8a9] BaseAsyncTask::onTaskEndSuccess: Task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:56:55,211 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-21) [16ced8a9] CommandAsyncTask::endActionIfNecessary: All tasks of command 529a4415-3bfc-4cad-8570-eedbf9d3b719 has ended -> executing endAction >2014-09-26 22:56:55,212 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-21) [16ced8a9] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 529a4415-3bfc-4cad-8570-eedbf9d3b719): calling endAction . >2014-09-26 22:56:55,213 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) [16ced8a9] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-09-26 22:56:55,234 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-40) [62265cf0] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-09-26 22:56:55,250 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-40) [5029bbb7] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 22:56:55,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [5029bbb7] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = a256fc11-f9ab-4391-af78-2a96e27fe39b, imageId = 96709bf3-cf37-4fca-b375-0cc28cddcf73), log id: 6a0d7b3e >2014-09-26 22:56:55,525 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [5029bbb7] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@b73b5b1d, log id: 6a0d7b3e >2014-09-26 22:56:55,548 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-40) Correlation ID: 62265cf0, Call Stack: null, Custom Event ID: -1, Message: The disk iscsi-el7-vm01_Disk1 was successfully added to VM iscsi-el7-vm01. >2014-09-26 22:56:55,549 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-09-26 22:56:55,549 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-09-26 22:56:55,557 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-40) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4 >2014-09-26 22:56:55,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4), log id: 355ff821 >2014-09-26 22:56:55,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4), log id: 2f9b59e7 >2014-09-26 22:56:55,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) FINISH, HSMClearTaskVDSCommand, log id: 2f9b59e7 >2014-09-26 22:56:55,741 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-40) FINISH, SPMClearTaskVDSCommand, log id: 355ff821 >2014-09-26 22:56:55,755 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-40) BaseAsyncTask::removeTaskFromDB: Removed task 5d2f2b14-14d4-41ee-88f9-1ba0d61b32c4 from DataBase >2014-09-26 22:56:55,756 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-40) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 529a4415-3bfc-4cad-8570-eedbf9d3b719 >2014-09-26 22:57:24,756 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8702-10) [12aa7fc3] Lock Acquired to object EngineLock [exclusiveLocks= key: 551b227c-eaf4-46cc-af32-e247348fa230 value: VM >, sharedLocks= ] >2014-09-26 22:57:24,846 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-26) [12aa7fc3] Running command: RemoveVmCommand internal: false. Entities affected : ID: 551b227c-eaf4-46cc-af32-e247348fa230 Type: VMAction group DELETE_VM with role type USER >2014-09-26 22:57:24,847 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-26) [12aa7fc3] START, SetVmStatusVDSCommand( vmId = 551b227c-eaf4-46cc-af32-e247348fa230, status = ImageLocked, exit status = Normal), log id: 3c9e400d >2014-09-26 22:57:24,849 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-26) [12aa7fc3] FINISH, SetVmStatusVDSCommand, log id: 3c9e400d >2014-09-26 22:57:24,854 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-26) [12aa7fc3] Lock freed to object EngineLock [exclusiveLocks= key: 551b227c-eaf4-46cc-af32-e247348fa230 value: VM >, sharedLocks= ] >2014-09-26 22:57:24,873 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-26) [7c913b19] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 551b227c-eaf4-46cc-af32-e247348fa230 Type: VM >2014-09-26 22:57:24,877 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 22:57:24,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] START, DeleteImageGroupVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = a256fc11-f9ab-4391-af78-2a96e27fe39b, postZeros = false, forceDelete = false), log id: 324edf67 >2014-09-26 22:57:25,580 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] FINISH, DeleteImageGroupVDSCommand, log id: 324edf67 >2014-09-26 22:57:25,618 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 4473c434-5faf-41f9-9619-b5d3af79ae21 >2014-09-26 22:57:25,618 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] CommandMultiAsyncTasks::AttachTask: Attaching task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0 to command 4473c434-5faf-41f9-9619-b5d3af79ae21. >2014-09-26 22:57:25,642 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] Adding task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:57:25,741 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] Correlation ID: 12aa7fc3, Job ID: 71c0a089-b31a-40bb-a70c-4b90326afd81, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was successfully removed. >2014-09-26 22:57:25,742 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) [6caaf28c] BaseAsyncTask::startPollingTask: Starting to poll task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0. >2014-09-26 22:57:35,216 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-3) [7974efa] Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-09-26 22:57:35,420 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-3) [7974efa] SPMAsyncTask::PollTask: Polling task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:57:35,473 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-3) [7974efa] BaseAsyncTask::onTaskEndSuccess: Task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:57:35,474 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-3) [7974efa] CommandAsyncTask::endActionIfNecessary: All tasks of command 4473c434-5faf-41f9-9619-b5d3af79ae21 has ended -> executing endAction >2014-09-26 22:57:35,474 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-3) [7974efa] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 4473c434-5faf-41f9-9619-b5d3af79ae21): calling endAction . >2014-09-26 22:57:35,475 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) [7974efa] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-09-26 22:57:35,498 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-38) [7974efa] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-09-26 22:57:35,499 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) [7974efa] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-09-26 22:57:35,500 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) [7974efa] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-09-26 22:57:35,506 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-38) [7974efa] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0 >2014-09-26 22:57:35,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) [7974efa] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 7d8153dc-6f11-4c4d-a0b9-ae03817871b0), log id: 3272a5ce >2014-09-26 22:57:35,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) [7974efa] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=7d8153dc-6f11-4c4d-a0b9-ae03817871b0), log id: 4e39142 >2014-09-26 22:57:35,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) [7974efa] FINISH, HSMClearTaskVDSCommand, log id: 4e39142 >2014-09-26 22:57:35,694 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) [7974efa] FINISH, SPMClearTaskVDSCommand, log id: 3272a5ce >2014-09-26 22:57:35,722 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-38) [7974efa] BaseAsyncTask::removeTaskFromDB: Removed task 7d8153dc-6f11-4c4d-a0b9-ae03817871b0 from DataBase >2014-09-26 22:57:35,723 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) [7974efa] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 4473c434-5faf-41f9-9619-b5d3af79ae21 >2014-09-26 22:58:01,662 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-59) [6eec24d0] Setting new tasks map. The map contains now 1 tasks >2014-09-26 22:58:13,422 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-3) [16916374] Lock Acquired to object EngineLock [exclusiveLocks= key: iscsi-el7-vm01 value: VM_NAME >, sharedLocks= ] >2014-09-26 22:58:13,459 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-3) [16916374] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: ab1f5d39-0f7d-42da-82d3-1c0364f8c099 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-09-26 22:58:13,525 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [16916374] Correlation ID: 16916374, Job ID: 81a38aef-b910-4a2b-bbe7-f2ab2c89f87a, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was created by admin. >2014-09-26 22:58:13,533 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-3) [16916374] Lock freed to object EngineLock [exclusiveLocks= key: iscsi-el7-vm01 value: VM_NAME >, sharedLocks= ] >2014-09-26 22:58:15,091 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp--127.0.0.1-8702-10) [403fa8be] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: c0818d05-2a65-4541-a0a1-ee5c25c7ec57 Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-09-26 22:58:15,154 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp--127.0.0.1-8702-10) [4f10229d] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VM >2014-09-26 22:58:15,181 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) [4f10229d] Correlation ID: 4f10229d, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM iscsi-el7-vm01. (User: admin) >2014-09-26 22:58:15,198 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) [4f10229d] Correlation ID: 403fa8be, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM iscsi-el7-vm01. (User: admin) >2014-09-26 22:58:15,564 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp--127.0.0.1-8702-3) [1aa6ef0f] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group CREATE_VM with role type USER >2014-09-26 22:58:15,579 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [1aa6ef0f] Correlation ID: 1aa6ef0f, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 22:58:27,055 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-10) [308e7bb6] Lock Acquired to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM_DISK_BOOT >, sharedLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >] >2014-09-26 22:58:27,084 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-10) [308e7bb6] Running command: AddDiskCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 22:58:27,134 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-10) [434ca263] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 22:58:27,142 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-10) [434ca263] Lock freed to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM_DISK_BOOT >, sharedLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >] >2014-09-26 22:58:27,143 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-10) [434ca263] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 9288c7e8-43fd-4174-9889-634fb2e0437a, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = fea5e854-3449-4ac4-abe8-58eb8e46dd9b, newImageDescription = ), log id: 4349fdad >2014-09-26 22:58:27,144 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-10) [434ca263] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:58:27,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-10) [434ca263] FINISH, CreateImageVDSCommand, return: fea5e854-3449-4ac4-abe8-58eb8e46dd9b, log id: 4349fdad >2014-09-26 22:58:27,458 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-10) [434ca263] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 357e4c50-b06f-4a71-90b9-0d4f220cd685 >2014-09-26 22:58:27,458 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-10) [434ca263] CommandMultiAsyncTasks::AttachTask: Attaching task 02e0cbbf-afa2-40c3-a787-ffc4d1848228 to command 357e4c50-b06f-4a71-90b9-0d4f220cd685. >2014-09-26 22:58:27,482 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-10) [434ca263] Adding task 02e0cbbf-afa2-40c3-a787-ffc4d1848228 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:58:27,590 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-10) [434ca263] Correlation ID: 308e7bb6, Job ID: a97358f8-0b57-4094-b6c4-6e4232668428, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of iscsi-el7-vm01_Disk1 was initiated on VM iscsi-el7-vm01 by admin. >2014-09-26 22:58:27,590 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-10) [434ca263] BaseAsyncTask::startPollingTask: Starting to poll task 02e0cbbf-afa2-40c3-a787-ffc4d1848228. >2014-09-26 22:58:33,088 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-7) [7a47a74f] Lock Acquired to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 22:58:33,115 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-7) [7a47a74f] START, IsVmDuringInitiatingVDSCommand( vmId = 723d6de8-7192-48ff-8561-51859bf33a69), log id: 23bd896e >2014-09-26 22:58:33,115 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-7) [7a47a74f] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 23bd896e >2014-09-26 22:58:33,118 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-7) [7a47a74f] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_DISKS_LOCKED,$diskAliases iscsi-el7-vm01_Disk1 >2014-09-26 22:58:33,118 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-7) [7a47a74f] Lock freed to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 22:58:35,479 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) [7c391780] Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-09-26 22:58:35,652 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) [7c391780] SPMAsyncTask::PollTask: Polling task 02e0cbbf-afa2-40c3-a787-ffc4d1848228 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:58:35,681 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) [7c391780] BaseAsyncTask::onTaskEndSuccess: Task 02e0cbbf-afa2-40c3-a787-ffc4d1848228 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:58:35,682 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-14) [7c391780] CommandAsyncTask::endActionIfNecessary: All tasks of command 357e4c50-b06f-4a71-90b9-0d4f220cd685 has ended -> executing endAction >2014-09-26 22:58:35,682 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-14) [7c391780] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 357e4c50-b06f-4a71-90b9-0d4f220cd685): calling endAction . >2014-09-26 22:58:35,683 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-49) [7c391780] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-09-26 22:58:35,706 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-49) [308e7bb6] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-09-26 22:58:35,722 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-49) [434ca263] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 22:58:35,727 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) [434ca263] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 9288c7e8-43fd-4174-9889-634fb2e0437a, imageId = fea5e854-3449-4ac4-abe8-58eb8e46dd9b), log id: 14922617 >2014-09-26 22:58:36,039 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-49) [434ca263] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@43de3429, log id: 14922617 >2014-09-26 22:58:36,053 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-49) Correlation ID: 308e7bb6, Call Stack: null, Custom Event ID: -1, Message: The disk iscsi-el7-vm01_Disk1 was successfully added to VM iscsi-el7-vm01. >2014-09-26 22:58:36,054 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-09-26 22:58:36,054 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-09-26 22:58:36,062 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 02e0cbbf-afa2-40c3-a787-ffc4d1848228 >2014-09-26 22:58:36,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 02e0cbbf-afa2-40c3-a787-ffc4d1848228), log id: 7fac5b5b >2014-09-26 22:58:36,468 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-49) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=02e0cbbf-afa2-40c3-a787-ffc4d1848228), log id: 537a1948 >2014-09-26 22:58:36,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 537a1948 >2014-09-26 22:58:36,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 7fac5b5b >2014-09-26 22:58:36,658 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-49) BaseAsyncTask::removeTaskFromDB: Removed task 02e0cbbf-afa2-40c3-a787-ffc4d1848228 from DataBase >2014-09-26 22:58:36,659 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 357e4c50-b06f-4a71-90b9-0d4f220cd685 >2014-09-26 22:58:37,930 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-7) [974256] Lock Acquired to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 22:58:37,953 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-7) [974256] START, IsVmDuringInitiatingVDSCommand( vmId = 723d6de8-7192-48ff-8561-51859bf33a69), log id: f99d514 >2014-09-26 22:58:37,953 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-7) [974256] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: f99d514 >2014-09-26 22:58:38,033 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-11) [974256] Running command: RunVmCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 22:58:38,072 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] START, UpdateVmDynamicDataVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@d22e619a), log id: 3a27de6d >2014-09-26 22:58:38,083 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] FINISH, UpdateVmDynamicDataVDSCommand, log id: 3a27de6d >2014-09-26 22:58:38,086 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] START, CreateVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69, vm=VM [iscsi-el7-vm01]), log id: 74ef369f >2014-09-26 22:58:38,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] START, CreateVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69, vm=VM [iscsi-el7-vm01]), log id: 3cf62507 >2014-09-26 22:58:38,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=723d6de8-7192-48ff-8561-51859bf33a69,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=512,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=preferred},maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=3e25d98b-1eb7-43f4-91a6-27ea1f7c62d4}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=c7a70c12-b359-42d3-a23a-9ccfb3335a2d}, {shared=false, index=0, volumeID=fea5e854-3449-4ac4-abe8-58eb8e46dd9b, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=1, domainID=ff559f46-c495-4f6b-901c-2a624042a050, imageID=9288c7e8-43fd-4174-9889-634fb2e0437a, specParams={}, optional=false, device=disk, poolID=b86b687a-d073-497a-ac8a-249025419a3e, readonly=false, deviceId=9288c7e8-43fd-4174-9889-634fb2e0437a}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:ab:e1:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=3df36618-fdc5-4a79-98ed-31dbe61a4b02}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=0325a583-bc11-4a1a-8436-6891b12c4cea}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=60ebd33c-7022-42fd-8406-c878696900e1}, {specParams={}, device=virtio-serial, type=controller, deviceId=15ae6083-4f11-464e-8a8d-d25799ff45cc}],vmName=iscsi-el7-vm01,cpuType=Haswell,fileTransferEnable=true >2014-09-26 22:58:38,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] FINISH, CreateVDSCommand, log id: 3cf62507 >2014-09-26 22:58:38,762 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-11) [974256] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 74ef369f >2014-09-26 22:58:38,762 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-11) [974256] Lock freed to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 22:58:38,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-11) [974256] Correlation ID: 974256, Job ID: 544148e6-81a9-454f-b363-192b5eaa524b, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was started by admin (Host: voodoo1). >2014-09-26 22:58:43,040 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) [1d2512cb] VM iscsi-el7-vm01 723d6de8-7192-48ff-8561-51859bf33a69 moved from WaitForLaunch --> PoweringUp >2014-09-26 22:58:43,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-23) [1d2512cb] START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[723d6de8-7192-48ff-8561-51859bf33a69]), log id: 7aa205f1 >2014-09-26 22:58:43,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-23) [1d2512cb] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, pitReinjection=false, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=723d6de8-7192-48ff-8561-51859bf33a69, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=29958, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@65a19dd0, vmName=iscsi-el7-vm01, fileTransferEnable=true, cpuType=Haswell}], log id: 7aa205f1 >2014-09-26 22:58:43,219 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) [1d2512cb] Received a spice Device without an address when processing VM 723d6de8-7192-48ff-8561-51859bf33a69 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 22:58:53,637 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The Balloon device on VM iscsi-el7-vm01 on host voodoo1 is inflated but the device cannot be controlled (guest agent is down). >2014-09-26 22:58:56,069 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-3) [41496022] Lock Acquired to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 22:58:56,122 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-48) Command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13 persisting async task placeholder for child command 305b3f6e-1537-4433-883e-3686dc1495d9 >2014-09-26 22:58:56,196 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-48) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-09-26 22:58:56,221 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 22:58:56,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] START, CreateSnapshotVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 9288c7e8-43fd-4174-9889-634fb2e0437a, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 07ebf60e-a89b-462b-9ca6-ed0cbf59e61c, newImageDescription = , imageId = fea5e854-3449-4ac4-abe8-58eb8e46dd9b, sourceImageGroupId = 9288c7e8-43fd-4174-9889-634fb2e0437a), log id: 309aebbb >2014-09-26 22:58:56,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:58:56,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] FINISH, CreateSnapshotVDSCommand, return: 07ebf60e-a89b-462b-9ca6-ed0cbf59e61c, log id: 309aebbb >2014-09-26 22:58:56,445 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13 >2014-09-26 22:58:56,446 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] CommandMultiAsyncTasks::AttachTask: Attaching task 676bdca9-48d1-43fe-ba37-45cadedb15e0 to command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13. >2014-09-26 22:58:56,469 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-48) [2f3c1672] Adding task 676bdca9-48d1-43fe-ba37-45cadedb15e0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:58:56,521 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-48) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 2c592d17-7d33-44bc-9ca8-d5585f3c9bd7, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 70aafeeb-6307-4451-a558-d707310667ab, newImageDescription = ), log id: 56df3ef3 >2014-09-26 22:58:56,524 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-48) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:58:56,735 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-48) FINISH, CreateImageVDSCommand, return: 70aafeeb-6307-4451-a558-d707310667ab, log id: 56df3ef3 >2014-09-26 22:58:56,760 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-48) CommandMultiAsyncTasks::AttachTask: Attaching task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 to command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13. >2014-09-26 22:58:56,776 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-48) Adding task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:58:56,785 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-48) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 3df5509e-4312-4967-a01a-db5de88b954b, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 58b9b9f8-b2c7-441f-acdb-2c0616dff271, newImageDescription = ), log id: 73c061d6 >2014-09-26 22:58:56,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-48) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 22:58:57,282 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-48) FINISH, CreateImageVDSCommand, return: 58b9b9f8-b2c7-441f-acdb-2c0616dff271, log id: 73c061d6 >2014-09-26 22:58:57,306 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-48) CommandMultiAsyncTasks::AttachTask: Attaching task 32d53632-bdd7-4638-a992-eb40e7751e9c to command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13. >2014-09-26 22:58:57,322 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-48) Adding task 32d53632-bdd7-4638-a992-eb40e7751e9c (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 22:58:57,364 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-48) Correlation ID: 41496022, Job ID: 477739fc-0347-4d87-9a20-268cc26dc839, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'iscsi-el7-vm01' was initiated by admin. >2014-09-26 22:58:57,364 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) BaseAsyncTask::startPollingTask: Starting to poll task 676bdca9-48d1-43fe-ba37-45cadedb15e0. >2014-09-26 22:58:57,364 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) BaseAsyncTask::startPollingTask: Starting to poll task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4. >2014-09-26 22:58:57,365 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) BaseAsyncTask::startPollingTask: Starting to poll task 32d53632-bdd7-4638-a992-eb40e7751e9c. >2014-09-26 22:59:01,662 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-34) [397bb7b7] Setting new tasks map. The map contains now 4 tasks >2014-09-26 22:59:05,683 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-19) [8e75a14] Polling and updating Async Tasks: 4 tasks, 3 tasks to poll now >2014-09-26 22:59:05,853 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] SPMAsyncTask::PollTask: Polling task 676bdca9-48d1-43fe-ba37-45cadedb15e0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:59:05,912 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] BaseAsyncTask::onTaskEndSuccess: Task 676bdca9-48d1-43fe-ba37-45cadedb15e0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:59:05,912 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-19) [8e75a14] Task with DB Task ID cc3b85e7-96cd-4a22-a037-73b8c0148d1d and VDSM Task ID 32d53632-bdd7-4638-a992-eb40e7751e9c is in state Polling. End action for command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13 will proceed when all the entitys tasks are completed. >2014-09-26 22:59:05,913 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] SPMAsyncTask::PollTask: Polling task 32d53632-bdd7-4638-a992-eb40e7751e9c (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:59:05,920 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] BaseAsyncTask::onTaskEndSuccess: Task 32d53632-bdd7-4638-a992-eb40e7751e9c (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:59:05,921 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-19) [8e75a14] Task with DB Task ID d1f7b7c3-5dba-4320-8340-b9893fd75aa0 and VDSM Task ID 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 is in state Polling. End action for command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13 will proceed when all the entitys tasks are completed. >2014-09-26 22:59:05,921 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] SPMAsyncTask::PollTask: Polling task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 22:59:05,928 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] BaseAsyncTask::onTaskEndSuccess: Task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 22:59:05,929 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] CommandAsyncTask::endActionIfNecessary: All tasks of command 483f00fa-e1e9-4a20-8dbf-f8c59a468a13 has ended -> executing endAction >2014-09-26 22:59:05,929 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-19) [8e75a14] CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 483f00fa-e1e9-4a20-8dbf-f8c59a468a13): calling endAction . >2014-09-26 22:59:05,930 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) [8e75a14] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-09-26 22:59:05,970 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-9) [8e75a14] Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-09-26 22:59:05,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-9) [8e75a14] START, SnapshotVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69), log id: 63d87987 >2014-09-26 22:59:09,348 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-9) [8e75a14] FINISH, SnapshotVDSCommand, log id: 63d87987 >2014-09-26 22:59:09,399 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-9) [2f3c1672] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-09-26 22:59:09,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-9) [2f3c1672] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 9288c7e8-43fd-4174-9889-634fb2e0437a, imageId = 07ebf60e-a89b-462b-9ca6-ed0cbf59e61c), log id: 11f4548d >2014-09-26 22:59:09,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-9) [2f3c1672] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9eff2914, log id: 11f4548d >2014-09-26 22:59:09,634 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-9) Lock freed to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 22:59:09,655 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-9) Correlation ID: 41496022, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'iscsi-el7-vm01' has been completed. >2014-09-26 22:59:09,655 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-09-26 22:59:09,656 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-09-26 22:59:09,663 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 676bdca9-48d1-43fe-ba37-45cadedb15e0 >2014-09-26 22:59:09,664 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 676bdca9-48d1-43fe-ba37-45cadedb15e0), log id: 505b5e54 >2014-09-26 22:59:09,665 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=676bdca9-48d1-43fe-ba37-45cadedb15e0), log id: 1e8e0603 >2014-09-26 22:59:09,862 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, HSMClearTaskVDSCommand, log id: 1e8e0603 >2014-09-26 22:59:09,862 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, SPMClearTaskVDSCommand, log id: 505b5e54 >2014-09-26 22:59:09,870 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) BaseAsyncTask::removeTaskFromDB: Removed task 676bdca9-48d1-43fe-ba37-45cadedb15e0 from DataBase >2014-09-26 22:59:09,870 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 32d53632-bdd7-4638-a992-eb40e7751e9c >2014-09-26 22:59:09,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 32d53632-bdd7-4638-a992-eb40e7751e9c), log id: 2644a3a2 >2014-09-26 22:59:09,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=32d53632-bdd7-4638-a992-eb40e7751e9c), log id: 6452f44e >2014-09-26 22:59:10,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, HSMClearTaskVDSCommand, log id: 6452f44e >2014-09-26 22:59:10,091 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, SPMClearTaskVDSCommand, log id: 2644a3a2 >2014-09-26 22:59:10,102 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) BaseAsyncTask::removeTaskFromDB: Removed task 32d53632-bdd7-4638-a992-eb40e7751e9c from DataBase >2014-09-26 22:59:10,103 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 >2014-09-26 22:59:10,104 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 95ddb4e9-583d-45a0-98af-c9797f2ccfc4), log id: 7c4b5c45 >2014-09-26 22:59:10,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=95ddb4e9-583d-45a0-98af-c9797f2ccfc4), log id: 3796f5c3 >2014-09-26 22:59:10,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, HSMClearTaskVDSCommand, log id: 3796f5c3 >2014-09-26 22:59:10,372 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, SPMClearTaskVDSCommand, log id: 7c4b5c45 >2014-09-26 22:59:10,384 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-9) BaseAsyncTask::removeTaskFromDB: Removed task 95ddb4e9-583d-45a0-98af-c9797f2ccfc4 from DataBase >2014-09-26 22:59:10,385 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-9) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 483f00fa-e1e9-4a20-8dbf-f8c59a468a13 >2014-09-26 22:59:11,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-38) [6a1b6cd3] START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[723d6de8-7192-48ff-8561-51859bf33a69]), log id: 664ab14 >2014-09-26 22:59:11,226 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-38) [6a1b6cd3] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, pitReinjection=false, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=723d6de8-7192-48ff-8561-51859bf33a69, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=29958, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@3b1bb153, vmName=iscsi-el7-vm01, fileTransferEnable=true, cpuType=Haswell}], log id: 664ab14 >2014-09-26 22:59:11,232 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-38) [6a1b6cd3] Received a spice Device without an address when processing VM 723d6de8-7192-48ff-8561-51859bf33a69 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 22:59:39,173 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) VM iscsi-el7-vm01 723d6de8-7192-48ff-8561-51859bf33a69 moved from PoweringUp --> Up >2014-09-26 22:59:39,233 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) Correlation ID: 974256, Job ID: 544148e6-81a9-454f-b363-192b5eaa524b, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 started on Host voodoo1 >2014-09-26 23:00:01,663 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-12) Setting new tasks map. The map contains now 3 tasks >2014-09-26 23:00:16,901 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 23:00:16,902 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] Entered (VM iscsi-el7-vm01). >2014-09-26 23:00:16,902 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] Sending shutdown command for VM iscsi-el7-vm01. >2014-09-26 23:00:16,903 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] START, DestroyVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69, force=false, secondsToWait=30, gracefully=true, reason=), log id: 42c6d9e >2014-09-26 23:00:16,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] START, DestroyVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69, force=false, secondsToWait=30, gracefully=true, reason=), log id: 2232177f >2014-09-26 23:00:17,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] FINISH, DestroyVDSCommand, log id: 2232177f >2014-09-26 23:00:17,158 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [242aa482] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 42c6d9e >2014-09-26 23:00:17,175 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [242aa482] Correlation ID: 242aa482, Job ID: 6e60a560-2a14-415c-96b4-65ae16db8014, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM iscsi-el7-vm01 (Host: voodoo1) (Reason: Not Specified). >2014-09-26 23:00:28,903 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-2) [50e76029] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 23:00:28,904 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-2) [50e76029] Entered (VM iscsi-el7-vm01). >2014-09-26 23:00:28,905 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-2) [50e76029] Cannot shutdown VM iscsi-el7-vm01, status is not up. Stopping instead. >2014-09-26 23:00:28,936 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-2) [7e0841e1] Running command: StopVmCommand internal: true. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 23:00:28,938 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-2) [7e0841e1] START, DestroyVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69, force=false, secondsToWait=0, gracefully=false, reason=), log id: 410b44c3 >2014-09-26 23:00:28,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-2) [7e0841e1] START, DestroyVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=723d6de8-7192-48ff-8561-51859bf33a69, force=false, secondsToWait=0, gracefully=false, reason=), log id: 2c2e8d34 >2014-09-26 23:00:29,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-2) [7e0841e1] FINISH, DestroyVDSCommand, log id: 2c2e8d34 >2014-09-26 23:00:30,012 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-2) [7e0841e1] FINISH, DestroyVmVDSCommand, return: Down, log id: 410b44c3 >2014-09-26 23:00:30,028 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-2) [7e0841e1] Correlation ID: 7e0841e1, Job ID: 8877d93d-82c8-4a1a-82c2-93837023f119, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was powered off ungracefully by admin (Host: voodoo1) (Reason: Not Specified). >2014-09-26 23:00:30,045 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-42) [5161b785] Running command: ProcessDownVmCommand internal: true. >2014-09-26 23:00:31,664 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-45) [5683a545] Setting new tasks map. The map contains now 0 tasks >2014-09-26 23:00:31,664 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-45) [5683a545] Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 23:00:45,623 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8702-1) [76891c4d] Lock Acquired to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 23:00:45,725 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-19) [76891c4d] Running command: RemoveVmCommand internal: false. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VMAction group DELETE_VM with role type USER >2014-09-26 23:00:45,725 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76891c4d] START, SetVmStatusVDSCommand( vmId = 723d6de8-7192-48ff-8561-51859bf33a69, status = ImageLocked, exit status = Normal), log id: 1871b4a4 >2014-09-26 23:00:45,727 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76891c4d] FINISH, SetVmStatusVDSCommand, log id: 1871b4a4 >2014-09-26 23:00:45,733 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-19) [76891c4d] Lock freed to object EngineLock [exclusiveLocks= key: 723d6de8-7192-48ff-8561-51859bf33a69 value: VM >, sharedLocks= ] >2014-09-26 23:00:45,736 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-19) [357d9d61] Running command: RemoveMemoryVolumesCommand internal: true. >2014-09-26 23:00:45,751 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-19) [161d20b3] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 723d6de8-7192-48ff-8561-51859bf33a69 Type: VM >2014-09-26 23:00:45,755 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-19) [27403461] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 23:00:45,800 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-19) [27403461] START, DeleteImageGroupVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 9288c7e8-43fd-4174-9889-634fb2e0437a, postZeros = false, forceDelete = false), log id: 3944a027 >2014-09-26 23:00:46,448 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-19) [27403461] FINISH, DeleteImageGroupVDSCommand, log id: 3944a027 >2014-09-26 23:00:46,505 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-19) [27403461] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0f58e0c6-2b4a-4f1a-9c4c-1d94ae447860 >2014-09-26 23:00:46,506 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-19) [27403461] CommandMultiAsyncTasks::AttachTask: Attaching task 53619166-ba58-4b19-beaa-0fdafe6cd57b to command 0f58e0c6-2b4a-4f1a-9c4c-1d94ae447860. >2014-09-26 23:00:46,528 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-19) [27403461] Adding task 53619166-ba58-4b19-beaa-0fdafe6cd57b (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:00:46,636 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-19) [27403461] Correlation ID: 76891c4d, Job ID: e94769db-38d4-404d-b2e2-a661a4ac4e55, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was successfully removed. >2014-09-26 23:00:46,636 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-19) [27403461] BaseAsyncTask::startPollingTask: Starting to poll task 53619166-ba58-4b19-beaa-0fdafe6cd57b. >2014-09-26 23:00:55,931 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-44) [6169e17d] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-09-26 23:00:56,167 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) [6169e17d] SPMAsyncTask::PollTask: Polling task 53619166-ba58-4b19-beaa-0fdafe6cd57b (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:00:56,194 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) [6169e17d] BaseAsyncTask::onTaskEndSuccess: Task 53619166-ba58-4b19-beaa-0fdafe6cd57b (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:00:56,195 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-44) [6169e17d] CommandAsyncTask::endActionIfNecessary: All tasks of command 0f58e0c6-2b4a-4f1a-9c4c-1d94ae447860 has ended -> executing endAction >2014-09-26 23:00:56,195 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-44) [6169e17d] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 0f58e0c6-2b4a-4f1a-9c4c-1d94ae447860): calling endAction . >2014-09-26 23:00:56,196 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) [6169e17d] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-09-26 23:00:56,219 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-43) [6169e17d] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-09-26 23:00:56,220 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) [6169e17d] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-09-26 23:00:56,220 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) [6169e17d] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-09-26 23:00:56,228 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) [6169e17d] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 53619166-ba58-4b19-beaa-0fdafe6cd57b >2014-09-26 23:00:56,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) [6169e17d] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 53619166-ba58-4b19-beaa-0fdafe6cd57b), log id: 359ac043 >2014-09-26 23:00:56,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) [6169e17d] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=53619166-ba58-4b19-beaa-0fdafe6cd57b), log id: 42c48a33 >2014-09-26 23:00:56,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) [6169e17d] FINISH, HSMClearTaskVDSCommand, log id: 42c48a33 >2014-09-26 23:00:56,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) [6169e17d] FINISH, SPMClearTaskVDSCommand, log id: 359ac043 >2014-09-26 23:00:56,468 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) [6169e17d] BaseAsyncTask::removeTaskFromDB: Removed task 53619166-ba58-4b19-beaa-0fdafe6cd57b from DataBase >2014-09-26 23:00:56,469 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) [6169e17d] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0f58e0c6-2b4a-4f1a-9c4c-1d94ae447860 >2014-09-26 23:02:01,665 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-32) Setting new tasks map. The map contains now 0 tasks >2014-09-26 23:02:01,666 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-32) Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 23:02:59,039 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-7) [3a8d3624] Lock Acquired to object EngineLock [exclusiveLocks= key: iscsi-el7-vm01 value: VM_NAME >, sharedLocks= ] >2014-09-26 23:02:59,068 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-7) [3a8d3624] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: ab1f5d39-0f7d-42da-82d3-1c0364f8c099 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-09-26 23:02:59,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [3a8d3624] Correlation ID: 3a8d3624, Job ID: 6bec4e0d-387c-4fd1-8c2c-9f0a726be1a9, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was created by admin. >2014-09-26 23:02:59,144 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp--127.0.0.1-8702-7) [3a8d3624] Lock freed to object EngineLock [exclusiveLocks= key: iscsi-el7-vm01 value: VM_NAME >, sharedLocks= ] >2014-09-26 23:03:00,834 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp--127.0.0.1-8702-7) [1ad58f7c] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: c0818d05-2a65-4541-a0a1-ee5c25c7ec57 Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-09-26 23:03:00,973 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp--127.0.0.1-8702-7) [7740726c] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VM >2014-09-26 23:03:01,049 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [7740726c] Correlation ID: 7740726c, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM iscsi-el7-vm01. (User: admin) >2014-09-26 23:03:01,173 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [7740726c] Correlation ID: 1ad58f7c, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM iscsi-el7-vm01. (User: admin) >2014-09-26 23:03:01,608 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp--127.0.0.1-8702-7) [30d4f18] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group CREATE_VM with role type USER >2014-09-26 23:03:01,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [30d4f18] Correlation ID: 30d4f18, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 23:03:12,871 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-11) [33a8f8ef] Lock Acquired to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM_DISK_BOOT >, sharedLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >] >2014-09-26 23:03:12,900 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-11) [33a8f8ef] Running command: AddDiskCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 23:03:12,950 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-11) [7ce7724d] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 23:03:12,959 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp--127.0.0.1-8702-11) [7ce7724d] Lock freed to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM_DISK_BOOT >, sharedLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >] >2014-09-26 23:03:12,959 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-11) [7ce7724d] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 60e28edc-4bb3-4f87-b6a2-5dc45f1a0971, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = d52154e3-52b0-4e20-b433-276e45b1ed63, newImageDescription = ), log id: 4d6a395f >2014-09-26 23:03:12,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-11) [7ce7724d] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 23:03:13,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp--127.0.0.1-8702-11) [7ce7724d] FINISH, CreateImageVDSCommand, return: d52154e3-52b0-4e20-b433-276e45b1ed63, log id: 4d6a395f >2014-09-26 23:03:13,224 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-11) [7ce7724d] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command f0c9bcb6-3d79-46bc-a59d-dd2fd7f77924 >2014-09-26 23:03:13,225 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-11) [7ce7724d] CommandMultiAsyncTasks::AttachTask: Attaching task ec8297a3-238d-4074-8474-7b83c4557764 to command f0c9bcb6-3d79-46bc-a59d-dd2fd7f77924. >2014-09-26 23:03:13,249 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-11) [7ce7724d] Adding task ec8297a3-238d-4074-8474-7b83c4557764 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:03:13,357 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [7ce7724d] Correlation ID: 33a8f8ef, Job ID: 43e62244-73e0-4a74-af6f-8bdfc4831f92, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of iscsi-el7-vm01_Disk1 was initiated on VM iscsi-el7-vm01 by admin. >2014-09-26 23:03:13,357 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-11) [7ce7724d] BaseAsyncTask::startPollingTask: Starting to poll task ec8297a3-238d-4074-8474-7b83c4557764. >2014-09-26 23:03:16,199 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-50) [2747abd8] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-09-26 23:03:16,373 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) [2747abd8] SPMAsyncTask::PollTask: Polling task ec8297a3-238d-4074-8474-7b83c4557764 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:03:16,388 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) [2747abd8] BaseAsyncTask::onTaskEndSuccess: Task ec8297a3-238d-4074-8474-7b83c4557764 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:03:16,390 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-50) [2747abd8] CommandAsyncTask::endActionIfNecessary: All tasks of command f0c9bcb6-3d79-46bc-a59d-dd2fd7f77924 has ended -> executing endAction >2014-09-26 23:03:16,390 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-50) [2747abd8] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: f0c9bcb6-3d79-46bc-a59d-dd2fd7f77924): calling endAction . >2014-09-26 23:03:16,391 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) [2747abd8] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-09-26 23:03:16,430 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-6) [33a8f8ef] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-09-26 23:03:16,446 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-6) [7ce7724d] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 23:03:16,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-6) [7ce7724d] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 60e28edc-4bb3-4f87-b6a2-5dc45f1a0971, imageId = d52154e3-52b0-4e20-b433-276e45b1ed63), log id: efb9525 >2014-09-26 23:03:16,722 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-6) [7ce7724d] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f078c796, log id: efb9525 >2014-09-26 23:03:16,752 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-6) Correlation ID: 33a8f8ef, Call Stack: null, Custom Event ID: -1, Message: The disk iscsi-el7-vm01_Disk1 was successfully added to VM iscsi-el7-vm01. >2014-09-26 23:03:16,753 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-09-26 23:03:16,753 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-09-26 23:03:16,761 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-6) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ec8297a3-238d-4074-8474-7b83c4557764 >2014-09-26 23:03:16,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = ec8297a3-238d-4074-8474-7b83c4557764), log id: 43a66ce5 >2014-09-26 23:03:16,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=ec8297a3-238d-4074-8474-7b83c4557764), log id: 168c0d3b >2014-09-26 23:03:16,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) FINISH, HSMClearTaskVDSCommand, log id: 168c0d3b >2014-09-26 23:03:16,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) FINISH, SPMClearTaskVDSCommand, log id: 43a66ce5 >2014-09-26 23:03:16,993 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-6) BaseAsyncTask::removeTaskFromDB: Removed task ec8297a3-238d-4074-8474-7b83c4557764 from DataBase >2014-09-26 23:03:16,993 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity f0c9bcb6-3d79-46bc-a59d-dd2fd7f77924 >2014-09-26 23:03:24,115 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-6) [3ad4521c] Lock Acquired to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >, sharedLocks= ] >2014-09-26 23:03:24,144 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-6) [3ad4521c] START, IsVmDuringInitiatingVDSCommand( vmId = d4ded5f8-6767-486b-8699-c1636b08eb22), log id: 69617431 >2014-09-26 23:03:24,144 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-6) [3ad4521c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 69617431 >2014-09-26 23:03:24,265 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] Running command: RunVmCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 23:03:24,314 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] START, UpdateVmDynamicDataVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@ef29f0da), log id: 7ebed2f2 >2014-09-26 23:03:24,323 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] FINISH, UpdateVmDynamicDataVDSCommand, log id: 7ebed2f2 >2014-09-26 23:03:24,328 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] START, CreateVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, vm=VM [iscsi-el7-vm01]), log id: 468a3471 >2014-09-26 23:03:24,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] START, CreateVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, vm=VM [iscsi-el7-vm01]), log id: 41b66a30 >2014-09-26 23:03:24,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=d4ded5f8-6767-486b-8699-c1636b08eb22,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=512,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=preferred},maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=fbd8802e-7d7d-4c3d-bdc3-d5e99d1965b0}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=21ff3b9b-b371-4f8d-96df-9b66d2dc8462}, {shared=false, index=0, volumeID=d52154e3-52b0-4e20-b433-276e45b1ed63, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=1, domainID=ff559f46-c495-4f6b-901c-2a624042a050, imageID=60e28edc-4bb3-4f87-b6a2-5dc45f1a0971, specParams={}, optional=false, device=disk, poolID=b86b687a-d073-497a-ac8a-249025419a3e, readonly=false, deviceId=60e28edc-4bb3-4f87-b6a2-5dc45f1a0971}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:ab:e1:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=02f92e76-54fc-41ad-92c0-13c216be43c4}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=e0711e02-d8f0-46ef-8068-32a52405fadb}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=9e772ce2-9357-4f58-84cf-b7ed4c9a8ee5}, {specParams={}, device=virtio-serial, type=controller, deviceId=1e9bd1b4-c66b-4d07-80ab-0940e266c740}],vmName=iscsi-el7-vm01,cpuType=Haswell,fileTransferEnable=true >2014-09-26 23:03:24,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] FINISH, CreateVDSCommand, log id: 41b66a30 >2014-09-26 23:03:24,961 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 468a3471 >2014-09-26 23:03:24,962 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] Lock freed to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >, sharedLocks= ] >2014-09-26 23:03:24,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-43) [3ad4521c] Correlation ID: 3ad4521c, Job ID: ce407ffd-74bb-49ae-bdd8-667c5712015b, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was started by admin (Host: voodoo1). >2014-09-26 23:03:25,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[d4ded5f8-6767-486b-8699-c1636b08eb22]), log id: 2ad49b31 >2014-09-26 23:03:26,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, pitReinjection=false, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=WaitForLaunch, memGuaranteedSize=512, display=qxl, pid=1341, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@7043c6c3, vmName=iscsi-el7-vm01, fileTransferEnable=true, cpuType=Haswell}], log id: 2ad49b31 >2014-09-26 23:03:26,104 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) Received a spice Device without an address when processing VM d4ded5f8-6767-486b-8699-c1636b08eb22 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 23:03:29,626 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) [3943bcef] VM iscsi-el7-vm01 d4ded5f8-6767-486b-8699-c1636b08eb22 moved from WaitForLaunch --> PoweringUp >2014-09-26 23:03:29,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) [3943bcef] START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[d4ded5f8-6767-486b-8699-c1636b08eb22]), log id: 56705a82 >2014-09-26 23:03:29,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) [3943bcef] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, pitReinjection=false, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=1341, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6a463923, vmName=iscsi-el7-vm01, fileTransferEnable=true, cpuType=Haswell}], log id: 56705a82 >2014-09-26 23:03:29,854 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) [3943bcef] Received a spice Device without an address when processing VM d4ded5f8-6767-486b-8699-c1636b08eb22 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 23:03:40,266 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The Balloon device on VM iscsi-el7-vm01 on host voodoo1 is inflated but the device cannot be controlled (guest agent is down). >2014-09-26 23:03:44,954 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-1) [95d4f49] Lock Acquired to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >, sharedLocks= ] >2014-09-26 23:03:45,011 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Command 27879fe9-c6e4-46be-9fda-e78cdb862390 persisting async task placeholder for child command fba26464-ca2f-4a87-90b2-97ce7951fb6e >2014-09-26 23:03:45,085 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-09-26 23:03:45,110 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-7) [50286f6d] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 23:03:45,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) [50286f6d] START, CreateSnapshotVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 60e28edc-4bb3-4f87-b6a2-5dc45f1a0971, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = d59da361-abaf-41d5-acb3-965508378439, newImageDescription = , imageId = d52154e3-52b0-4e20-b433-276e45b1ed63, sourceImageGroupId = 60e28edc-4bb3-4f87-b6a2-5dc45f1a0971), log id: d275ee1 >2014-09-26 23:03:45,117 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) [50286f6d] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 23:03:45,418 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) [50286f6d] FINISH, CreateSnapshotVDSCommand, return: d59da361-abaf-41d5-acb3-965508378439, log id: d275ee1 >2014-09-26 23:03:45,435 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) [50286f6d] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 27879fe9-c6e4-46be-9fda-e78cdb862390 >2014-09-26 23:03:45,436 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-7) [50286f6d] CommandMultiAsyncTasks::AttachTask: Attaching task b3ad2c19-422d-4ec9-9c11-98b711252dd7 to command 27879fe9-c6e4-46be-9fda-e78cdb862390. >2014-09-26 23:03:45,466 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-7) [50286f6d] Adding task b3ad2c19-422d-4ec9-9c11-98b711252dd7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:03:45,520 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 13ab6641-ba04-4f48-9596-eefdbf875412, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = e89a3dc7-947c-4692-b5d1-eb8f5a4958cb, newImageDescription = ), log id: 9a95fa8 >2014-09-26 23:03:45,523 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 23:03:45,833 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, CreateImageVDSCommand, return: e89a3dc7-947c-4692-b5d1-eb8f5a4958cb, log id: 9a95fa8 >2014-09-26 23:03:45,865 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-7) CommandMultiAsyncTasks::AttachTask: Attaching task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 to command 27879fe9-c6e4-46be-9fda-e78cdb862390. >2014-09-26 23:03:45,881 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-7) Adding task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:03:45,890 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = e82592d0-5084-47ee-b57e-9705508868f6, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 0ffd2268-ef48-4fbf-aaf6-73f4249d5f40, newImageDescription = ), log id: 100d7fda >2014-09-26 23:03:45,891 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 23:03:46,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, CreateImageVDSCommand, return: 0ffd2268-ef48-4fbf-aaf6-73f4249d5f40, log id: 100d7fda >2014-09-26 23:03:46,146 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-7) CommandMultiAsyncTasks::AttachTask: Attaching task cb3f1397-a919-4f99-80aa-e16cb54d0534 to command 27879fe9-c6e4-46be-9fda-e78cdb862390. >2014-09-26 23:03:46,162 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-7) Adding task cb3f1397-a919-4f99-80aa-e16cb54d0534 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:03:46,286 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) Correlation ID: 95d4f49, Job ID: 957025ef-00d6-4347-919a-00460c28cc32, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'iscsi-el7-vm01' was initiated by admin. >2014-09-26 23:03:46,287 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::startPollingTask: Starting to poll task b3ad2c19-422d-4ec9-9c11-98b711252dd7. >2014-09-26 23:03:46,287 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::startPollingTask: Starting to poll task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6. >2014-09-26 23:03:46,288 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::startPollingTask: Starting to poll task cb3f1397-a919-4f99-80aa-e16cb54d0534. >2014-09-26 23:03:46,391 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-51) Polling and updating Async Tasks: 4 tasks, 3 tasks to poll now >2014-09-26 23:03:46,562 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task cb3f1397-a919-4f99-80aa-e16cb54d0534 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 23:03:46,563 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task b3ad2c19-422d-4ec9-9c11-98b711252dd7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 23:03:46,565 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-09-26 23:03:46,566 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-51) Finished polling Tasks, will poll again in 10 seconds. >2014-09-26 23:03:56,823 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] SPMAsyncTask::PollTask: Polling task cb3f1397-a919-4f99-80aa-e16cb54d0534 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:03:56,847 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] BaseAsyncTask::onTaskEndSuccess: Task cb3f1397-a919-4f99-80aa-e16cb54d0534 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:03:56,849 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Task with DB Task ID 34ef7ead-cda3-4e26-8029-b392dca0f24c and VDSM Task ID b3ad2c19-422d-4ec9-9c11-98b711252dd7 is in state Polling. End action for command 27879fe9-c6e4-46be-9fda-e78cdb862390 will proceed when all the entitys tasks are completed. >2014-09-26 23:03:56,850 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] SPMAsyncTask::PollTask: Polling task b3ad2c19-422d-4ec9-9c11-98b711252dd7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:03:56,864 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] BaseAsyncTask::onTaskEndSuccess: Task b3ad2c19-422d-4ec9-9c11-98b711252dd7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:03:56,865 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) [1a94ae30] Task with DB Task ID e500145e-3ea3-4837-8495-da030e3f3009 and VDSM Task ID 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 is in state Polling. End action for command 27879fe9-c6e4-46be-9fda-e78cdb862390 will proceed when all the entitys tasks are completed. >2014-09-26 23:03:56,866 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] SPMAsyncTask::PollTask: Polling task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:03:56,880 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] BaseAsyncTask::onTaskEndSuccess: Task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:03:56,881 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] CommandAsyncTask::endActionIfNecessary: All tasks of command 27879fe9-c6e4-46be-9fda-e78cdb862390 has ended -> executing endAction >2014-09-26 23:03:56,882 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-35) [1a94ae30] CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 27879fe9-c6e4-46be-9fda-e78cdb862390): calling endAction . >2014-09-26 23:03:56,883 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-14) [1a94ae30] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-09-26 23:03:56,913 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-14) [1a94ae30] Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-09-26 23:03:56,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-14) [1a94ae30] START, SnapshotVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22), log id: 780b9f45 >2014-09-26 23:03:59,666 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-14) [1a94ae30] FINISH, SnapshotVDSCommand, log id: 780b9f45 >2014-09-26 23:03:59,704 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-14) [50286f6d] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-09-26 23:03:59,709 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [50286f6d] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 60e28edc-4bb3-4f87-b6a2-5dc45f1a0971, imageId = d59da361-abaf-41d5-acb3-965508378439), log id: 438a9344 >2014-09-26 23:03:59,890 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [50286f6d] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@27829a1a, log id: 438a9344 >2014-09-26 23:03:59,921 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-14) Lock freed to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >, sharedLocks= ] >2014-09-26 23:03:59,944 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 95d4f49, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'iscsi-el7-vm01' has been completed. >2014-09-26 23:03:59,945 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-14) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-09-26 23:03:59,945 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-14) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-09-26 23:03:59,953 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-14) SPMAsyncTask::ClearAsyncTask: Attempting to clear task cb3f1397-a919-4f99-80aa-e16cb54d0534 >2014-09-26 23:03:59,953 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = cb3f1397-a919-4f99-80aa-e16cb54d0534), log id: 64cb8b79 >2014-09-26 23:03:59,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=cb3f1397-a919-4f99-80aa-e16cb54d0534), log id: 6f31e8a1 >2014-09-26 23:04:00,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) FINISH, HSMClearTaskVDSCommand, log id: 6f31e8a1 >2014-09-26 23:04:00,231 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) FINISH, SPMClearTaskVDSCommand, log id: 64cb8b79 >2014-09-26 23:04:00,242 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-14) BaseAsyncTask::removeTaskFromDB: Removed task cb3f1397-a919-4f99-80aa-e16cb54d0534 from DataBase >2014-09-26 23:04:00,243 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-14) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b3ad2c19-422d-4ec9-9c11-98b711252dd7 >2014-09-26 23:04:00,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = b3ad2c19-422d-4ec9-9c11-98b711252dd7), log id: c5d522a >2014-09-26 23:04:00,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=b3ad2c19-422d-4ec9-9c11-98b711252dd7), log id: 42bd49bd >2014-09-26 23:04:00,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) FINISH, HSMClearTaskVDSCommand, log id: 42bd49bd >2014-09-26 23:04:00,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) FINISH, SPMClearTaskVDSCommand, log id: c5d522a >2014-09-26 23:04:00,482 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-14) BaseAsyncTask::removeTaskFromDB: Removed task b3ad2c19-422d-4ec9-9c11-98b711252dd7 from DataBase >2014-09-26 23:04:00,483 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-14) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 >2014-09-26 23:04:00,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6), log id: 540a22fe >2014-09-26 23:04:00,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=8bf6f4c1-dc89-48b0-86ee-a0695f972eb6), log id: 657f7ccc >2014-09-26 23:04:00,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) FINISH, HSMClearTaskVDSCommand, log id: 657f7ccc >2014-09-26 23:04:00,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-14) FINISH, SPMClearTaskVDSCommand, log id: 540a22fe >2014-09-26 23:04:00,723 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-14) BaseAsyncTask::removeTaskFromDB: Removed task 8bf6f4c1-dc89-48b0-86ee-a0695f972eb6 from DataBase >2014-09-26 23:04:00,724 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-14) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 27879fe9-c6e4-46be-9fda-e78cdb862390 >2014-09-26 23:04:00,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-18) [61378cb0] START, FullListVdsCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4], vmIds=[d4ded5f8-6767-486b-8699-c1636b08eb22]), log id: 7cc4edaf >2014-09-26 23:04:01,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-18) [61378cb0] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, guestDiskMapping={}, displayIp=10.35.0.100, pauseCode=NOERR, pitReinjection=false, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=512, display=qxl, pid=1341, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=preferred}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@64d0bc27, vmName=iscsi-el7-vm01, fileTransferEnable=true, cpuType=Haswell}], log id: 7cc4edaf >2014-09-26 23:04:01,148 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) [61378cb0] Received a spice Device without an address when processing VM d4ded5f8-6767-486b-8699-c1636b08eb22 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.100}, device=spice, tlsPort=5901, type=graphics} >2014-09-26 23:04:19,271 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-7) [75658536] Running command: ShutdownVmCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 23:04:19,273 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-7) [75658536] Entered (VM iscsi-el7-vm01). >2014-09-26 23:04:19,273 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-7) [75658536] Cannot shutdown VM iscsi-el7-vm01, status is not up. Stopping instead. >2014-09-26 23:04:19,304 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-7) [589e487f] Running command: StopVmCommand internal: true. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-09-26 23:04:19,306 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-7) [589e487f] START, DestroyVmVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, force=false, secondsToWait=0, gracefully=false, reason=), log id: 1c1a6b69 >2014-09-26 23:04:19,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-7) [589e487f] START, DestroyVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vmId=d4ded5f8-6767-486b-8699-c1636b08eb22, force=false, secondsToWait=0, gracefully=false, reason=), log id: 55f3bcb >2014-09-26 23:04:20,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-7) [589e487f] FINISH, DestroyVDSCommand, log id: 55f3bcb >2014-09-26 23:04:20,248 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-7) [589e487f] FINISH, DestroyVmVDSCommand, return: Down, log id: 1c1a6b69 >2014-09-26 23:04:20,264 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-3) [63058725] Running command: ProcessDownVmCommand internal: true. >2014-09-26 23:04:20,273 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) [589e487f] Correlation ID: 589e487f, Job ID: 35bdd355-84b0-45fd-8a86-4694104a24b4, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was powered off ungracefully by admin (Host: voodoo1) (Reason: Not Specified). >2014-09-26 23:04:31,666 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-80) [19164de8] Setting new tasks map. The map contains now 3 tasks >2014-09-26 23:05:01,666 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) Setting new tasks map. The map contains now 0 tasks >2014-09-26 23:05:01,667 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 23:07:23,988 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp--127.0.0.1-8702-3) [63def4a] Lock Acquired to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >, sharedLocks= ] >2014-09-26 23:07:24,046 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-5) [63def4a] Running command: RemoveVmCommand internal: false. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VMAction group DELETE_VM with role type USER >2014-09-26 23:07:24,047 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-5) [63def4a] START, SetVmStatusVDSCommand( vmId = d4ded5f8-6767-486b-8699-c1636b08eb22, status = ImageLocked, exit status = Normal), log id: 12869d5f >2014-09-26 23:07:24,049 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-5) [63def4a] FINISH, SetVmStatusVDSCommand, log id: 12869d5f >2014-09-26 23:07:24,054 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-5) [63def4a] Lock freed to object EngineLock [exclusiveLocks= key: d4ded5f8-6767-486b-8699-c1636b08eb22 value: VM >, sharedLocks= ] >2014-09-26 23:07:24,057 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-5) [57c0b02f] Running command: RemoveMemoryVolumesCommand internal: true. >2014-09-26 23:07:24,073 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-5) [49679e40] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: d4ded5f8-6767-486b-8699-c1636b08eb22 Type: VM >2014-09-26 23:07:24,078 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-5) [3e91162] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-09-26 23:07:24,122 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-5) [3e91162] START, DeleteImageGroupVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = ff559f46-c495-4f6b-901c-2a624042a050, imageGroupId = 60e28edc-4bb3-4f87-b6a2-5dc45f1a0971, postZeros = false, forceDelete = false), log id: 6865cb69 >2014-09-26 23:07:25,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-5) [3e91162] FINISH, DeleteImageGroupVDSCommand, log id: 6865cb69 >2014-09-26 23:07:25,157 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-5) [3e91162] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command f6d1bc78-2689-461c-897f-7581d9b1cfb1 >2014-09-26 23:07:25,157 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-5) [3e91162] CommandMultiAsyncTasks::AttachTask: Attaching task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4 to command f6d1bc78-2689-461c-897f-7581d9b1cfb1. >2014-09-26 23:07:25,181 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-5) [3e91162] Adding task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:07:25,289 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [3e91162] Correlation ID: 63def4a, Job ID: 5fd12a8a-7f16-41c4-9657-ad6b850e44e0, Call Stack: null, Custom Event ID: -1, Message: VM iscsi-el7-vm01 was successfully removed. >2014-09-26 23:07:25,290 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-5) [3e91162] BaseAsyncTask::startPollingTask: Starting to poll task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4. >2014-09-26 23:07:26,888 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-34) [397bb7b7] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-09-26 23:07:27,060 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-34) [397bb7b7] SPMAsyncTask::PollTask: Polling task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:07:27,095 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-34) [397bb7b7] BaseAsyncTask::onTaskEndSuccess: Task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:07:27,096 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-34) [397bb7b7] CommandAsyncTask::endActionIfNecessary: All tasks of command f6d1bc78-2689-461c-897f-7581d9b1cfb1 has ended -> executing endAction >2014-09-26 23:07:27,096 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-34) [397bb7b7] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: f6d1bc78-2689-461c-897f-7581d9b1cfb1): calling endAction . >2014-09-26 23:07:27,097 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-09-26 23:07:27,128 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-09-26 23:07:27,129 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-09-26 23:07:27,130 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-09-26 23:07:27,136 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] SPMAsyncTask::ClearAsyncTask: Attempting to clear task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4 >2014-09-26 23:07:27,137 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = d63357c8-3ecb-49f1-b2ed-b33d7a357ca4), log id: 7301ae75 >2014-09-26 23:07:27,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=d63357c8-3ecb-49f1-b2ed-b33d7a357ca4), log id: 7364be4f >2014-09-26 23:07:27,370 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] FINISH, HSMClearTaskVDSCommand, log id: 7364be4f >2014-09-26 23:07:27,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] FINISH, SPMClearTaskVDSCommand, log id: 7301ae75 >2014-09-26 23:07:27,376 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] BaseAsyncTask::removeTaskFromDB: Removed task d63357c8-3ecb-49f1-b2ed-b33d7a357ca4 from DataBase >2014-09-26 23:07:27,377 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) [397bb7b7] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity f6d1bc78-2689-461c-897f-7581d9b1cfb1 >2014-09-26 23:08:31,670 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-15) [3943bcef] Setting new tasks map. The map contains now 0 tasks >2014-09-26 23:08:31,671 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-15) [3943bcef] Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 23:34:41,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-09-26 23:34:41,706 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-12) [28d87ff2] Lock Acquired to object EngineLock [exclusiveLocks= key: 3e419414-ee73-47e8-809d-60de4a88403c value: STORAGE >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 23:34:41,710 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-12) [28d87ff2] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:41,712 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (DefaultQuartzScheduler_Worker-12) [365a35b4] Running command: CreateOvfStoresForStorageDomainCommand internal: true. >2014-09-26 23:34:41,714 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-12) [5c7bd84c] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:41,732 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-12) [404e7a4f] Running command: AddDiskCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 23:34:41,786 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-12) [7c6401a1] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:41,795 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-12) [7c6401a1] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 1b8ef4eb-4f1d-4188-a931-edf0f24c4297, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2, newImageDescription = OVF_STORE), log id: 795516f2 >2014-09-26 23:34:41,797 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-12) [7c6401a1] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 23:34:42,081 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-12) [7c6401a1] FINISH, CreateImageVDSCommand, return: 4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2, log id: 795516f2 >2014-09-26 23:34:42,084 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-12) [7c6401a1] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 750265dd-0689-41f7-b32b-2af42c54af78 >2014-09-26 23:34:42,085 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-12) [7c6401a1] CommandMultiAsyncTasks::AttachTask: Attaching task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 to command 750265dd-0689-41f7-b32b-2af42c54af78. >2014-09-26 23:34:42,110 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-12) [7c6401a1] Adding task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:34:42,151 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) [7c6401a1] Correlation ID: 404e7a4f, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-09-26 23:34:42,161 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-12) [24327e28] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:42,175 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-12) [75109207] Running command: AddDiskCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: StorageAction group CREATE_DISK with role type USER >2014-09-26 23:34:42,218 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-12) [6ec4ada] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:42,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-12) [6ec4ada] START, CreateImageVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 8f783331-2413-4965-ac8b-177ad4011a46, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = dc6c2161-9435-4613-bf90-3ed52702ea31, newImageDescription = OVF_STORE), log id: 670cecd >2014-09-26 23:34:42,229 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-12) [6ec4ada] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-09-26 23:34:42,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-12) [6ec4ada] FINISH, CreateImageVDSCommand, return: dc6c2161-9435-4613-bf90-3ed52702ea31, log id: 670cecd >2014-09-26 23:34:42,539 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-12) [6ec4ada] CommandMultiAsyncTasks::AttachTask: Attaching task a2d2d2f5-280a-444d-831e-c92cfb48cb6a to command 750265dd-0689-41f7-b32b-2af42c54af78. >2014-09-26 23:34:42,566 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-12) [6ec4ada] Adding task a2d2d2f5-280a-444d-831e-c92cfb48cb6a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:34:42,590 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) [6ec4ada] Correlation ID: 75109207, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-09-26 23:34:42,615 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-12) [6ec4ada] BaseAsyncTask::startPollingTask: Starting to poll task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2. >2014-09-26 23:34:42,616 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-12) [6ec4ada] BaseAsyncTask::startPollingTask: Starting to poll task a2d2d2f5-280a-444d-831e-c92cfb48cb6a. >2014-09-26 23:34:42,617 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-12) [6ec4ada] Lock freed to object EngineLock [exclusiveLocks= key: 3e419414-ee73-47e8-809d-60de4a88403c value: STORAGE >, sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: OVF_UPDATE >] >2014-09-26 23:34:47,148 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-23) [1d2512cb] Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-09-26 23:34:47,317 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-23) [1d2512cb] SPMAsyncTask::PollTask: Polling task a2d2d2f5-280a-444d-831e-c92cfb48cb6a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:34:47,318 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-23) [1d2512cb] BaseAsyncTask::onTaskEndSuccess: Task a2d2d2f5-280a-444d-831e-c92cfb48cb6a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:34:47,319 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-23) [1d2512cb] Task with DB Task ID 21500348-d03b-4193-85f2-58248fc08b0e and VDSM Task ID 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 is in state Polling. End action for command 750265dd-0689-41f7-b32b-2af42c54af78 will proceed when all the entitys tasks are completed. >2014-09-26 23:34:47,321 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-23) [1d2512cb] SPMAsyncTask::PollTask: Polling task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:34:47,322 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-23) [1d2512cb] BaseAsyncTask::onTaskEndSuccess: Task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:34:47,323 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-23) [1d2512cb] CommandAsyncTask::endActionIfNecessary: All tasks of command 750265dd-0689-41f7-b32b-2af42c54af78 has ended -> executing endAction >2014-09-26 23:34:47,324 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-23) [1d2512cb] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 750265dd-0689-41f7-b32b-2af42c54af78): calling endAction . >2014-09-26 23:34:47,325 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) [1d2512cb] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateOvfStoresForStorageDomain, executionIndex: 0 >2014-09-26 23:34:47,345 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-17) [365a35b4] Ending command successfully: org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand >2014-09-26 23:34:47,361 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-17) [6ec4ada] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 23:34:47,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-17) [6ec4ada] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 8f783331-2413-4965-ac8b-177ad4011a46, imageId = dc6c2161-9435-4613-bf90-3ed52702ea31), log id: 2e55f052 >2014-09-26 23:34:47,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-17) [6ec4ada] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@975ed2f2, log id: 2e55f052 >2014-09-26 23:34:47,584 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-17) [7c6401a1] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-09-26 23:34:47,588 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-17) [7c6401a1] START, GetImageInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 1b8ef4eb-4f1d-4188-a931-edf0f24c4297, imageId = 4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2), log id: 1efdce39 >2014-09-26 23:34:47,770 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-17) [7c6401a1] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@14157dc6, log id: 1efdce39 >2014-09-26 23:34:47,841 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-17) [365a35b4] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:47,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [365a35b4] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 8f783331-2413-4965-ac8b-177ad4011a46, imageId = dc6c2161-9435-4613-bf90-3ed52702ea31), log id: 1bd34cec >2014-09-26 23:34:47,854 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [365a35b4] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 23:34:47,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [365a35b4] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=3e419414-ee73-47e8-809d-60de4a88403c > imageGroupGUID=8f783331-2413-4965-ac8b-177ad4011a46 > volUUID=dc6c2161-9435-4613-bf90-3ed52702ea31 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"3e419414-ee73-47e8-809d-60de4a88403c"}],"Last Updated":null} > >2014-09-26 23:34:48,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [365a35b4] FINISH, SetVolumeDescriptionVDSCommand, log id: 1bd34cec >2014-09-26 23:34:48,439 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 23:34:48,454 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] Running command: UploadStreamCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:48,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] START, UploadStreamVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 254519a3 >2014-09-26 23:34:48,457 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] -- executeVdsBrokerCommand: >2014-09-26 23:34:48,457 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] -- parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=3e419414-ee73-47e8-809d-60de4a88403c > imageGUID=8f783331-2413-4965-ac8b-177ad4011a46 > volUUID=dc6c2161-9435-4613-bf90-3ed52702ea31 > size=10,240 > >2014-09-26 23:34:49,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] FINISH, UploadStreamVDSCommand, log id: 254519a3 >2014-09-26 23:34:49,603 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-17) [335a600a] CommandMultiAsyncTasks::AttachTask: Attaching task 8045fe19-919b-4d6c-b84a-320dbf57ac44 to command 750265dd-0689-41f7-b32b-2af42c54af78. >2014-09-26 23:34:49,663 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-17) [335a600a] Adding task 8045fe19-919b-4d6c-b84a-320dbf57ac44 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:34:49,680 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 23:34:49,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 8f783331-2413-4965-ac8b-177ad4011a46, imageId = dc6c2161-9435-4613-bf90-3ed52702ea31), log id: 643c6903 >2014-09-26 23:34:49,690 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 23:34:49,690 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=3e419414-ee73-47e8-809d-60de4a88403c > imageGroupGUID=8f783331-2413-4965-ac8b-177ad4011a46 > volUUID=dc6c2161-9435-4613-bf90-3ed52702ea31 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"3e419414-ee73-47e8-809d-60de4a88403c"}],"Last Updated":"Fri Sep 26 23:34:47 IDT 2014","Size":10240} > >2014-09-26 23:34:50,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] FINISH, SetVolumeDescriptionVDSCommand, log id: 643c6903 >2014-09-26 23:34:50,224 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 1b8ef4eb-4f1d-4188-a931-edf0f24c4297, imageId = 4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2), log id: 7c1eae0e >2014-09-26 23:34:50,225 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 23:34:50,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=3e419414-ee73-47e8-809d-60de4a88403c > imageGroupGUID=1b8ef4eb-4f1d-4188-a931-edf0f24c4297 > volUUID=4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"3e419414-ee73-47e8-809d-60de4a88403c"}],"Last Updated":null} > >2014-09-26 23:34:50,805 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [335a600a] FINISH, SetVolumeDescriptionVDSCommand, log id: 7c1eae0e >2014-09-26 23:34:50,882 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 23:34:50,897 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] Running command: UploadStreamCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:50,900 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] START, UploadStreamVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 2c272dfd >2014-09-26 23:34:50,901 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] -- executeVdsBrokerCommand: >2014-09-26 23:34:50,901 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] -- parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=3e419414-ee73-47e8-809d-60de4a88403c > imageGUID=1b8ef4eb-4f1d-4188-a931-edf0f24c4297 > volUUID=4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2 > size=10,240 > >2014-09-26 23:34:51,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] FINISH, UploadStreamVDSCommand, log id: 2c272dfd >2014-09-26 23:34:51,946 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-17) [f474706] CommandMultiAsyncTasks::AttachTask: Attaching task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 to command 750265dd-0689-41f7-b32b-2af42c54af78. >2014-09-26 23:34:52,007 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-17) [f474706] Adding task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-09-26 23:34:52,024 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 114c2cc6-5123-45bc-8900-5c875b0543c4 value: VDS_EXECUTION >] >2014-09-26 23:34:52,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] START, SetVolumeDescriptionVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, storageDomainId = 3e419414-ee73-47e8-809d-60de4a88403c, imageGroupId = 1b8ef4eb-4f1d-4188-a931-edf0f24c4297, imageId = 4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2), log id: b3ab662 >2014-09-26 23:34:52,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-09-26 23:34:52,029 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] -- setVolumeDescription parameters: > spUUID=b86b687a-d073-497a-ac8a-249025419a3e > sdUUID=3e419414-ee73-47e8-809d-60de4a88403c > imageGroupGUID=1b8ef4eb-4f1d-4188-a931-edf0f24c4297 > volUUID=4d6a3aea-ec6d-41aa-b5d8-0334e6be18d2 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"3e419414-ee73-47e8-809d-60de4a88403c"}],"Last Updated":"Fri Sep 26 23:34:47 IDT 2014","Size":10240} > >2014-09-26 23:34:52,321 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] FINISH, SetVolumeDescriptionVDSCommand, log id: b3ab662 >2014-09-26 23:34:52,380 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] BaseAsyncTask::startPollingTask: Starting to poll task 8045fe19-919b-4d6c-b84a-320dbf57ac44. >2014-09-26 23:34:52,380 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] BaseAsyncTask::startPollingTask: Starting to poll task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5. >2014-09-26 23:34:52,381 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain completed, handling the result. >2014-09-26 23:34:52,381 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain succeeded, clearing tasks. >2014-09-26 23:34:52,382 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] SPMAsyncTask::ClearAsyncTask: Attempting to clear task a2d2d2f5-280a-444d-831e-c92cfb48cb6a >2014-09-26 23:34:52,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = a2d2d2f5-280a-444d-831e-c92cfb48cb6a), log id: 6f3b9157 >2014-09-26 23:34:52,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=a2d2d2f5-280a-444d-831e-c92cfb48cb6a), log id: 2fc31fce >2014-09-26 23:34:57,325 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-85) Polling and updating Async Tasks: 4 tasks, 4 tasks to poll now >2014-09-26 23:34:57,574 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] Command HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=a2d2d2f5-280a-444d-831e-c92cfb48cb6a) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-86) [269fc23f] Command ListVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] FINISH, HSMClearTaskVDSCommand, log id: 2fc31fce >2014-09-26 23:34:57,577 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-86) [269fc23f] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:34:57,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] FINISH, SPMClearTaskVDSCommand, log id: 6f3b9157 >2014-09-26 23:34:57,581 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] SPMAsyncTask::ClearAsyncTask: Clearing task a2d2d2f5-280a-444d-831e-c92cfb48cb6a failed. >2014-09-26 23:34:57,582 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 >2014-09-26 23:34:57,583 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2), log id: 7cfdbff8 >2014-09-26 23:34:57,584 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-85) Command HSMGetAllTasksStatusesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,586 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-85) Finished polling Tasks, will poll again in 10 seconds. >2014-09-26 23:34:57,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-63) Command SpmStatusVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,596 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-63) [185d4153] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:34:57,598 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [269fc23f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:34:57,599 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-63) [185d4153] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain ff559f46-c495-4f6b-901c-2a624042a050 status from Active to Unknown, reason : null >2014-09-26 23:34:57,601 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-63) [185d4153] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 3e419414-ee73-47e8-809d-60de4a88403c status from Active to Unknown, reason : null >2014-09-26 23:34:57,600 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) [269fc23f] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:413) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.fetchRunningVms(VdsUpdateRunTimeInfo.java:982) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:931) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:649) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.list(Unknown Source) > at sun.reflect.GeneratedMethodAccessor98.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:34:57,623 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) [185d4153] Correlation ID: 185d4153, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting Data Center status to Non Responsive (On host voodoo1, Error: Network error during communication with the Host.). >2014-09-26 23:34:57,634 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-86) [269fc23f] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,865 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-14) [2b6bfc25] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 23:34:57,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [2b6bfc25] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8), log id: 22b5735c >2014-09-26 23:34:57,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [2b6bfc25] Command GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [2b6bfc25] FINISH, GetVGInfoVDSCommand, log id: 22b5735c >2014-09-26 23:34:57,890 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-14) [2b6bfc25] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 23:34:57,898 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-48) [33a8503b] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:34:57,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33a8503b] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w), log id: 68198dc3 >2014-09-26 23:34:57,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=3b5da88d-6c9b-437d-bd8f-0ce27feb14c2), log id: 4719645c >2014-09-26 23:34:57,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33a8503b] Command GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-48) [33a8503b] FINISH, GetVGInfoVDSCommand, log id: 68198dc3 >2014-09-26 23:34:57,910 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] Command HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=3b5da88d-6c9b-437d-bd8f-0ce27feb14c2) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:34:57,910 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-48) [33a8503b] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-09-26 23:34:57,911 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] FINISH, HSMClearTaskVDSCommand, log id: 4719645c >2014-09-26 23:34:57,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) [f474706] FINISH, SPMClearTaskVDSCommand, log id: 7cfdbff8 >2014-09-26 23:34:57,913 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) [f474706] SPMAsyncTask::ClearAsyncTask: Clearing task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 failed. >2014-09-26 23:34:57,914 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-17) [f474706] [within thread]: Some of the tasks related to command id 750265dd-0689-41f7-b32b-2af42c54af78 were not cleared yet (Task id 8045fe19-919b-4d6c-b84a-320dbf57ac44 is in state Polling). >2014-09-26 23:35:00,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [33584788] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:35:00,645 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-72) [33584788] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:35:00,649 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-72) [33584788] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:35:00,669 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-72) [33584788] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:35:03,678 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [29d3c279] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:35:03,679 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-67) [29d3c279] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:35:03,683 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) [29d3c279] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:35:03,701 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-67) [29d3c279] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:35:06,709 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [37598b68] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:35:06,711 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) [37598b68] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:35:06,715 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-61) [37598b68] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.UnknownHostException: voodoo1.tlv.redhat.com > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:35:06,732 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) [37598b68] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.UnknownHostException: voodoo1.tlv.redhat.com >2014-09-26 23:35:08,298 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a2d2d2f5-280a-444d-831e-c92cfb48cb6a >2014-09-26 23:35:08,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = a2d2d2f5-280a-444d-831e-c92cfb48cb6a), log id: 55455c72 >2014-09-26 23:35:08,302 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-19) [8e75a14] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain ff559f46-c495-4f6b-901c-2a624042a050 status from Active to Unknown, reason : no reporting hosts >2014-09-26 23:35:08,350 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-19) [8e75a14] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 3e419414-ee73-47e8-809d-60de4a88403c status from Active to Unknown, reason : no reporting hosts >2014-09-26 23:35:08,844 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-32) [258eb0b9] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 23:35:08,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-32) [258eb0b9] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8), log id: 21cd0bdd >2014-09-26 23:35:08,873 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-29) [5457688f] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:35:08,880 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-29) [5457688f] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w), log id: e824d18 >2014-09-26 23:35:08,881 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=a2d2d2f5-280a-444d-831e-c92cfb48cb6a), log id: 759d5680 >2014-09-26 23:35:09,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-32) [258eb0b9] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb, volumeGroupId=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050, storageDomainName=null]], log id: 21cd0bdd >2014-09-26 23:35:09,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, HSMClearTaskVDSCommand, log id: 759d5680 >2014-09-26 23:35:09,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, SPMClearTaskVDSCommand, log id: 55455c72 >2014-09-26 23:35:09,965 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) BaseAsyncTask::removeTaskFromDB: Removed task a2d2d2f5-280a-444d-831e-c92cfb48cb6a from DataBase >2014-09-26 23:35:09,966 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 >2014-09-26 23:35:09,967 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2), log id: 7e80c667 >2014-09-26 23:35:09,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=3b5da88d-6c9b-437d-bd8f-0ce27feb14c2), log id: 3861d513 >2014-09-26 23:35:10,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) [6631a2c7] START, GetHardwareInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]), log id: 2169e172 >2014-09-26 23:35:10,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-29) [5457688f] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=OJXETa-XKwC-GizR-hnvw-Cr7H-UWmH-RQz7RG, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=KgqqOU-mqae-ikMS-Y8eV-8BLg-mdFL-YP4LfA, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null]], log id: e824d18 >2014-09-26 23:35:10,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, HSMClearTaskVDSCommand, log id: 3861d513 >2014-09-26 23:35:10,545 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, SPMClearTaskVDSCommand, log id: 7e80c667 >2014-09-26 23:35:10,594 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) BaseAsyncTask::removeTaskFromDB: Removed task 3b5da88d-6c9b-437d-bd8f-0ce27feb14c2 from DataBase >2014-09-26 23:35:10,595 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) SPMAsyncTask::PollTask: Polling task 8045fe19-919b-4d6c-b84a-320dbf57ac44 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:35:10,597 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) BaseAsyncTask::onTaskEndSuccess: Task 8045fe19-919b-4d6c-b84a-320dbf57ac44 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:35:10,598 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-40) Task with DB Task ID 3e922de3-aa7d-47bc-8b79-bfed71186093 and VDSM Task ID b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 is in state Polling. End action for command 750265dd-0689-41f7-b32b-2af42c54af78 will proceed when all the entitys tasks are completed. >2014-09-26 23:35:10,599 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) SPMAsyncTask::PollTask: Polling task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-09-26 23:35:10,600 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) BaseAsyncTask::onTaskEndSuccess: Task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-09-26 23:35:10,601 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-40) CommandAsyncTask::endActionIfNecessary: All tasks of command 750265dd-0689-41f7-b32b-2af42c54af78 has ended -> executing endAction >2014-09-26 23:35:10,602 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-40) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 750265dd-0689-41f7-b32b-2af42c54af78): calling endAction . >2014-09-26 23:35:10,603 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-11) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-09-26 23:35:10,644 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-09-26 23:35:10,645 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-09-26 23:35:10,646 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-09-26 23:35:10,647 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8045fe19-919b-4d6c-b84a-320dbf57ac44 >2014-09-26 23:35:10,647 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = 8045fe19-919b-4d6c-b84a-320dbf57ac44), log id: 1db0b055 >2014-09-26 23:35:10,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=8045fe19-919b-4d6c-b84a-320dbf57ac44), log id: 3b08abad >2014-09-26 23:35:10,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) [6631a2c7] FINISH, GetHardwareInfoVDSCommand, log id: 2169e172 >2014-09-26 23:35:10,952 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-66) [32b90685] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 23:35:11,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] FINISH, HSMClearTaskVDSCommand, log id: 3b08abad >2014-09-26 23:35:11,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] FINISH, SPMClearTaskVDSCommand, log id: 1db0b055 >2014-09-26 23:35:11,017 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] BaseAsyncTask::removeTaskFromDB: Removed task 8045fe19-919b-4d6c-b84a-320dbf57ac44 from DataBase >2014-09-26 23:35:11,017 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] SPMAsyncTask::ClearAsyncTask: Attempting to clear task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 >2014-09-26 23:35:11,018 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] START, SPMClearTaskVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, taskId = b4ee7e29-77e2-478e-bfb2-887c3cfb08e5), log id: 12d11571 >2014-09-26 23:35:11,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=b4ee7e29-77e2-478e-bfb2-887c3cfb08e5), log id: 5cd6b75d >2014-09-26 23:35:11,168 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-66) [360f650e] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:35:11,185 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-66) [54884e5c] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:35:11,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-66) [54884e5c] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 542c0c01 >2014-09-26 23:35:11,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] FINISH, HSMClearTaskVDSCommand, log id: 5cd6b75d >2014-09-26 23:35:11,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-11) [365a35b4] FINISH, SPMClearTaskVDSCommand, log id: 12d11571 >2014-09-26 23:35:11,290 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] BaseAsyncTask::removeTaskFromDB: Removed task b4ee7e29-77e2-478e-bfb2-887c3cfb08e5 from DataBase >2014-09-26 23:35:11,291 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-11) [365a35b4] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 750265dd-0689-41f7-b32b-2af42c54af78 >2014-09-26 23:35:11,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-66) [54884e5c] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 542c0c01 >2014-09-26 23:35:11,465 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-66) [54884e5c] Host voodoo1 storage connection was succeeded >2014-09-26 23:35:11,474 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-18) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 5), log id: 7d3dd0c8 >2014-09-26 23:35:12,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-18) FINISH, ConnectStoragePoolVDSCommand, log id: 7d3dd0c8 >2014-09-26 23:35:12,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-66) [54884e5c] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 1144319a >2014-09-26 23:35:13,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-66) [54884e5c] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1144319a >2014-09-26 23:35:13,178 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [54884e5c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo1 was set to Up. >2014-09-26 23:35:13,186 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [54884e5c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo1. >2014-09-26 23:35:13,195 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [54884e5c] Correlation ID: 360f650e, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 23:35:13,267 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-66) [23ce0ce9] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 23:36:01,681 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-11) Setting new tasks map. The map contains now 2 tasks >2014-09-26 23:36:31,683 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-28) [362ac299] Setting new tasks map. The map contains now 0 tasks >2014-09-26 23:36:31,684 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-28) [362ac299] Cleared all tasks of pool b86b687a-d073-497a-ac8a-249025419a3e. >2014-09-26 23:38:03,233 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp--127.0.0.1-8702-4) [17548f0e] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 23:38:03,251 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 23:38:03,254 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] START, SetVdsStatusVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 220cabf8 >2014-09-26 23:38:03,255 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] VDS voodoo1 is spm and moved from up calling resetIrs. >2014-09-26 23:38:03,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] START, ResetIrsVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, ignoreStopFailed = false), log id: 32ddc4fd >2014-09-26 23:38:03,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] START, SpmStopVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e), log id: 6dd39d32 >2014-09-26 23:38:03,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] Command HSMGetAllTasksStatusesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 23:38:03,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] SpmStopVDSCommand::Stopping SPM on vds voodoo1, pool id b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 23:38:03,549 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] could not stop spm of pool b86b687a-d073-497a-ac8a-249025419a3e on vds 114c2cc6-5123-45bc-8900-5c875b0543c4 - reason: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-09-26 23:38:03,550 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] FINISH, SpmStopVDSCommand, log id: 6dd39d32 >2014-09-26 23:38:03,550 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] FINISH, ResetIrsVDSCommand, log id: 32ddc4fd >2014-09-26 23:38:03,571 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [17548f0e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to change status of host 'voodoo1' due to a failure to stop the spm. >2014-09-26 23:38:03,572 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] FINISH, SetVdsStatusVDSCommand, log id: 220cabf8 >2014-09-26 23:38:03,572 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-30) [17548f0e] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 23:38:03,729 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-78) [68d3b50c] Command ListVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 23:38:03,730 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-78) [68d3b50c] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:38:03,745 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) [68d3b50c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:38:03,746 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) [68d3b50c] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:413) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.fetchRunningVms(VdsUpdateRunTimeInfo.java:982) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:931) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:649) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.list(Unknown Source) > at sun.reflect.GeneratedMethodAccessor98.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:38:03,771 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-78) [68d3b50c] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-09-26 23:38:06,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 23:38:06,855 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-60) Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:38:06,857 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:38:06,867 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-60) Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-09-26 23:38:07,891 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-70) [51303d41] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain ff559f46-c495-4f6b-901c-2a624042a050 status from Active to Unknown, reason : no reporting hosts >2014-09-26 23:38:07,936 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-70) [51303d41] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 3e419414-ee73-47e8-809d-60de4a88403c status from Active to Unknown, reason : no reporting hosts >2014-09-26 23:38:08,030 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-70) [51303d41] Command SpmStatusVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 23:38:08,034 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-70) [5688655a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:38:08,061 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) [5688655a] Correlation ID: 5688655a, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting Data Center status to Non Responsive (On host voodoo1, Error: Network error during communication with the Host.). >2014-09-26 23:38:08,158 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-70) [5688655a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2014-09-26 23:38:10,088 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [24417dc5] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 23:38:10,089 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-99) [24417dc5] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:38:10,094 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) [24417dc5] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:38:10,110 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-99) [24417dc5] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-09-26 23:38:13,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [214c8e50] Command GetCapabilitiesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-09-26 23:38:13,384 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-62) [214c8e50] Host voodoo1 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-09-26 23:38:13,389 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) [214c8e50] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:567) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:639) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:486) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) [rt.jar:1.7.0_65] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) [rt.jar:1.7.0_65] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) [rt.jar:1.7.0_65] > at java.net.Socket.connect(Socket.java:579) [rt.jar:1.7.0_65] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) [jsse.jar:1.7.0_65] > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) [utils.jar:] > at org.apache.commons.httpclient.HttpConnection.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.commons.httpclient.HttpClient.executeMethod(Unknown Source) [commons-httpclient.jar:3.1] > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) [xmlrpc-client.jar:3.1.3] > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) [xmlrpc-client.jar:3.1.3] > at com.sun.proxy.$Proxy83.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:242) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-09-26 23:38:13,408 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-62) [214c8e50] Failed to refresh VDS , vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-09-26 23:38:17,388 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GetHardwareInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vds=Host[voodoo1,114c2cc6-5123-45bc-8900-5c875b0543c4]), log id: 440320ae >2014-09-26 23:38:17,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GetHardwareInfoVDSCommand, log id: 440320ae >2014-09-26 23:38:17,655 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-42) [5403714d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 23:38:17,844 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-42) [a428daa] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:38:17,851 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-42) [2da40020] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:38:17,860 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-42) [2da40020] START, ConnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 697d7d66 >2014-09-26 23:38:18,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-42) [2da40020] FINISH, ConnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 697d7d66 >2014-09-26 23:38:18,259 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-42) [2da40020] Host voodoo1 storage connection was succeeded >2014-09-26 23:38:18,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, ConnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, masterVersion = 5), log id: 3ed55e34 >2014-09-26 23:38:18,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-81) [1222c2af] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-09-26 23:38:18,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-81) [1222c2af] HostName = voodoo1 >2014-09-26 23:38:18,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-81) [1222c2af] Command HSMGetAllTasksStatusesVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4) execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-09-26 23:38:19,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, ConnectStoragePoolVDSCommand, log id: 3ed55e34 >2014-09-26 23:38:19,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-42) [2da40020] START, SetMOMPolicyParametersVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 29ca4b8c >2014-09-26 23:38:19,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-42) [2da40020] FINISH, SetMOMPolicyParametersVDSCommand, log id: 29ca4b8c >2014-09-26 23:38:19,872 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [2da40020] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host voodoo1 was set to Up. >2014-09-26 23:38:19,875 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [2da40020] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host voodoo1. >2014-09-26 23:38:19,880 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [2da40020] Correlation ID: a428daa, Call Stack: null, Custom Event ID: -1, Message: Unrecognized audit log type has been used. >2014-09-26 23:38:19,898 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-42) [5e6c034c] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 23:38:29,009 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-50) [2747abd8] hostFromVds::selectedVds - voodoo1, spmStatus Free, storage pool iscsi-el7 >2014-09-26 23:38:29,067 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-50) [2747abd8] starting spm on vds voodoo1, storage pool iscsi-el7, prevId -1, LVER -1 >2014-09-26 23:38:29,068 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] START, SpmStartVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 180e5ff5 >2014-09-26 23:38:29,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] spmStart polling started: taskId = 08b96b34-aece-4deb-8121-26dd8821e257 >2014-09-26 23:38:30,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] spmStart polling ended: taskId = 08b96b34-aece-4deb-8121-26dd8821e257 task status = finished >2014-09-26 23:38:30,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] spmStart polling ended, spm status: SPM >2014-09-26 23:38:30,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] START, HSMClearTaskVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, taskId=08b96b34-aece-4deb-8121-26dd8821e257), log id: 575e8be8 >2014-09-26 23:38:30,964 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] FINISH, HSMClearTaskVDSCommand, log id: 575e8be8 >2014-09-26 23:38:30,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-50) [2747abd8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5904f580, log id: 180e5ff5 >2014-09-26 23:38:30,980 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-50) [2747abd8] Initialize Irs proxy from vds: voodoo1.tlv.redhat.com >2014-09-26 23:38:30,988 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-50) [2747abd8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host voodoo1 (Address: voodoo1.tlv.redhat.com). >2014-09-26 23:38:30,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [2747abd8] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false), log id: 32a651a0 >2014-09-26 23:38:31,626 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-50) [4058fa71] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: ff559f46-c495-4f6b-901c-2a624042a050 Type: Storage >2014-09-26 23:38:31,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-50) [4058fa71] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8), log id: 21da6198 >2014-09-26 23:38:31,643 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-25) [5ea38584] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 3e419414-ee73-47e8-809d-60de4a88403c Type: Storage >2014-09-26 23:38:31,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [5ea38584] START, GetVGInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, VGID=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w), log id: 460fa5a2 >2014-09-26 23:38:31,650 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [2747abd8] -- executeIrsBrokerCommand: Attempting on storage pool b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 23:38:31,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [2747abd8] START, HSMGetAllTasksInfoVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4), log id: 5689633f >2014-09-26 23:38:32,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-50) [4058fa71] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1IET_00060007, physicalVolumeId=QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb, volumeGroupId=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8, serial=SRed_Cat_VIRTUAL-DISK, lunMapping=7, vendorId=Red Cat, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=20, vendorName=Red Cat, pathsDictionary={sdv=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=ff559f46-c495-4f6b-901c-2a624042a050, storageDomainName=null]], log id: 21da6198 >2014-09-26 23:38:32,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [2747abd8] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 5689633f >2014-09-26 23:38:32,757 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [2747abd8] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 32a651a0 >2014-09-26 23:38:32,757 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-33) [2747abd8] Discovered no tasks on Storage Pool iscsi-el7 >2014-09-26 23:38:32,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [5ea38584] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600144f09dbd0500000053a85076000a, physicalVolumeId=OJXETa-XKwC-GizR-hnvw-Cr7H-UWmH-RQz7RG, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=11, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdl=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null], LUNs [id=3600144f09dbd0500000053a84e730003, physicalVolumeId=KgqqOU-mqae-ikMS-Y8eV-8BLg-mdFL-YP4LfA, volumeGroupId=0Z8u7D-gmfq-jt3L-Vffj-Nd8C-VpvD-23RR9w, serial=SNEXENTA_COMSTAR_5H49HFEFE, lunMapping=77, vendorId=NEXENTA, productId=COMSTAR, _lunConnections=[{ id: null, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=10, vendorName=NEXENTA, pathsDictionary={sdo=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=3e419414-ee73-47e8-809d-60de4a88403c, storageDomainName=null]], log id: 460fa5a2 >2014-09-26 23:38:33,601 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp--127.0.0.1-8702-10) [3860788e] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 23:38:33,613 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-09-26 23:38:33,615 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] START, SetVdsStatusVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 1fa7f9af >2014-09-26 23:38:33,616 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] VDS voodoo1 is spm and moved from up calling resetIrs. >2014-09-26 23:38:33,616 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] START, ResetIrsVDSCommand( storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, ignoreFailoverLimit = false, vdsId = 114c2cc6-5123-45bc-8900-5c875b0543c4, ignoreStopFailed = false), log id: 4e830e62 >2014-09-26 23:38:33,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] START, SpmStopVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e), log id: 101f900c >2014-09-26 23:38:33,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] SpmStopVDSCommand::Stopping SPM on vds voodoo1, pool id b86b687a-d073-497a-ac8a-249025419a3e >2014-09-26 23:38:34,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] FINISH, SpmStopVDSCommand, log id: 101f900c >2014-09-26 23:38:34,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] FINISH, ResetIrsVDSCommand, log id: 4e830e62 >2014-09-26 23:38:34,209 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] FINISH, SetVdsStatusVDSCommand, log id: 1fa7f9af >2014-09-26 23:38:34,228 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: b86b687a-d073-497a-ac8a-249025419a3e value: POOL >] >2014-09-26 23:38:34,267 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-8-thread-1) [3860788e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 114c2cc6-5123-45bc-8900-5c875b0543c4 Type: VDS >2014-09-26 23:38:34,276 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-1) [3860788e] Correlation ID: 3860788e, Job ID: 89aafb7c-bd0c-4f64-a345-9e6272803650, Call Stack: null, Custom Event ID: -1, Message: Host voodoo1 was switched to Maintenance mode by admin. >2014-09-26 23:38:36,712 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) [765ca739] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 114c2cc6-5123-45bc-8900-5c875b0543c4 : voodoo1 >2014-09-26 23:38:36,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-48) Clearing cache of pool: b86b687a-d073-497a-ac8a-249025419a3e for problematic entities of VDS: voodoo1. >2014-09-26 23:38:36,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-48) Removing vds [114c2cc6-5123-45bc-8900-5c875b0543c4] from the domain in maintenance cache >2014-09-26 23:38:36,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-48) Removing host(s) [114c2cc6-5123-45bc-8900-5c875b0543c4] from hosts unseen domain report cache >2014-09-26 23:38:36,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-55) [765ca739] START, DisconnectStoragePoolVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, vds_spm_id = 3), log id: 6cd59080 >2014-09-26 23:38:40,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-55) [765ca739] FINISH, DisconnectStoragePoolVDSCommand, log id: 6cd59080 >2014-09-26 23:38:40,171 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-55) [784dab14] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:38:40,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-55) [784dab14] START, DisconnectStorageServerVDSCommand(HostName = voodoo1, HostId = 114c2cc6-5123-45bc-8900-5c875b0543c4, storagePoolId = b86b687a-d073-497a-ac8a-249025419a3e, storageType = ISCSI, connectionList = [{ id: af150e8e-4d74-4810-b8bf-0c6a19637dbf, connection: 10.35.16.25, iqn: iqn.1994-05.com.redhat:nsoffer-target1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: e8d58651-6414-4fc2-b281-2141cc97829b, connection: 10.35.0.98, iqn: iqn.1994-05.com.redhat:target6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 15145c10 >2014-09-26 23:38:41,654 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-30) [1347cf38] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain ff559f46-c495-4f6b-901c-2a624042a050 status from Active to Unknown, reason : no reporting hosts >2014-09-26 23:38:41,698 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-30) [1347cf38] Storage Pool b86b687a-d073-497a-ac8a-249025419a3e - Updating Storage Domain 3e419414-ee73-47e8-809d-60de4a88403c status from Active to Unknown, reason : no reporting hosts >2014-09-26 23:38:41,709 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-30) [680add6] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: b86b687a-d073-497a-ac8a-249025419a3e Type: StoragePool >2014-09-26 23:38:41,731 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) [680add6] Correlation ID: 680add6, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center iscsi-el7. Setting status to Non Responsive. >2014-09-26 23:38:41,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-55) [784dab14] FINISH, DisconnectStorageServerVDSCommand, return: {e8d58651-6414-4fc2-b281-2141cc97829b=0, af150e8e-4d74-4810-b8bf-0c6a19637dbf=0}, log id: 15145c10
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1147085
: 941720 |
941721