Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 945692 Details for
Bug 1151516
[restapi] can't create new ppc64 VM via restapi: Migration option is not supported in this CPU architecture.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine.log
engine.log (text/plain), 1.44 MB, created by
Jiri Belka
on 2014-10-10 15:14:15 UTC
(
hide
)
Description:
engine.log
Filename:
MIME Type:
Creator:
Jiri Belka
Created:
2014-10-10 15:14:15 UTC
Size:
1.44 MB
patch
obsolete
>2014-10-07 15:19:37,880 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-10-07 15:19:37,880 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-10-07 15:19:37,890 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-10-07 15:19:37,890 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-10-07 15:19:37,890 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-10-07 15:19:37,891 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-10-07 15:19:37,891 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-10-07 15:19:37,891 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-10-07 15:19:37,891 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_AJP_PORT" is "8702". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war "/usr/share/ovirt-engine/branding/rhev-2.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-10-07 15:19:37,892 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-10-07 15:19:37,893 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_HOST" is "localhost". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_PORT" is "5432". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SECURED" is "False". >2014-10-07 15:19:37,901 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_USER" is "engine". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_EXTENSION_PATH" is "/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_FQDN" is "jb-rhevm35.rhev.lab.eng.brq.redhat.com". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_GROUP" is "ovirt". >2014-10-07 15:19:37,902 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTP_PORT" is "None". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-10-07 15:19:37,903 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-10-07 15:19:37,904 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-10-07 15:19:37,904 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-10-07 15:19:37,910 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PERM_MAX" is "256m". >2014-10-07 15:19:37,916 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PERM_MIN" is "256m". >2014-10-07 15:19:37,916 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-10-07 15:19:37,917 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-10-07 15:19:37,918 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_BASE_URL" is "". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_DASHBOARD_URL" is "/flow.html?viewAsDashboardFrame=true". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_NOT_INSTALLED_URL" is "/ovirt-engine/ReportsNotInstalled.html". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_PROXY_URL" is "/ovirt/reports-interface". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_READ_TIMEOUT" is "". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_RIGHTCLICK_URL" is "". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_VERIFY_CHAIN" is "true". >2014-10-07 15:19:37,924 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_VERIFY_HOST" is "true". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_STOP_TIME" is "10". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_USER" is "ovirt". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-10-07 15:19:37,925 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-10-07 15:19:37,926 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-10-07 15:19:37,926 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 38) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-10-07 15:19:46,925 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Start initializing Backend >2014-10-07 15:19:47,332 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 43) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-10-07 15:19:47,457 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Running ovirt-engine 3.5.0-0.14.beta.el6ev >2014-10-07 15:19:47,458 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 43) Start initializing dictionaries >2014-10-07 15:19:47,460 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 43) Finished initializing dictionaries >2014-10-07 15:19:47,460 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Start initializing AuditLogCleanupManager >2014-10-07 15:19:47,461 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-10-07 15:19:47,483 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Finished initializing AuditLogCleanupManager >2014-10-07 15:19:47,484 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Start initializing CommandEntityCleanupManager >2014-10-07 15:19:47,485 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Setting command entity cleanup manager to run at: 35 35 3 * * ? >2014-10-07 15:19:47,489 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 43) Finished initializing CommandEntityCleanupManager >2014-10-07 15:19:47,491 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 43) Start initializing TagsDirector >2014-10-07 15:19:47,505 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 43) Tag root added to tree >2014-10-07 15:19:47,521 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 43) Finished initializing TagsDirector >2014-10-07 15:19:47,521 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 43) Start initializing IsoDomainListSyncronizer >2014-10-07 15:19:47,530 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 43) Finished initializing IsoDomainListSyncronizer >2014-10-07 15:19:47,571 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Completed initializing handlers >2014-10-07 15:19:47,600 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Start initializing ErrorTranslatorImpl >2014-10-07 15:19:47,616 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-10-07 15:19:47,617 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Finished initializing ErrorTranslatorImpl >2014-10-07 15:19:47,617 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Start initializing ErrorTranslatorImpl >2014-10-07 15:19:47,617 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 43) Finished initializing ErrorTranslatorImpl >2014-10-07 15:19:47,617 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 43) Mark incomplete jobs as UNKNOWN >2014-10-07 15:19:47,671 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 43) Start initializing JobRepositoryCleanupManager >2014-10-07 15:19:47,672 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 43) Finished initializing JobRepositoryCleanupManager >2014-10-07 15:19:47,675 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 43) Start initializing AutoRecoveryManager >2014-10-07 15:19:47,679 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 43) Finished initializing AutoRecoveryManager >2014-10-07 15:19:47,680 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 43) Start initializing ExecutionMessageDirector >2014-10-07 15:19:47,682 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 43) Finished initializing ExecutionMessageDirector >2014-10-07 15:19:47,725 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Loading extension 'builtin-authn-internal' >2014-10-07 15:19:47,726 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Extension 'builtin-authn-internal' loaded >2014-10-07 15:19:47,728 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Loading extension 'internal' >2014-10-07 15:19:47,730 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Extension 'internal' loaded >2014-10-07 15:19:47,731 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Initializing extension 'builtin-authn-internal' >2014-10-07 15:19:47,731 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Extension 'builtin-authn-internal' initialized >2014-10-07 15:19:47,732 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Initializing extension 'internal' >2014-10-07 15:19:47,732 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Extension 'internal' initialized >2014-10-07 15:19:47,732 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Start of enabled extensions list >2014-10-07 15:19:47,733 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' >2014-10-07 15:19:47,733 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' >2014-10-07 15:19:47,733 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 43) End of enabled extensions list >2014-10-07 15:19:47,795 INFO [org.ovirt.engine.core.bll.aaa.DbUserCacheManager] (ServerService Thread Pool -- 41) Start initializing DbUserCacheManager >2014-10-07 15:19:47,813 INFO [org.ovirt.engine.core.bll.aaa.DbUserCacheManager] (ServerService Thread Pool -- 41) Finished initializing DbUserCacheManager >2014-10-07 15:19:47,831 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ServerService Thread Pool -- 41) Initialization of AsyncTaskManager completed successfully. >2014-10-07 15:19:47,833 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 41) Start initializing ResourceManager >2014-10-07 15:19:47,922 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 41) Finished initializing ResourceManager >2014-10-07 15:19:47,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 41) Initialization of OvfDataUpdater completed successfully. >2014-10-07 15:19:47,927 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Start scheduling to enable vds load balancer >2014-10-07 15:19:47,928 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Finished scheduling to enable vds load balancer >2014-10-07 15:19:47,928 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Start HA Reservation check >2014-10-07 15:19:47,928 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Finished HA Reservation check >2014-10-07 15:19:47,942 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 41) Init VM custom properties utilities >2014-10-07 15:19:47,942 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 41) Init device custom properties utilities >2014-10-07 15:19:47,943 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-7-thread-1) Start initializing MacPoolManagerRanges >2014-10-07 15:19:47,957 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Initializing Scheduling manager >2014-10-07 15:19:47,963 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-7-thread-1) Finished initializing. Available MACs in pool: 256 >2014-10-07 15:19:48,017 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) External scheduler disabled, discovery skipped >2014-10-07 15:19:48,017 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Initialized Scheduling manager >2014-10-07 15:19:48,017 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 41) Initializing DWH Heart Beat >2014-10-07 15:19:48,024 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 41) DWH Heart Beat initialized >2014-10-07 15:19:48,104 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-1) Deactivating non existing principal admin::internal >2014-10-07 15:22:23,264 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-1) Invalid locale found in configuration: >2014-10-07 15:22:23,265 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-1) Invalid locale found in configuration: >2014-10-07 15:22:58,925 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-7) Invalid locale found in configuration: >2014-10-07 15:22:58,926 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-7) Invalid locale found in configuration: >2014-10-07 15:23:44,107 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-8) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-10-07 15:23:44,125 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-8) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-10-07 15:23:44,144 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-8) Invalid locale found in configuration: >2014-10-07 15:23:44,144 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-8) Invalid locale found in configuration: >2014-10-07 15:23:50,689 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2014-10-07 15:23:50,711 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: UNASSIGNED not exist in string table >2014-10-07 15:23:50,712 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-10-07 15:23:50,712 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-10-07 15:23:50,712 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-10-07 15:23:50,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-10-07 15:23:50,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-10-07 15:23:50,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_ADDED_DISK_PROFILE not exist in string table >2014-10-07 15:23:50,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_ADD_DISK_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_REMOVED_DISK_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_REMOVE_DISK_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_UPDATED_DISK_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_UPDATE_DISK_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_ADDED_CPU_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_ADD_CPU_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_REMOVED_CPU_PROFILE not exist in string table >2014-10-07 15:23:50,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_REMOVE_CPU_PROFILE not exist in string table >2014-10-07 15:23:50,715 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_UPDATED_CPU_PROFILE not exist in string table >2014-10-07 15:23:50,715 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_UPDATE_CPU_PROFILE not exist in string table >2014-10-07 15:23:51,206 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-07 15:23:54,905 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginUserCommand internal: false. >2014-10-07 15:42:41,703 ERROR [org.ovirt.engine.core.bll.FenceExecutor] (ajp-/127.0.0.1:8702-9) Failed to run Power Management command on Host , no running proxy Host was found. >2014-10-07 15:42:50,921 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [62a1240b] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-07 15:42:51,219 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-07 15:42:51,243 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-0000000001f1 value: REGISTER_VDS >, sharedLocks= ] >2014-10-07 15:42:51,288 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] START, RemoveVdsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 26b85284 >2014-10-07 15:42:51,288 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] FINISH, RemoveVdsVDSCommand, log id: 26b85284 >2014-10-07 15:42:51,325 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] START, AddVdsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 3e567525 >2014-10-07 15:42:51,325 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] AddVds - entered , starting logic to add VDS 04f67d65-72bc-4ddc-88b7-81d0053dff0b >2014-10-07 15:42:51,361 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] AddVds - VDS 04f67d65-72bc-4ddc-88b7-81d0053dff0b was added, will try to add it to the resource manager >2014-10-07 15:42:51,367 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [6b535c51] Entered VdsManager constructor >2014-10-07 15:42:51,391 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [6b535c51] Initialize vdsBroker (10.34.63.222,54,321) >2014-10-07 15:42:51,608 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [6b535c51] VDS 04f67d65-72bc-4ddc-88b7-81d0053dff0b was added to the Resource Manager >2014-10-07 15:42:51,614 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [6b535c51] FINISH, AddVdsVDSCommand, log id: 3e567525 >2014-10-07 15:42:51,719 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [6b535c51] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-07 15:42:51,756 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [6b535c51] Correlation ID: 62a1240b, Job ID: a3d66f5f-e2cb-4be2-a324-b74fa4255ffc, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was added by admin. >2014-10-07 15:42:51,794 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Lock Acquired to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-07 15:42:51,807 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-07 15:42:51,820 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Before Installation host 04f67d65-72bc-4ddc-88b7-81d0053dff0b, dell-r210ii-03 >2014-10-07 15:42:51,911 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 55edfd16 >2014-10-07 15:42:51,942 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] FINISH, SetVdsStatusVDSCommand, log id: 55edfd16 >2014-10-07 15:42:52,032 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Installation 10.34.63.222: Connected to host 10.34.63.222 with SSH key fingerprint: 17:16:ef:e1:eb:47:07:81:43:e0:34:6b:d9:0d:51:46 >2014-10-07 15:42:52,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Connected to host 10.34.63.222 with SSH key fingerprint: 17:16:ef:e1:eb:47:07:81:43:e0:34:6b:d9:0d:51:46. >2014-10-07 15:42:52,144 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Installation of 10.34.63.222. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-07 15:42:52,145 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-7-thread-4) Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' is missing, creating >2014-10-07 15:42:52,260 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-7-thread-4) SSH execute root@10.34.63.222 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-07 15:42:53,096 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Initializing >2014-10-07 15:42:53,198 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Initializing. >2014-10-07 15:42:53,214 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Environment setup >2014-10-07 15:42:53,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Environment setup. >2014-10-07 15:42:53,252 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Environment packages setup >2014-10-07 15:42:53,303 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Environment packages setup. >2014-10-07 15:42:54,206 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Programs detection >2014-10-07 15:42:54,271 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Programs detection. >2014-10-07 15:42:54,272 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Environment customization >2014-10-07 15:42:54,336 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Environment customization. >2014-10-07 15:42:54,336 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Kdump supported >2014-10-07 15:42:54,407 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Kdump supported. >2014-10-07 15:42:54,429 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Logs at host located at: '/tmp/ovirt-host-deploy-20141007154252-a6061h.log' >2014-10-07 15:42:54,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Logs at host located at: '/tmp/ovirt-host-deploy-20141007154252-a6061h.log'. >2014-10-07 15:42:54,640 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.63.222 reports unique id 4C4C4544-0058-3410-8058-C3C04F38354A >2014-10-07 15:42:54,678 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0058-3410-8058-C3C04F38354A to Host 10.34.63.222 >2014-10-07 15:42:54,687 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-66) Initializing Host: dell-r210ii-03 >2014-10-07 15:42:54,837 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Disabling Kdump integration >2014-10-07 15:42:54,895 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Disabling Kdump integration. >2014-10-07 15:42:54,925 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Setup validation >2014-10-07 15:42:54,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Setup validation. >2014-10-07 15:42:54,978 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Hardware supports virtualization >2014-10-07 15:42:55,069 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Hardware supports virtualization. >2014-10-07 15:42:55,069 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Transaction setup >2014-10-07 15:42:55,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Transaction setup. >2014-10-07 15:42:55,140 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Misc configuration >2014-10-07 15:42:55,185 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Misc configuration. >2014-10-07 15:42:55,186 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Package installation >2014-10-07 15:42:55,240 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Package installation. >2014-10-07 15:42:55,824 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum Status: Downloading Packages >2014-10-07 15:42:55,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum Status: Downloading Packages. >2014-10-07 15:42:56,837 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum Download/Verify: 2:qemu-kvm-rhev-tools-0.12.1.2-2.448.el6.x86_64 >2014-10-07 15:42:56,876 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum Download/Verify: 2:qemu-kvm-rhev-tools-0.12.1.2-2.448.el6.x86_64. >2014-10-07 15:42:56,876 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum Status: Check Package Signatures >2014-10-07 15:42:56,912 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum Status: Check Package Signatures. >2014-10-07 15:42:56,912 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum Status: Running Test Transaction >2014-10-07 15:42:56,953 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum Status: Running Test Transaction. >2014-10-07 15:42:56,953 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum Status: Running Transaction >2014-10-07 15:42:56,988 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum Status: Running Transaction. >2014-10-07 15:42:57,118 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum install: 1/1: 2:qemu-kvm-rhev-tools-0.12.1.2-2.448.el6.x86_64 >2014-10-07 15:42:57,154 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum install: 1/1: 2:qemu-kvm-rhev-tools-0.12.1.2-2.448.el6.x86_64. >2014-10-07 15:42:57,783 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Yum Verify: 1/1: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.448.el6 - u >2014-10-07 15:42:57,819 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Yum Verify: 1/1: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.448.el6 - u. >2014-10-07 15:42:57,987 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Misc configuration >2014-10-07 15:42:58,041 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Misc configuration. >2014-10-07 15:42:58,074 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Setting time >2014-10-07 15:42:58,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Setting time. >2014-10-07 15:43:00,938 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Enrolling certificate >2014-10-07 15:43:00,975 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Enrolling certificate. >2014-10-07 15:43:02,235 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Transaction commit >2014-10-07 15:43:02,285 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Transaction commit. >2014-10-07 15:43:03,298 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Closing up >2014-10-07 15:43:03,336 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Closing up. >2014-10-07 15:43:04,277 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stopping libvirtd >2014-10-07 15:43:04,315 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stopping libvirtd. >2014-10-07 15:43:04,315 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Starting vdsm >2014-10-07 15:43:04,352 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Starting vdsm. >2014-10-07 15:43:07,884 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Pre-termination >2014-10-07 15:43:07,935 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Pre-termination. >2014-10-07 15:43:07,949 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141007154307-10.34.63.222-65fe5244.log' >2014-10-07 15:43:07,992 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141007154307-10.34.63.222-65fe5244.log'. >2014-10-07 15:43:08,250 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.222: Stage: Termination >2014-10-07 15:43:08,303 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 65fe5244, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-03. Stage: Termination. >2014-10-07 15:43:08,367 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-07 15:43:08,373 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-07 15:43:08,375 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-07 15:43:08,376 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-5) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-07 15:43:08,378 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-07 15:43:08,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Command PollVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-07 15:43:08,922 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-07 15:43:09,216 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-4) [65fe5244] Engine managed to communicate with VDSM agent on host dell-r210ii-03 >2014-10-07 15:43:09,951 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-7-thread-4) [14a18b49] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN >2014-10-07 15:43:09,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (org.ovirt.thread.pool-7-thread-4) [14a18b49] START, SetupNetworksVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-0000000001f1, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=true, required=true, migration=true}, providedBy=null, label=null, qosId=null}], > bonds=[], > interfaces=[em1 {id=6c1b5c8b-2022-4fbe-b03e-351787763b00, vdsId=04f67d65-72bc-4ddc-88b7-81d0053dff0b, macAddress=d0:67:e5:ee:63:ec, networkName=rhevm, baseInterface=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.34.63.222, subnet=255.255.252.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, > em2 {id=e40ab110-e566-41f7-bc2a-118c512fcc78, vdsId=04f67d65-72bc-4ddc-88b7-81d0053dff0b, macAddress=d0:67:e5:ee:63:ed, networkName=null, baseInterface=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}], > removedNetworks=[], > removedBonds=[]), log id: 747abf61 >2014-10-07 15:43:10,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (org.ovirt.thread.pool-7-thread-4) [14a18b49] FINISH, SetupNetworksVDSCommand, log id: 747abf61 >2014-10-07 15:43:10,033 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-07 15:43:18,676 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-07 15:43:18,988 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN >2014-10-07 15:43:19,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] START, SetSafeNetworkConfigVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 4189a1a >2014-10-07 15:43:19,041 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] FINISH, SetSafeNetworkConfigVDSCommand, log id: 4189a1a >2014-10-07 15:43:19,055 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-4) [3d28719f] Correlation ID: 3d28719f, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host dell-r210ii-03 >2014-10-07 15:43:19,086 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 67e4c06f >2014-10-07 15:43:19,099 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] FINISH, SetVdsStatusVDSCommand, log id: 67e4c06f >2014-10-07 15:43:19,099 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] After Installation host dell-r210ii-03, VDS >2014-10-07 15:43:19,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-4) [3d28719f] Correlation ID: 65fe5244, Job ID: a3d66f5f-e2cb-4be2-a324-b74fa4255ffc, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 installed >2014-10-07 15:43:19,130 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-4) [3d28719f] Lock freed to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-07 15:43:22,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 772c387a >2014-10-07 15:43:22,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GetHardwareInfoVDSCommand, log id: 772c387a >2014-10-07 15:43:22,432 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-22) [61f29bab] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-07 15:43:22,631 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (DefaultQuartzScheduler_Worker-22) [75bc1f96] Running command: UpdateVdsGroupCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group EDIT_CLUSTER_CONFIGURATION with role type ADMIN >2014-10-07 15:43:22,672 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [75bc1f96] Correlation ID: 75bc1f96, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by system >2014-10-07 15:43:22,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-22) [75bc1f96] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 661f76d9 >2014-10-07 15:43:22,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-22) [75bc1f96] FINISH, GetHardwareInfoVDSCommand, log id: 661f76d9 >2014-10-07 15:43:22,796 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-22) [42b9c8ec] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-07 15:43:22,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-22) [42b9c8ec] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 10afc0c8 >2014-10-07 15:43:22,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-22) [42b9c8ec] FINISH, SetMOMPolicyParametersVDSCommand, log id: 10afc0c8 >2014-10-07 15:43:22,995 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [42b9c8ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-03 was set to Up. >2014-10-07 15:43:23,031 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [42b9c8ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-07 15:43:23,184 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-22) [31981175] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-07 15:43:23,222 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-22) [b5200ed] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-07 16:19:47,929 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-10-07 16:19:48,122 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-68) Deactivating non existing principal admin::internal >2014-10-07 16:31:23,798 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-7) [25017e53] Running command: LogoutUserCommand internal: false. >2014-10-07 16:31:23,807 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [25017e53] Correlation ID: 25017e53, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-07 16:31:23,835 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-10) Invalid locale found in configuration: >2014-10-07 16:31:23,835 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-10) Invalid locale found in configuration: >2014-10-07 16:47:10,208 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-4) Invalid locale found in configuration: >2014-10-07 16:47:10,208 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-4) Invalid locale found in configuration: >2014-10-07 16:47:15,894 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-4) Invalid locale found in configuration: >2014-10-07 16:47:15,894 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-4) Invalid locale found in configuration: >2014-10-07 16:47:27,189 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false. >2014-10-07 16:47:27,196 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-07 16:48:08,111 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [2757fbd0] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-07 16:48:08,145 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [14050605] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-07 16:48:08,157 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [14050605] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-0000000001f1 value: REGISTER_VDS >, sharedLocks= ] >2014-10-07 16:48:08,160 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [14050605] START, RemoveVdsVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 15c24f7b >2014-10-07 16:48:08,164 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [14050605] FINISH, RemoveVdsVDSCommand, log id: 15c24f7b >2014-10-07 16:48:08,165 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [14050605] START, AddVdsVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 619ff743 >2014-10-07 16:48:08,167 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [14050605] AddVds - entered , starting logic to add VDS 7f0606fe-4272-40af-973f-ddfb3f78ab4f >2014-10-07 16:48:08,169 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [14050605] AddVds - VDS 7f0606fe-4272-40af-973f-ddfb3f78ab4f was added, will try to add it to the resource manager >2014-10-07 16:48:08,169 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [14050605] Entered VdsManager constructor >2014-10-07 16:48:08,187 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [14050605] Initialize vdsBroker (10.34.63.223,54,321) >2014-10-07 16:48:08,188 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [14050605] VDS 7f0606fe-4272-40af-973f-ddfb3f78ab4f was added to the Resource Manager >2014-10-07 16:48:08,188 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [14050605] FINISH, AddVdsVDSCommand, log id: 619ff743 >2014-10-07 16:48:08,195 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [14050605] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-07 16:48:08,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [14050605] Correlation ID: 2757fbd0, Job ID: ef01c00b-6e0d-4cdf-b778-9d520ad67055, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was added by admin. >2014-10-07 16:48:08,224 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Lock Acquired to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-07 16:48:08,231 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-07 16:48:08,232 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Before Installation host 7f0606fe-4272-40af-973f-ddfb3f78ab4f, dell-r210ii-04 >2014-10-07 16:48:08,241 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1864a86b >2014-10-07 16:48:08,247 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] FINISH, SetVdsStatusVDSCommand, log id: 1864a86b >2014-10-07 16:48:08,313 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Installation 10.34.63.223: Connected to host 10.34.63.223 with SSH key fingerprint: 25:e8:be:e9:00:4e:0a:d1:a2:07:f0:67:36:06:20:f7 >2014-10-07 16:48:08,324 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Connected to host 10.34.63.223 with SSH key fingerprint: 25:e8:be:e9:00:4e:0a:d1:a2:07:f0:67:36:06:20:f7. >2014-10-07 16:48:08,394 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Installation of 10.34.63.223. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-07 16:48:08,432 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-7-thread-34) SSH execute root@10.34.63.223 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-07 16:48:09,128 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Initializing >2014-10-07 16:48:09,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Initializing. >2014-10-07 16:48:09,145 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Environment setup >2014-10-07 16:48:09,150 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Environment setup. >2014-10-07 16:48:09,154 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Environment packages setup >2014-10-07 16:48:09,160 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Environment packages setup. >2014-10-07 16:48:10,065 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Programs detection >2014-10-07 16:48:10,071 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Programs detection. >2014-10-07 16:48:10,072 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Environment customization >2014-10-07 16:48:10,078 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Environment customization. >2014-10-07 16:48:10,167 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Kdump supported >2014-10-07 16:48:10,172 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Kdump supported. >2014-10-07 16:48:10,186 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Logs at host located at: '/tmp/ovirt-host-deploy-20141007164808-k3f7t9.log' >2014-10-07 16:48:10,191 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Logs at host located at: '/tmp/ovirt-host-deploy-20141007164808-k3f7t9.log'. >2014-10-07 16:48:10,266 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.63.223 reports unique id 4C4C4544-0058-3410-8058-C2C04F38354A >2014-10-07 16:48:10,318 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0058-3410-8058-C2C04F38354A to Host 10.34.63.223 >2014-10-07 16:48:10,391 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Disabling Kdump integration >2014-10-07 16:48:10,396 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Disabling Kdump integration. >2014-10-07 16:48:10,413 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Setup validation >2014-10-07 16:48:10,418 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Setup validation. >2014-10-07 16:48:10,457 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Hardware supports virtualization >2014-10-07 16:48:10,462 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Hardware supports virtualization. >2014-10-07 16:48:10,516 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Transaction setup >2014-10-07 16:48:10,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Transaction setup. >2014-10-07 16:48:10,532 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Misc configuration >2014-10-07 16:48:10,537 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Misc configuration. >2014-10-07 16:48:10,537 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Package installation >2014-10-07 16:48:10,543 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Package installation. >2014-10-07 16:48:11,191 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-8) Initializing Host: dell-r210ii-04 >2014-10-07 16:48:20,736 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Downloading Packages >2014-10-07 16:48:20,751 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Downloading Packages. >2014-10-07 16:48:20,751 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: ioprocess-0.12.0-2.el6ev.x86_64 >2014-10-07 16:48:20,761 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: ioprocess-0.12.0-2.el6ev.x86_64. >2014-10-07 16:48:20,761 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: mom-0.4.1-1.el6_5.noarch >2014-10-07 16:48:20,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: mom-0.4.1-1.el6_5.noarch. >2014-10-07 16:48:20,768 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: python-ioprocess-0.12.0-2.el6ev.noarch >2014-10-07 16:48:20,781 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: python-ioprocess-0.12.0-2.el6ev.noarch. >2014-10-07 16:48:20,781 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: python-ordereddict-1.1-3.el6ev.noarch >2014-10-07 16:48:20,787 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: python-ordereddict-1.1-3.el6ev.noarch. >2014-10-07 16:48:20,787 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-4.16.6-1.el6ev.x86_64 >2014-10-07 16:48:20,797 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-4.16.6-1.el6ev.x86_64. >2014-10-07 16:48:20,797 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-cli-4.16.6-1.el6ev.noarch >2014-10-07 16:48:20,804 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-cli-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:20,805 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-jsonrpc-4.16.6-1.el6ev.noarch >2014-10-07 16:48:20,810 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-jsonrpc-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:20,810 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-python-4.16.6-1.el6ev.noarch >2014-10-07 16:48:20,815 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-python-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:20,815 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-python-zombiereaper-4.16.6-1.el6ev.noarch >2014-10-07 16:48:20,832 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-python-zombiereaper-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:20,832 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-xmlrpc-4.16.6-1.el6ev.noarch >2014-10-07 16:48:20,837 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-xmlrpc-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:20,837 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: vdsm-yajsonrpc-4.16.6-1.el6ev.noarch >2014-10-07 16:48:20,849 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: vdsm-yajsonrpc-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:20,849 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Check Package Signatures >2014-10-07 16:48:20,855 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Check Package Signatures. >2014-10-07 16:48:20,855 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Running Test Transaction >2014-10-07 16:48:20,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Running Test Transaction. >2014-10-07 16:48:20,983 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Running Transaction >2014-10-07 16:48:21,000 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Running Transaction. >2014-10-07 16:48:21,351 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum update: 1/17: vdsm-python-zombiereaper-4.16.6-1.el6ev.noarch >2014-10-07 16:48:21,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum update: 1/17: vdsm-python-zombiereaper-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:21,644 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum update: 2/17: mom-0.4.1-1.el6_5.noarch >2014-10-07 16:48:21,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum update: 2/17: mom-0.4.1-1.el6_5.noarch. >2014-10-07 16:48:22,193 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum install: 3/17: vdsm-yajsonrpc-4.16.6-1.el6ev.noarch >2014-10-07 16:48:22,223 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum install: 3/17: vdsm-yajsonrpc-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:22,519 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum install: 4/17: ioprocess-0.12.0-2.el6ev.x86_64 >2014-10-07 16:48:22,535 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum install: 4/17: ioprocess-0.12.0-2.el6ev.x86_64. >2014-10-07 16:48:22,867 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum install: 5/17: python-ioprocess-0.12.0-2.el6ev.noarch >2014-10-07 16:48:22,887 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum install: 5/17: python-ioprocess-0.12.0-2.el6ev.noarch. >2014-10-07 16:48:23,243 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum update: 6/17: vdsm-python-4.16.6-1.el6ev.noarch >2014-10-07 16:48:23,256 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum update: 6/17: vdsm-python-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:23,751 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum update: 7/17: vdsm-xmlrpc-4.16.6-1.el6ev.noarch >2014-10-07 16:48:23,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum update: 7/17: vdsm-xmlrpc-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:24,051 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum update: 8/17: vdsm-cli-4.16.6-1.el6ev.noarch >2014-10-07 16:48:24,057 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum update: 8/17: vdsm-cli-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:24,435 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum install: 9/17: python-ordereddict-1.1-3.el6ev.noarch >2014-10-07 16:48:24,442 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum install: 9/17: python-ordereddict-1.1-3.el6ev.noarch. >2014-10-07 16:48:24,768 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum install: 10/17: vdsm-jsonrpc-4.16.6-1.el6ev.noarch >2014-10-07 16:48:24,773 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum install: 10/17: vdsm-jsonrpc-4.16.6-1.el6ev.noarch. >2014-10-07 16:48:25,484 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum update: 11/17: vdsm-4.16.6-1.el6ev.x86_64 >2014-10-07 16:48:25,489 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum update: 11/17: vdsm-4.16.6-1.el6ev.x86_64. >2014-10-07 16:48:34,157 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum updated: 12/17: vdsm >2014-10-07 16:48:34,163 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum updated: 12/17: vdsm. >2014-10-07 16:48:35,384 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum updated: 13/17: vdsm-cli >2014-10-07 16:48:35,390 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum updated: 13/17: vdsm-cli. >2014-10-07 16:48:35,643 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum updated: 14/17: vdsm-xmlrpc >2014-10-07 16:48:35,649 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum updated: 14/17: vdsm-xmlrpc. >2014-10-07 16:48:35,860 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum updated: 15/17: vdsm-python >2014-10-07 16:48:35,866 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum updated: 15/17: vdsm-python. >2014-10-07 16:48:36,209 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum updated: 16/17: vdsm-python-zombiereaper >2014-10-07 16:48:36,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum updated: 16/17: vdsm-python-zombiereaper. >2014-10-07 16:48:36,411 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum updated: 17/17: mom >2014-10-07 16:48:36,422 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum updated: 17/17: mom. >2014-10-07 16:48:37,203 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 1/17: python-ordereddict.noarch 0:1.1-3.el6ev - u >2014-10-07 16:48:37,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 1/17: python-ordereddict.noarch 0:1.1-3.el6ev - u. >2014-10-07 16:48:37,256 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 2/17: vdsm-xmlrpc.noarch 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,262 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 2/17: vdsm-xmlrpc.noarch 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,331 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 3/17: vdsm-python-zombiereaper.noarch 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,337 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 3/17: vdsm-python-zombiereaper.noarch 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,406 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 4/17: vdsm.x86_64 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,412 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 4/17: vdsm.x86_64 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,448 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 5/17: ioprocess.x86_64 0:0.12.0-2.el6ev - u >2014-10-07 16:48:37,453 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 5/17: ioprocess.x86_64 0:0.12.0-2.el6ev - u. >2014-10-07 16:48:37,514 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 6/17: vdsm-jsonrpc.noarch 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 6/17: vdsm-jsonrpc.noarch 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,556 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 7/17: vdsm-yajsonrpc.noarch 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,561 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 7/17: vdsm-yajsonrpc.noarch 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,614 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 8/17: vdsm-cli.noarch 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,621 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 8/17: vdsm-cli.noarch 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,673 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 9/17: python-ioprocess.noarch 0:0.12.0-2.el6ev - u >2014-10-07 16:48:37,679 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 9/17: python-ioprocess.noarch 0:0.12.0-2.el6ev - u. >2014-10-07 16:48:37,739 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 10/17: vdsm-python.noarch 0:4.16.6-1.el6ev - u >2014-10-07 16:48:37,745 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 10/17: vdsm-python.noarch 0:4.16.6-1.el6ev - u. >2014-10-07 16:48:37,798 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 11/17: mom.noarch 0:0.4.1-1.el6_5 - u >2014-10-07 16:48:37,810 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 11/17: mom.noarch 0:0.4.1-1.el6_5 - u. >2014-10-07 16:48:37,840 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 12/17: mom.noarch 0:0.4.0-1.el6ev - ud >2014-10-07 16:48:37,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 12/17: mom.noarch 0:0.4.0-1.el6ev - ud. >2014-10-07 16:48:37,846 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 13/17: vdsm.x86_64 0:4.14.17-1.el6ev - ud >2014-10-07 16:48:37,851 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 13/17: vdsm.x86_64 0:4.14.17-1.el6ev - ud. >2014-10-07 16:48:37,851 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 14/17: vdsm-xmlrpc.noarch 0:4.14.17-1.el6ev - ud >2014-10-07 16:48:37,856 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 14/17: vdsm-xmlrpc.noarch 0:4.14.17-1.el6ev - ud. >2014-10-07 16:48:37,857 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 15/17: vdsm-python.x86_64 0:4.14.17-1.el6ev - ud >2014-10-07 16:48:37,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 15/17: vdsm-python.x86_64 0:4.14.17-1.el6ev - ud. >2014-10-07 16:48:37,862 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 16/17: vdsm-python-zombiereaper.noarch 0:4.14.17-1.el6ev - ud >2014-10-07 16:48:37,867 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 16/17: vdsm-python-zombiereaper.noarch 0:4.14.17-1.el6ev - ud. >2014-10-07 16:48:37,867 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 17/17: vdsm-cli.noarch 0:4.14.17-1.el6ev - ud >2014-10-07 16:48:37,872 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 17/17: vdsm-cli.noarch 0:4.14.17-1.el6ev - ud. >2014-10-07 16:48:37,960 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Misc configuration >2014-10-07 16:48:37,966 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Misc configuration. >2014-10-07 16:48:38,008 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Setting time >2014-10-07 16:48:38,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Setting time. >2014-10-07 16:48:40,575 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Enrolling certificate >2014-10-07 16:48:40,587 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Enrolling certificate. >2014-10-07 16:48:41,884 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Transaction commit >2014-10-07 16:48:41,890 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Transaction commit. >2014-10-07 16:48:42,671 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Closing up >2014-10-07 16:48:42,677 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Closing up. >2014-10-07 16:48:43,619 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stopping libvirtd >2014-10-07 16:48:43,627 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stopping libvirtd. >2014-10-07 16:48:44,177 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Starting vdsm >2014-10-07 16:48:44,184 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Starting vdsm. >2014-10-07 16:48:46,360 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Pre-termination >2014-10-07 16:48:46,367 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Pre-termination. >2014-10-07 16:48:46,374 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141007164846-10.34.63.223-1d1a426.log' >2014-10-07 16:48:46,380 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141007164846-10.34.63.223-1d1a426.log'. >2014-10-07 16:48:46,617 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Termination >2014-10-07 16:48:46,622 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1d1a426, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Termination. >2014-10-07 16:48:46,750 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-07 16:48:46,751 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-07 16:48:46,752 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-07 16:48:46,752 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-48) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-07 16:48:46,754 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-07 16:48:46,756 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Command PollVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-07 16:48:47,257 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-07 16:48:47,346 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Engine managed to communicate with VDSM agent on host dell-r210ii-04 >2014-10-07 16:48:47,759 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-34) [1d1a426] The management network rhevm is already configured on host dell-r210ii-04 >2014-10-07 16:48:47,760 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1bb28420 >2014-10-07 16:48:47,765 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] FINISH, SetVdsStatusVDSCommand, log id: 1bb28420 >2014-10-07 16:48:47,765 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] After Installation host dell-r210ii-04, VDS >2014-10-07 16:48:47,772 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Correlation ID: 1d1a426, Job ID: ef01c00b-6e0d-4cdf-b778-9d520ad67055, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 installed >2014-10-07 16:48:47,777 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-34) [1d1a426] Lock freed to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-07 16:48:50,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]), log id: 38385fa1 >2014-10-07 16:48:50,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GetHardwareInfoVDSCommand, log id: 38385fa1 >2014-10-07 16:48:50,341 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-19) [43184fb8] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-07 16:48:50,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-19) [43184fb8] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]), log id: 2b56c062 >2014-10-07 16:48:50,386 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-19) [43184fb8] FINISH, GetHardwareInfoVDSCommand, log id: 2b56c062 >2014-10-07 16:48:50,413 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-19) [5477d4e4] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-07 16:48:50,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-19) [5477d4e4] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 7f9efdbb >2014-10-07 16:48:50,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-19) [5477d4e4] FINISH, SetMOMPolicyParametersVDSCommand, log id: 7f9efdbb >2014-10-07 16:48:50,494 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [5477d4e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-04 was set to Up. >2014-10-07 16:48:50,499 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [5477d4e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-07 16:48:50,515 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-19) [891e1f7] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-07 16:48:50,522 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-19) [76a76e91] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-07 17:12:03,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetDeviceListVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageType=ISCSI), log id: 11258847 >2014-10-07 17:12:03,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetDeviceListVDSCommand, return: [], log id: 11258847 >2014-10-07 17:12:13,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp-/127.0.0.1:8702-3) START, DiscoverSendTargetsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, connection={ id: null, connection: 10.34.63.202, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };), log id: 6d0280e0 >2014-10-07 17:12:13,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, DiscoverSendTargetsVDSCommand, return: [{ id: null, connection: 10.34.63.202, iqn: iqn.2011-01.brq.str-01:pstehlik, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2012-06.brq.str-01:brq-setup, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2012-10.brq.str-01:cmestreg, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2012-10.brq.str-01:kjachim, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2012-10.brq.str-01:lbednar, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2012-10.brq.str-01:mbetak, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:mpavlik, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], log id: 6d0280e0 >2014-10-07 17:12:15,579 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-2) [244c27dc] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-07 17:12:15,650 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [244c27dc] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2472229 >2014-10-07 17:12:15,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [244c27dc] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 2472229 >2014-10-07 17:12:16,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetDeviceListVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageType=ISCSI), log id: 48044622 >2014-10-07 17:12:16,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=KYXMZs-GJ8V-kVDM-CUhr-PRRh-9MM8-BpN8Ow, volumeGroupId=lw8avY-aiJJ-wZMl-KJX3-7DTp-mOlP-9jWIlH, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1jbelka02, physicalVolumeId=rAD1kd-RBT1-17KP-DZvS-T0iF-Re75-BxCcNy, volumeGroupId=g66kvX-udWl-v3xt-SplJ-dV62-C9et-hTqShs, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1jbelka03, physicalVolumeId=I7psqd-CjI2-sGZW-dBaR-JnDp-0ofC-ZrjFS6, volumeGroupId=, serial=SRH-str01VIRTUAL-DISK, lunMapping=3, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=30, vendorName=RH-str01, pathsDictionary={sdd=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 48044622 >2014-10-07 17:12:25,887 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-07 17:12:25,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] START, CreateVGVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, deviceList=[1jbelka01], force=true), log id: 3d7dbeda >2014-10-07 17:12:26,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] FINISH, CreateVGVDSCommand, return: dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, log id: 3d7dbeda >2014-10-07 17:12:26,876 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] START, CreateStorageDomainVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomain=StorageDomainStatic[iscsi-1, 322e3360-066e-4e98-a0e9-dd44e82f0992], args=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 7d85aad0 >2014-10-07 17:12:32,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] FINISH, CreateStorageDomainVDSCommand, log id: 7d85aad0 >2014-10-07 17:12:32,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] START, GetStorageDomainStatsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992), log id: 74b5a215 >2014-10-07 17:12:32,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 322e3360-066e-4e98-a0e9-dd44e82f0992], log id: 74b5a215 >2014-10-07 17:12:32,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 43f439e6 >2014-10-07 17:12:32,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-8) [59ada0d8] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 43f439e6 >2014-10-07 17:12:32,580 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [59ada0d8] Correlation ID: 59ada0d8, Job ID: ec9c57f1-2d2c-4987-91bc-f1ecb7aa9d97, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-1 was added by admin >2014-10-07 17:12:32,750 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-5) [4529f8aa] Lock Acquired to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= ] >2014-10-07 17:12:32,809 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-5) [4529f8aa] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-07 17:12:32,917 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-5) [513c71d5] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePoolAction group CREATE_STORAGE_POOL with role type ADMIN >2014-10-07 17:12:33,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-5) [513c71d5] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6722a05a >2014-10-07 17:12:33,193 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-5) [513c71d5] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 6722a05a >2014-10-07 17:12:33,241 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-5) [513c71d5] START, CreateStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId=00000002-0002-0002-0002-0000000001f1, storagePoolName=Default, masterDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, domainsIdList=[322e3360-066e-4e98-a0e9-dd44e82f0992], masterVersion=1), log id: 2215fe78 >2014-10-07 17:12:58,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-5) [513c71d5] FINISH, CreateStoragePoolVDSCommand, log id: 2215fe78 >2014-10-07 17:12:58,427 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-5) [513c71d5] Lock freed to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= ] >2014-10-07 17:12:58,431 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [4097d57] Lock Acquired to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= ] >2014-10-07 17:12:58,466 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [4097d57] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-07 17:12:58,483 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [4097d57] Lock freed to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= ] >2014-10-07 17:12:58,485 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [4097d57] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/7/14 5:12 PM >2014-10-07 17:12:58,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-9) [4097d57] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6971c9e9 >2014-10-07 17:12:58,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-7) [4097d57] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d15936b >2014-10-07 17:12:58,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-7) [4097d57] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 5d15936b >2014-10-07 17:12:58,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-9) [4097d57] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 6971c9e9 >2014-10-07 17:12:58,827 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [441fce26] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:12:58,895 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-5) [441fce26] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 6cad2a28 >2014-10-07 17:12:59,045 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-5) [441fce26] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 6cad2a28 >2014-10-07 17:12:59,075 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [441fce26] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992), log id: 16235e7a >2014-10-07 17:12:59,125 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-07 17:12:59,140 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [ca24dae] Correlation ID: ca24dae, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. >2014-10-07 17:12:59,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-5) [ca24dae] hostFromVds::selectedVds - dell-r210ii-04, spmStatus Unknown_Pool, storage pool Default >2014-10-07 17:12:59,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 69ecaeaf >2014-10-07 17:13:00,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] FINISH, ConnectStoragePoolVDSCommand, log id: 69ecaeaf >2014-10-07 17:13:00,806 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-5) [ca24dae] hostFromVds::Connected host to pool - selectedVds - dell-r210ii-04, spmStatus Free, storage pool Default >2014-10-07 17:13:00,819 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-5) [ca24dae] starting spm on vds dell-r210ii-04, storage pool Default, prevId -1, LVER -1 >2014-10-07 17:13:00,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] START, SpmStartVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 33961208 >2014-10-07 17:13:00,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] spmStart polling started: taskId = 15d71a01-1ffc-4431-8fbd-23381152833f >2014-10-07 17:13:22,974 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] spmStart polling ended: taskId = 15d71a01-1ffc-4431-8fbd-23381152833f task status = finished >2014-10-07 17:13:22,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] spmStart polling ended, spm status: SPM >2014-10-07 17:13:22,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=15d71a01-1ffc-4431-8fbd-23381152833f), log id: 21b846de >2014-10-07 17:13:22,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] FINISH, HSMClearTaskVDSCommand, log id: 21b846de >2014-10-07 17:13:22,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3ce68736, log id: 33961208 >2014-10-07 17:13:22,999 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-5) [ca24dae] Initialize Irs proxy from vds: 10.34.63.223 >2014-10-07 17:13:23,005 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [ca24dae] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dell-r210ii-04 (Address: 10.34.63.223). >2014-10-07 17:13:23,013 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-07 17:13:23,113 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 16235e7a >2014-10-07 17:13:23,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] ActivateStorage Domain. After Connect all hosts to pool. Time:10/7/14 5:13 PM >2014-10-07 17:13:23,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-31) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 2b7efcf9 >2014-10-07 17:13:23,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-30) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 25003b6f >2014-10-07 17:13:23,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-31) FINISH, ConnectStoragePoolVDSCommand, log id: 2b7efcf9 >2014-10-07 17:13:23,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-30) FINISH, ConnectStoragePoolVDSCommand, log id: 25003b6f >2014-10-07 17:13:23,741 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] ActivateStorage Domain. After change storage pool status in vds. Time:10/7/14 5:13 PM >2014-10-07 17:13:23,753 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [ca24dae] Correlation ID: 4097d57, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-1 (Data Center Default) was activated by admin >2014-10-07 17:13:23,762 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [ca24dae] Correlation ID: 513c71d5, Job ID: a3bbbcfb-e8ca-43c5-b935-d65698ef2eec, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center Default by admin >2014-10-07 17:13:23,771 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [ca24dae] Correlation ID: 4529f8aa, Job ID: a3bbbcfb-e8ca-43c5-b935-d65698ef2eec, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-1 was attached to Data Center Default by admin >2014-10-07 17:13:23,775 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp-/127.0.0.1:8702-5) [ca24dae] Trying to release exclusive lock which does not exist, lock key: 322e3360-066e-4e98-a0e9-dd44e82f0992STORAGE >2014-10-07 17:13:23,775 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-5) [ca24dae] Lock freed to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= ] >2014-10-07 17:19:47,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-10-07 17:19:48,012 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [55507fde] Lock Acquired to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-07 17:19:48,014 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [55507fde] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:48,022 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [1b0ede75] Running command: CreateOvfStoresForStorageDomainCommand internal: true. >2014-10-07 17:19:48,024 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [4fde15e] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:48,121 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-35) [23c08cd0] Running command: AddDiskCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group CREATE_DISK with role type USER >2014-10-07 17:19:48,131 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-23) Deactivating non existing principal admin::internal >2014-10-07 17:19:48,270 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-35) [1f171e0d] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:48,319 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f171e0d] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8, newImageDescription = OVF_STORE), log id: 226451c3 >2014-10-07 17:19:48,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f171e0d] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-07 17:19:48,574 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f171e0d] FINISH, CreateImageVDSCommand, return: 31dca8b6-1eb2-4431-8dc6-49ead49c57b8, log id: 226451c3 >2014-10-07 17:19:48,586 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-35) [1f171e0d] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command edefbaa2-f8f6-4de4-9283-590885309faf >2014-10-07 17:19:48,587 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) [1f171e0d] CommandMultiAsyncTasks::AttachTask: Attaching task bf4e6641-280f-4002-9ffe-c745ed2fdf70 to command edefbaa2-f8f6-4de4-9283-590885309faf. >2014-10-07 17:19:48,621 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) [1f171e0d] Adding task bf4e6641-280f-4002-9ffe-c745ed2fdf70 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-07 17:19:48,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) [1f171e0d] Correlation ID: 23c08cd0, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-10-07 17:19:48,675 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [15f19307] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:48,761 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-35) [d8d36b9] Running command: AddDiskCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group CREATE_DISK with role type USER >2014-10-07 17:19:48,787 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-35) [30606a26] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:48,795 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-35) [30606a26] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740, newImageDescription = OVF_STORE), log id: 37b8a212 >2014-10-07 17:19:48,797 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-35) [30606a26] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-07 17:19:48,881 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-35) [30606a26] FINISH, CreateImageVDSCommand, return: 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740, log id: 37b8a212 >2014-10-07 17:19:48,882 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) [30606a26] CommandMultiAsyncTasks::AttachTask: Attaching task aeba6eeb-37c1-4a3d-81a3-296a51431d16 to command edefbaa2-f8f6-4de4-9283-590885309faf. >2014-10-07 17:19:48,896 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) [30606a26] Adding task aeba6eeb-37c1-4a3d-81a3-296a51431d16 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-07 17:19:48,918 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) [30606a26] Correlation ID: d8d36b9, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-10-07 17:19:48,962 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [30606a26] BaseAsyncTask::startPollingTask: Starting to poll task bf4e6641-280f-4002-9ffe-c745ed2fdf70. >2014-10-07 17:19:48,962 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [30606a26] BaseAsyncTask::startPollingTask: Starting to poll task aeba6eeb-37c1-4a3d-81a3-296a51431d16. >2014-10-07 17:19:48,963 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [30606a26] Lock freed to object EngineLock [exclusiveLocks= key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-07 17:19:54,235 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-40) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-10-07 17:19:54,245 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) SPMAsyncTask::PollTask: Polling task bf4e6641-280f-4002-9ffe-c745ed2fdf70 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-07 17:19:54,246 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) BaseAsyncTask::onTaskEndSuccess: Task bf4e6641-280f-4002-9ffe-c745ed2fdf70 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-07 17:19:54,247 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-40) Task with DB Task ID c1c580b3-3b38-419d-a2f8-a3e899f43dd5 and VDSM Task ID aeba6eeb-37c1-4a3d-81a3-296a51431d16 is in state Polling. End action for command edefbaa2-f8f6-4de4-9283-590885309faf will proceed when all the entitys tasks are completed. >2014-10-07 17:19:54,247 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) SPMAsyncTask::PollTask: Polling task aeba6eeb-37c1-4a3d-81a3-296a51431d16 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-07 17:19:54,247 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-40) BaseAsyncTask::onTaskEndSuccess: Task aeba6eeb-37c1-4a3d-81a3-296a51431d16 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-07 17:19:54,247 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-40) CommandAsyncTask::endActionIfNecessary: All tasks of command edefbaa2-f8f6-4de4-9283-590885309faf has ended -> executing endAction >2014-10-07 17:19:54,248 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-40) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: edefbaa2-f8f6-4de4-9283-590885309faf): calling endAction . >2014-10-07 17:19:54,249 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-40) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateOvfStoresForStorageDomain, executionIndex: 0 >2014-10-07 17:19:54,256 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-40) [1b0ede75] Ending command successfully: org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand >2014-10-07 17:19:54,307 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-40) [30606a26] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-07 17:19:54,333 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-40) [30606a26] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 6964cfe7 >2014-10-07 17:19:54,348 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-40) [30606a26] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f3194994, log id: 6964cfe7 >2014-10-07 17:19:54,379 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-40) [1f171e0d] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-07 17:19:54,381 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-40) [1f171e0d] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 3d83a972 >2014-10-07 17:19:54,394 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-40) [1f171e0d] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a0ef36fe, log id: 3d83a972 >2014-10-07 17:19:54,492 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-40) [1b0ede75] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:54,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [1b0ede75] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 6fc1d407 >2014-10-07 17:19:54,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [1b0ede75] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-07 17:19:54,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [1b0ede75] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":null} > >2014-10-07 17:19:54,683 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [1b0ede75] FINISH, SetVolumeDescriptionVDSCommand, log id: 6fc1d407 >2014-10-07 17:19:54,749 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-07 17:19:54,756 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] Running command: UploadStreamCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:54,769 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] START, UploadStreamVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 3fa209f2 >2014-10-07 17:19:54,769 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] -- executeVdsBrokerCommand: >2014-10-07 17:19:54,769 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > size=10,240 > >2014-10-07 17:19:56,920 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] FINISH, UploadStreamVDSCommand, log id: 3fa209f2 >2014-10-07 17:19:56,922 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-40) [3e375486] CommandMultiAsyncTasks::AttachTask: Attaching task 6ec2d30d-c6e0-4608-a217-d68b08e952a6 to command edefbaa2-f8f6-4de4-9283-590885309faf. >2014-10-07 17:19:56,939 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-40) [3e375486] Adding task 6ec2d30d-c6e0-4608-a217-d68b08e952a6 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-07 17:19:56,946 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-07 17:19:56,955 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 7f132082 >2014-10-07 17:19:56,955 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-07 17:19:56,955 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Tue Oct 07 17:19:54 CEST 2014","Size":10240} > >2014-10-07 17:19:57,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] FINISH, SetVolumeDescriptionVDSCommand, log id: 7f132082 >2014-10-07 17:19:57,102 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 68dbd52e >2014-10-07 17:19:57,102 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-07 17:19:57,102 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":null} > >2014-10-07 17:19:57,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [3e375486] FINISH, SetVolumeDescriptionVDSCommand, log id: 68dbd52e >2014-10-07 17:19:57,281 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-07 17:19:57,286 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] Running command: UploadStreamCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-07 17:19:57,287 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] START, UploadStreamVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 23b47a37 >2014-10-07 17:19:57,287 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] -- executeVdsBrokerCommand: >2014-10-07 17:19:57,288 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > size=10,240 > >2014-10-07 17:19:59,283 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] FINISH, UploadStreamVDSCommand, log id: 23b47a37 >2014-10-07 17:19:59,286 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-40) [4eee9436] CommandMultiAsyncTasks::AttachTask: Attaching task 05fb65a6-add7-42fa-a181-59bd92f6b55f to command edefbaa2-f8f6-4de4-9283-590885309faf. >2014-10-07 17:19:59,296 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-40) [4eee9436] Adding task 05fb65a6-add7-42fa-a181-59bd92f6b55f (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-07 17:19:59,301 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-07 17:19:59,304 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 35f2a9e7 >2014-10-07 17:19:59,304 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-07 17:19:59,304 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Tue Oct 07 17:19:54 CEST 2014","Size":10240} > >2014-10-07 17:19:59,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] FINISH, SetVolumeDescriptionVDSCommand, log id: 35f2a9e7 >2014-10-07 17:19:59,466 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] BaseAsyncTask::startPollingTask: Starting to poll task 6ec2d30d-c6e0-4608-a217-d68b08e952a6. >2014-10-07 17:19:59,466 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] BaseAsyncTask::startPollingTask: Starting to poll task 05fb65a6-add7-42fa-a181-59bd92f6b55f. >2014-10-07 17:19:59,467 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain completed, handling the result. >2014-10-07 17:19:59,467 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain succeeded, clearing tasks. >2014-10-07 17:19:59,467 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] SPMAsyncTask::ClearAsyncTask: Attempting to clear task aeba6eeb-37c1-4a3d-81a3-296a51431d16 >2014-10-07 17:19:59,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = aeba6eeb-37c1-4a3d-81a3-296a51431d16), log id: 720f4081 >2014-10-07 17:19:59,470 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=aeba6eeb-37c1-4a3d-81a3-296a51431d16), log id: 47540fa7 >2014-10-07 17:19:59,490 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] FINISH, HSMClearTaskVDSCommand, log id: 47540fa7 >2014-10-07 17:19:59,490 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] FINISH, SPMClearTaskVDSCommand, log id: 720f4081 >2014-10-07 17:19:59,504 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] BaseAsyncTask::removeTaskFromDB: Removed task aeba6eeb-37c1-4a3d-81a3-296a51431d16 from DataBase >2014-10-07 17:19:59,504 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] SPMAsyncTask::ClearAsyncTask: Attempting to clear task bf4e6641-280f-4002-9ffe-c745ed2fdf70 >2014-10-07 17:19:59,504 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = bf4e6641-280f-4002-9ffe-c745ed2fdf70), log id: 7240d192 >2014-10-07 17:19:59,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=bf4e6641-280f-4002-9ffe-c745ed2fdf70), log id: 7d7f02d7 >2014-10-07 17:19:59,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] FINISH, HSMClearTaskVDSCommand, log id: 7d7f02d7 >2014-10-07 17:19:59,525 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-40) [4eee9436] FINISH, SPMClearTaskVDSCommand, log id: 7240d192 >2014-10-07 17:19:59,530 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-40) [4eee9436] BaseAsyncTask::removeTaskFromDB: Removed task bf4e6641-280f-4002-9ffe-c745ed2fdf70 from DataBase >2014-10-07 17:19:59,530 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-40) [4eee9436] [within thread]: Some of the tasks related to command id edefbaa2-f8f6-4de4-9283-590885309faf were not cleared yet (Task id 6ec2d30d-c6e0-4608-a217-d68b08e952a6 is in state Polling). >2014-10-07 17:20:04,253 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-75) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-10-07 17:20:04,259 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task 05fb65a6-add7-42fa-a181-59bd92f6b55f (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-07 17:20:04,259 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task 05fb65a6-add7-42fa-a181-59bd92f6b55f (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-07 17:20:04,259 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-75) Task with DB Task ID 1605454f-d306-4d6f-a308-c59be1f13873 and VDSM Task ID 6ec2d30d-c6e0-4608-a217-d68b08e952a6 is in state Polling. End action for command edefbaa2-f8f6-4de4-9283-590885309faf will proceed when all the entitys tasks are completed. >2014-10-07 17:20:04,259 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task 6ec2d30d-c6e0-4608-a217-d68b08e952a6 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-07 17:20:04,259 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task 6ec2d30d-c6e0-4608-a217-d68b08e952a6 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-07 17:20:04,259 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-75) CommandAsyncTask::endActionIfNecessary: All tasks of command edefbaa2-f8f6-4de4-9283-590885309faf has ended -> executing endAction >2014-10-07 17:20:04,260 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-75) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: edefbaa2-f8f6-4de4-9283-590885309faf): calling endAction . >2014-10-07 17:20:04,260 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-10-07 17:20:04,322 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-10-07 17:20:04,323 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-10-07 17:20:04,323 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-10-07 17:20:04,323 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6ec2d30d-c6e0-4608-a217-d68b08e952a6 >2014-10-07 17:20:04,323 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 6ec2d30d-c6e0-4608-a217-d68b08e952a6), log id: 6e4fb0f2 >2014-10-07 17:20:04,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=6ec2d30d-c6e0-4608-a217-d68b08e952a6), log id: 7feafdf7 >2014-10-07 17:20:04,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] FINISH, HSMClearTaskVDSCommand, log id: 7feafdf7 >2014-10-07 17:20:04,340 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] FINISH, SPMClearTaskVDSCommand, log id: 6e4fb0f2 >2014-10-07 17:20:04,344 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] BaseAsyncTask::removeTaskFromDB: Removed task 6ec2d30d-c6e0-4608-a217-d68b08e952a6 from DataBase >2014-10-07 17:20:04,344 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 05fb65a6-add7-42fa-a181-59bd92f6b55f >2014-10-07 17:20:04,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 05fb65a6-add7-42fa-a181-59bd92f6b55f), log id: 7956a301 >2014-10-07 17:20:04,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=05fb65a6-add7-42fa-a181-59bd92f6b55f), log id: 26e7d4e3 >2014-10-07 17:20:04,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] FINISH, HSMClearTaskVDSCommand, log id: 26e7d4e3 >2014-10-07 17:20:04,360 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] FINISH, SPMClearTaskVDSCommand, log id: 7956a301 >2014-10-07 17:20:04,364 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] BaseAsyncTask::removeTaskFromDB: Removed task 05fb65a6-add7-42fa-a181-59bd92f6b55f from DataBase >2014-10-07 17:20:04,364 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [1b0ede75] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity edefbaa2-f8f6-4de4-9283-590885309faf >2014-10-07 17:21:17,948 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-69) Setting new tasks map. The map contains now 0 tasks >2014-10-07 17:21:17,949 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-69) Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-07 18:19:48,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-10-07 19:19:48,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-10-07 20:19:49,020 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-10-07 21:19:49,047 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-10-07 22:19:49,063 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-10-07 23:19:49,094 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-10-08 00:19:49,114 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-10-08 01:19:49,129 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-10-08 02:19:49,144 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-10-08 03:19:49,159 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-10-08 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-63) Start deleteAgedOutCommandEntities >2014-10-08 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-68) Start deleteAgedOutAuditLogs >2014-10-08 03:35:35,011 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-68) Finished deleteAgedOutAuditLogs >2014-10-08 03:35:35,015 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-63) Finished deleteAgedOutCommandEntities >2014-10-08 04:19:49,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-10-08 05:19:49,187 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-10-08 06:19:49,201 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-10-08 07:19:49,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-10-08 08:19:49,237 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-10-08 09:19:49,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-10-08 09:26:13,500 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-5) [51178a49] Running command: LogoutUserCommand internal: false. >2014-10-08 09:26:13,514 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [51178a49] Correlation ID: 51178a49, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 09:26:13,569 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-1) [19a1af3] Running command: LogoutUserCommand internal: false. >2014-10-08 09:26:13,574 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-9) [dcbd21a] Running command: LogoutUserCommand internal: false. >2014-10-08 09:26:13,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [19a1af3] Correlation ID: 19a1af3, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 09:26:13,578 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [dcbd21a] Correlation ID: dcbd21a, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 09:26:13,592 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-10) [5f7e889f] Running command: LogoutUserCommand internal: false. >2014-10-08 09:26:13,595 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [10069de8] Running command: LogoutUserCommand internal: false. >2014-10-08 09:26:13,597 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-6) [2268f290] Running command: LogoutUserCommand internal: false. >2014-10-08 09:26:13,599 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [10069de8] Correlation ID: 10069de8, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 09:26:13,601 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [5f7e889f] Correlation ID: 5f7e889f, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 09:26:13,603 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [2268f290] Correlation ID: 2268f290, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 09:26:13,644 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-8) Invalid locale found in configuration: >2014-10-08 09:26:13,645 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-8) Invalid locale found in configuration: >2014-10-08 09:26:20,260 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-1) Invalid locale found in configuration: >2014-10-08 09:26:20,260 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-1) Invalid locale found in configuration: >2014-10-08 09:28:37,743 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-9) Invalid locale found in configuration: >2014-10-08 09:28:37,744 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-9) Invalid locale found in configuration: >2014-10-08 09:28:42,413 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginAdminUserCommand internal: false. >2014-10-08 09:28:42,417 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 09:28:42,492 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-10-08 09:29:12,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetDeviceListVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storageType=ISCSI), log id: 38fba0a1 >2014-10-08 09:29:12,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=rAD1kd-RBT1-17KP-DZvS-T0iF-Re75-BxCcNy, volumeGroupId=g66kvX-udWl-v3xt-SplJ-dV62-C9et-hTqShs, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1jbelka03, physicalVolumeId=I7psqd-CjI2-sGZW-dBaR-JnDp-0ofC-ZrjFS6, volumeGroupId=, serial=SRH-str01VIRTUAL-DISK, lunMapping=3, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=30, vendorName=RH-str01, pathsDictionary={sdd=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 38fba0a1 >2014-10-08 09:29:25,759 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [77372414] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-08 09:29:25,770 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] START, CreateVGVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, deviceList=[1jbelka02], force=true), log id: 29192458 >2014-10-08 09:29:26,648 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] FINISH, CreateVGVDSCommand, return: 9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, log id: 29192458 >2014-10-08 09:29:26,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] START, CreateStorageDomainVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storageDomain=StorageDomainStatic[iscsi-2, a27ef16b-ef58-4130-8d71-e5183b8556d5], args=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 4001008d >2014-10-08 09:29:32,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] FINISH, CreateStorageDomainVDSCommand, log id: 4001008d >2014-10-08 09:29:32,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] START, GetStorageDomainStatsVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5), log id: 592989bb >2014-10-08 09:29:32,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, a27ef16b-ef58-4130-8d71-e5183b8556d5], log id: 592989bb >2014-10-08 09:29:32,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 5db47330 >2014-10-08 09:29:32,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-7) [77372414] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 5db47330 >2014-10-08 09:29:32,506 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [77372414] Correlation ID: 77372414, Job ID: a3544ef3-3e2f-4444-8636-e616efe717e5, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-2 was added by admin >2014-10-08 09:29:32,616 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] Lock Acquired to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= ] >2014-10-08 09:29:32,667 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-08 09:29:32,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-47) [69ba3d28] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5137b9fa >2014-10-08 09:29:32,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-45) [69ba3d28] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69c00040 >2014-10-08 09:29:32,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-47) [69ba3d28] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 5137b9fa >2014-10-08 09:29:32,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-45) [69ba3d28] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 69c00040 >2014-10-08 09:29:32,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] START, HSMGetStorageDomainInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5), log id: 1b0ac5f6 >2014-10-08 09:29:34,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] FINISH, HSMGetStorageDomainInfoVDSCommand, return: <StorageDomainStatic[iscsi-2, a27ef16b-ef58-4130-8d71-e5183b8556d5], null>, log id: 1b0ac5f6 >2014-10-08 09:29:34,700 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5), log id: 2948216b >2014-10-08 09:30:00,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] FINISH, AttachStorageDomainVDSCommand, log id: 2948216b >2014-10-08 09:30:00,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, sdUUID = a27ef16b-ef58-4130-8d71-e5183b8556d5), log id: fadb251 >2014-10-08 09:30:00,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp-/127.0.0.1:8702-9) [69ba3d28] FINISH, GetImagesListVDSCommand, return: [], log id: fadb251 >2014-10-08 09:30:00,266 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-9) There are no OVF_STORE disks on storage domain id a27ef16b-ef58-4130-8d71-e5183b8556d5 >2014-10-08 09:30:00,271 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [493a775c] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= ] >2014-10-08 09:30:00,272 WARN [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [493a775c] CanDoAction of action ActivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ACTIVATE,ACTION_TYPE_FAILED_OBJECT_LOCKED >2014-10-08 09:30:00,283 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [493a775c] Correlation ID: 69ba3d28, Job ID: f2b837d2-6028-4cd6-a747-a98a02ff1718, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-2 was attached to Data Center Default by admin >2014-10-08 09:30:00,288 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-9) [493a775c] Lock freed to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= ] >2014-10-08 09:30:08,978 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-10) Adding domain a27ef16b-ef58-4130-8d71-e5183b8556d5 to the domains in maintenance cache >2014-10-08 09:32:31,278 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [36f72936] Lock Acquired to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= ] >2014-10-08 09:32:31,343 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-13) [36f72936] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-08 09:32:31,349 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-13) [36f72936] Lock freed to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= ] >2014-10-08 09:32:31,349 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-13) [36f72936] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/8/14 9:32 AM >2014-10-08 09:32:31,417 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-35) [36f72936] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a33f40f >2014-10-08 09:32:31,494 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-23) [36f72936] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 579ad407 >2014-10-08 09:32:31,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-35) [36f72936] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 4a33f40f >2014-10-08 09:32:31,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-23) [36f72936] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 579ad407 >2014-10-08 09:32:31,728 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 09:32:31,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 78a5897d >2014-10-08 09:32:31,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 78a5897d >2014-10-08 09:32:31,946 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5), log id: 62437076 >2014-10-08 09:32:32,570 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 62437076 >2014-10-08 09:32:32,571 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] ActivateStorage Domain. After Connect all hosts to pool. Time:10/8/14 9:32 AM >2014-10-08 09:32:32,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-1) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 3a83cac9 >2014-10-08 09:32:32,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-22) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 43017949 >2014-10-08 09:32:33,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-22) FINISH, ConnectStoragePoolVDSCommand, log id: 43017949 >2014-10-08 09:32:33,184 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-22) Refreshed vds dell-r210ii-03 in pool Default >2014-10-08 09:32:33,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-1) FINISH, ConnectStoragePoolVDSCommand, log id: 3a83cac9 >2014-10-08 09:32:33,270 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-1) Refreshed vds dell-r210ii-04 in pool Default >2014-10-08 09:32:33,271 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-13) [613b46f1] ActivateStorage Domain. After change storage pool status in vds. Time:10/8/14 9:32 AM >2014-10-08 09:32:33,300 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) [613b46f1] Correlation ID: 36f72936, Job ID: a409d4ad-46c3-4298-8f58-8d4fa1fa4f75, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-2 (Data Center Default) was activated by admin >2014-10-08 09:32:43,753 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-21) Removing domain a27ef16b-ef58-4130-8d71-e5183b8556d5 from the domains in maintenance cache >2014-10-08 09:39:09,834 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [50b3c2ab] Lock Acquired to object EngineLock [exclusiveLocks= key: test value: VM_NAME >, sharedLocks= ] >2014-10-08 09:39:09,886 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [50b3c2ab] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-10-08 09:39:10,152 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [50b3c2ab] Correlation ID: 50b3c2ab, Job ID: 3e45ad9b-b5ff-4d30-88d4-b4f3811f15ce, Call Stack: null, Custom Event ID: -1, Message: VM test was created by admin. >2014-10-08 09:39:10,159 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [50b3c2ab] Lock freed to object EngineLock [exclusiveLocks= key: test value: VM_NAME >, sharedLocks= ] >2014-10-08 09:39:11,890 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-5) [2df978cd] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: 0000000e-000e-000e-000e-0000000001ae Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-10-08 09:39:11,986 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-5) [1a15b3e5] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VM >2014-10-08 09:39:12,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [1a15b3e5] Correlation ID: 1a15b3e5, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM test. (User: admin) >2014-10-08 09:39:12,042 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [1a15b3e5] Correlation ID: 2df978cd, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM test. (User: admin) >2014-10-08 09:39:12,579 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-6) [78bdc0fd] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group CREATE_VM with role type USER >2014-10-08 09:39:26,959 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-8) [5c75dcdb] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM_DISK_BOOT >, sharedLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >] >2014-10-08 09:39:26,996 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-8) [5c75dcdb] Running command: AddDiskCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group CREATE_DISK with role type USER >2014-10-08 09:39:27,061 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-8) [5b6bf88f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 09:39:27,073 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-8) [5b6bf88f] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM_DISK_BOOT >, sharedLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >] >2014-10-08 09:39:27,073 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [5b6bf88f] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 0dbe1f65-c19d-4e40-941c-bf912d2380fa, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 4d141588-ecbd-4e67-b588-55859e059aa0, newImageDescription = ), log id: 11793b2d >2014-10-08 09:39:27,075 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [5b6bf88f] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-08 09:39:27,154 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [5b6bf88f] FINISH, CreateImageVDSCommand, return: 4d141588-ecbd-4e67-b588-55859e059aa0, log id: 11793b2d >2014-10-08 09:39:27,162 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp-/127.0.0.1:8702-8) [5b6bf88f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 68ed2b49-3d37-45b3-90ce-1929604648fa >2014-10-08 09:39:27,162 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-8) [5b6bf88f] CommandMultiAsyncTasks::AttachTask: Attaching task a0c26772-f964-49d0-a1da-c12206307546 to command 68ed2b49-3d37-45b3-90ce-1929604648fa. >2014-10-08 09:39:27,173 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp-/127.0.0.1:8702-8) [5b6bf88f] Adding task a0c26772-f964-49d0-a1da-c12206307546 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 09:39:27,257 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [5b6bf88f] Correlation ID: 5c75dcdb, Job ID: 5e22030a-3d0f-4f02-8ef6-8b010c460763, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of test_Disk1 was initiated on VM test by admin. >2014-10-08 09:39:27,257 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp-/127.0.0.1:8702-8) [5b6bf88f] BaseAsyncTask::startPollingTask: Starting to poll task a0c26772-f964-49d0-a1da-c12206307546. >2014-10-08 09:39:36,999 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-51) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-10-08 09:39:37,035 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task a0c26772-f964-49d0-a1da-c12206307546 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 09:39:37,041 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) BaseAsyncTask::onTaskEndSuccess: Task a0c26772-f964-49d0-a1da-c12206307546 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 09:39:37,044 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-51) CommandAsyncTask::endActionIfNecessary: All tasks of command 68ed2b49-3d37-45b3-90ce-1929604648fa has ended -> executing endAction >2014-10-08 09:39:37,044 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-51) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 68ed2b49-3d37-45b3-90ce-1929604648fa): calling endAction . >2014-10-08 09:39:37,044 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-16) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-10-08 09:39:37,084 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-7-thread-16) [5c75dcdb] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-10-08 09:39:37,111 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-16) [5b6bf88f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-08 09:39:37,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-16) [5b6bf88f] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 0dbe1f65-c19d-4e40-941c-bf912d2380fa, imageId = 4d141588-ecbd-4e67-b588-55859e059aa0), log id: 1997ec62 >2014-10-08 09:39:37,130 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-16) [5b6bf88f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@eddf239b, log id: 1997ec62 >2014-10-08 09:39:37,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-16) Correlation ID: 5c75dcdb, Job ID: 5e22030a-3d0f-4f02-8ef6-8b010c460763, Call Stack: null, Custom Event ID: -1, Message: The disk test_Disk1 was successfully added to VM test. >2014-10-08 09:39:37,147 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-16) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-10-08 09:39:37,147 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-16) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-10-08 09:39:37,150 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-16) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a0c26772-f964-49d0-a1da-c12206307546 >2014-10-08 09:39:37,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-16) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = a0c26772-f964-49d0-a1da-c12206307546), log id: 35c83da6 >2014-10-08 09:39:37,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-16) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=a0c26772-f964-49d0-a1da-c12206307546), log id: 6d4778df >2014-10-08 09:39:37,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-16) FINISH, HSMClearTaskVDSCommand, log id: 6d4778df >2014-10-08 09:39:37,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-16) FINISH, SPMClearTaskVDSCommand, log id: 35c83da6 >2014-10-08 09:39:37,175 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-16) BaseAsyncTask::removeTaskFromDB: Removed task a0c26772-f964-49d0-a1da-c12206307546 from DataBase >2014-10-08 09:39:37,175 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-16) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 68ed2b49-3d37-45b3-90ce-1929604648fa >2014-10-08 09:40:48,817 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-45) Setting new tasks map. The map contains now 0 tasks >2014-10-08 09:40:48,818 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-45) Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-08 09:41:58,935 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-5) [3246f1db] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:41:59,002 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [3246f1db] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 212849f9 >2014-10-08 09:41:59,003 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [3246f1db] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 212849f9 >2014-10-08 09:41:59,138 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 09:41:59,250 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-30) [3246f1db] Started HA reservation scoring method >2014-10-08 09:41:59,335 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@2381fe52), log id: 4b78dfa0 >2014-10-08 09:41:59,340 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] FINISH, UpdateVmDynamicDataVDSCommand, log id: 4b78dfa0 >2014-10-08 09:41:59,387 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 4a764755 >2014-10-08 09:41:59,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] START, CreateVmFromCloudInitVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 9cc223a >2014-10-08 09:41:59,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{shared=false, iface=ide, index=3, specParams={vmPayload={file={openstack/latest/meta_data.json=ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs >CiAgInV1aWQiIDogImQwMzY4YWJlLWY1OGUtNGY5Zi04NGYwLTNiMTAxM2VkYzc3ZSIsCiAgIm1l >dGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs >CiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0= >, openstack/latest/user_data=I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg >YWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBp >cmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0 >Yy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwg >IkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK >}, volId=config-2}}, path=, device=cdrom, type=disk, readonly=true, deviceId=15df4435-4687-485c-ae84-32b0da6d599f}, {specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 09:41:59,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] FINISH, CreateVmFromCloudInitVDSCommand, log id: 9cc223a >2014-10-08 09:41:59,690 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 4a764755 >2014-10-08 09:41:59,691 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-30) [3246f1db] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:41:59,715 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-30) [3246f1db] Correlation ID: 3246f1db, Job ID: 884225d6-a4f9-4122-a780-0ad357da988c, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-03). >2014-10-08 09:42:01,767 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-73) START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 200c6ae1 >2014-10-08 09:42:02,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, DestroyVDSCommand, log id: 200c6ae1 >2014-10-08 09:42:02,112 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-73) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 09:42:02,112 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) Running on vds during rerun failed vm: null >2014-10-08 09:42:02,114 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-03 >2014-10-08 09:42:02,143 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-03 >2014-10-08 09:42:02,156 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-26) Correlation ID: 3246f1db, Job ID: 884225d6-a4f9-4122-a780-0ad357da988c, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-03. >2014-10-08 09:42:02,166 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-26) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:42:02,217 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-26) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 6a48708b >2014-10-08 09:42:02,219 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-26) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6a48708b >2014-10-08 09:42:02,286 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-26) Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 09:42:02,365 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-26) START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@8d8978ec), log id: 4ff82396 >2014-10-08 09:42:02,370 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-26) FINISH, UpdateVmDynamicDataVDSCommand, log id: 4ff82396 >2014-10-08 09:42:02,381 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-26) START, CreateVmVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 5f65140 >2014-10-08 09:42:02,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-26) START, CreateVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 847968c >2014-10-08 09:42:02,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-26) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 09:42:02,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-26) FINISH, CreateVDSCommand, log id: 847968c >2014-10-08 09:42:02,481 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-26) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5f65140 >2014-10-08 09:42:02,481 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-26) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:42:02,484 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-26) Correlation ID: 3246f1db, Job ID: 884225d6-a4f9-4122-a780-0ad357da988c, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-04). >2014-10-08 09:42:05,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-43) START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 63380b9e >2014-10-08 09:42:05,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, DestroyVDSCommand, log id: 63380b9e >2014-10-08 09:42:05,572 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 09:42:05,572 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) Running on vds during rerun failed vm: null >2014-10-08 09:42:05,573 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-04 >2014-10-08 09:42:05,580 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-04 >2014-10-08 09:42:05,588 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) Correlation ID: 3246f1db, Job ID: 884225d6-a4f9-4122-a780-0ad357da988c, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-04. >2014-10-08 09:42:05,594 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:42:05,618 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-43) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 5d1d766d >2014-10-08 09:42:05,618 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5d1d766d >2014-10-08 09:42:05,642 WARN [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-43) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_NO_HOSTS >2014-10-08 09:42:05,642 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-43) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:42:05,651 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) Correlation ID: 3246f1db, Job ID: 884225d6-a4f9-4122-a780-0ad357da988c, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test (User: admin). >2014-10-08 09:42:05,659 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-7-thread-32) [6b40226c] Running command: ProcessDownVmCommand internal: true. >2014-10-08 09:48:35,237 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [209570d9] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:48:35,265 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [209570d9] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 56c8ce0c >2014-10-08 09:48:35,266 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [209570d9] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 56c8ce0c >2014-10-08 09:48:35,343 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 09:48:35,429 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-22) [209570d9] Started HA reservation scoring method >2014-10-08 09:48:35,546 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@b79b7a45), log id: 6922fd99 >2014-10-08 09:48:35,550 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] FINISH, UpdateVmDynamicDataVDSCommand, log id: 6922fd99 >2014-10-08 09:48:35,583 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 7d1fbb24 >2014-10-08 09:48:35,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] START, CreateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 148cc44d >2014-10-08 09:48:35,668 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 09:48:35,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] FINISH, CreateVDSCommand, log id: 148cc44d >2014-10-08 09:48:35,711 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7d1fbb24 >2014-10-08 09:48:35,711 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-22) [209570d9] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:48:35,721 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-22) [209570d9] Correlation ID: 209570d9, Job ID: fb100399-65d8-4abd-9b9e-506899c3ac40, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-03). >2014-10-08 09:48:38,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-3) START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 780ccaab >2014-10-08 09:48:38,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, DestroyVDSCommand, log id: 780ccaab >2014-10-08 09:48:38,965 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 09:48:38,965 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) Running on vds during rerun failed vm: null >2014-10-08 09:48:38,967 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-03 >2014-10-08 09:48:38,975 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-03 >2014-10-08 09:48:38,984 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) Correlation ID: 209570d9, Job ID: fb100399-65d8-4abd-9b9e-506899c3ac40, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-03. >2014-10-08 09:48:38,993 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-25) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:48:39,022 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-25) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 58d85a63 >2014-10-08 09:48:39,022 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-25) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 58d85a63 >2014-10-08 09:48:39,078 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-25) Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 09:48:39,146 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-25) START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@423799e2), log id: 2fc31ee8 >2014-10-08 09:48:39,149 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-25) FINISH, UpdateVmDynamicDataVDSCommand, log id: 2fc31ee8 >2014-10-08 09:48:39,155 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-25) START, CreateVmVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 3bd61fa5 >2014-10-08 09:48:39,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-25) START, CreateVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 887d668 >2014-10-08 09:48:39,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-25) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 09:48:39,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-25) FINISH, CreateVDSCommand, log id: 887d668 >2014-10-08 09:48:39,220 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-25) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3bd61fa5 >2014-10-08 09:48:39,220 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-25) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:48:39,223 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) Correlation ID: 209570d9, Job ID: fb100399-65d8-4abd-9b9e-506899c3ac40, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-04). >2014-10-08 09:48:41,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-78) START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 44bacab5 >2014-10-08 09:48:41,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, DestroyVDSCommand, log id: 44bacab5 >2014-10-08 09:48:41,967 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 09:48:41,967 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) Running on vds during rerun failed vm: null >2014-10-08 09:48:41,968 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-04 >2014-10-08 09:48:41,975 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-04 >2014-10-08 09:48:41,983 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-33) Correlation ID: 209570d9, Job ID: fb100399-65d8-4abd-9b9e-506899c3ac40, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-04. >2014-10-08 09:48:41,988 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-33) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:48:42,022 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 527321eb >2014-10-08 09:48:42,023 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 527321eb >2014-10-08 09:48:42,046 WARN [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-33) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_NO_HOSTS >2014-10-08 09:48:42,046 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-33) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:48:42,054 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-33) Correlation ID: 209570d9, Job ID: fb100399-65d8-4abd-9b9e-506899c3ac40, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test (User: admin). >2014-10-08 09:48:42,057 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-7-thread-39) [737762ad] Running command: ProcessDownVmCommand internal: true. >2014-10-08 09:53:21,494 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-10) [71e7b5da] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 09:53:21,541 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN, ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 09:53:21,561 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: dab0014 >2014-10-08 09:53:21,565 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] FINISH, SetVdsStatusVDSCommand, log id: dab0014 >2014-10-08 09:53:21,567 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 5a24ff39 >2014-10-08 09:53:21,567 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] VDS dell-r210ii-04 is spm and moved from up calling resetIrs. >2014-10-08 09:53:21,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, ignoreStopFailed = false), log id: 1a88abdb >2014-10-08 09:53:21,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] START, SpmStopVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1), log id: 3fc6fb9c >2014-10-08 09:53:21,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] SpmStopVDSCommand::Stopping SPM on vds dell-r210ii-04, pool id 00000002-0002-0002-0002-0000000001f1 >2014-10-08 09:53:21,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] FINISH, SpmStopVDSCommand, log id: 3fc6fb9c >2014-10-08 09:53:21,682 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] FINISH, ResetIrsVDSCommand, log id: 1a88abdb >2014-10-08 09:53:21,685 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] FINISH, SetVdsStatusVDSCommand, log id: 5a24ff39 >2014-10-08 09:53:21,765 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 09:53:21,785 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 09:53:21,791 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] Correlation ID: 71e7b5da, Job ID: 0f5395b3-dffc-4bd5-b9e4-786be2fee5b1, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was switched to Maintenance mode by admin. >2014-10-08 09:53:21,849 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 09:53:21,853 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-42) [71e7b5da] Correlation ID: 71e7b5da, Job ID: 8578c35c-e952-470d-b4b5-d2965ca3115c, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was switched to Maintenance mode by admin. >2014-10-08 09:53:22,516 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03 >2014-10-08 09:53:22,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-15) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-03. >2014-10-08 09:53:22,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-15) Removing vds [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from the domain in maintenance cache >2014-10-08 09:53:22,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-15) Removing host(s) [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from hosts unseen domain report cache >2014-10-08 09:53:22,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-20) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 1), log id: 4986a2de >2014-10-08 09:53:23,072 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-2) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04 >2014-10-08 09:53:23,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-21) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-04. >2014-10-08 09:53:23,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-21) Removing vds [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from the domain in maintenance cache >2014-10-08 09:53:23,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-21) Removing host(s) [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from hosts unseen domain report cache >2014-10-08 09:53:23,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-2) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2), log id: 5829d731 >2014-10-08 09:53:23,572 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-27) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : no reporting hosts >2014-10-08 09:53:23,575 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-27) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : no reporting hosts >2014-10-08 09:53:23,581 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-27) [1d1dd329] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:53:23,590 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) [1d1dd329] Correlation ID: 1d1dd329, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-08 09:53:27,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, DisconnectStoragePoolVDSCommand, log id: 5829d731 >2014-10-08 09:53:27,451 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-2) [733d0959] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:53:27,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-2) [733d0959] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4c694d52 >2014-10-08 09:53:27,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-2) [733d0959] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 4c694d52 >2014-10-08 09:53:28,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, DisconnectStoragePoolVDSCommand, log id: 4986a2de >2014-10-08 09:53:28,586 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-20) [1b7756cc] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:53:28,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-20) [1b7756cc] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1d53f8c4 >2014-10-08 09:53:28,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-20) [1b7756cc] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 1d53f8c4 >2014-10-08 09:57:29,958 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-46) [6c972d67] Start running CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 09:57:29,959 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-24) [3925fce3] Start running CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 09:57:29,961 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-46) [6c972d67] Lock Acquired to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 09:57:29,968 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-24) [3925fce3] Lock Acquired to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 09:57:29,969 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-46) [6c972d67] Finish handling CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 09:57:29,986 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-24) [3925fce3] Finish handling CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 09:57:30,003 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 09:57:30,003 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] Before acquiring lock in order to prevent monitoring for host dell-r210ii-04 from data-center Default >2014-10-08 09:57:30,003 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-04 from data-center Default >2014-10-08 09:57:30,010 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3f6a1f01 >2014-10-08 09:57:30,015 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] FINISH, SetVdsStatusVDSCommand, log id: 3f6a1f01 >2014-10-08 09:57:30,039 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-04 from data-center Default >2014-10-08 09:57:30,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-7) [6c972d67] Correlation ID: 6c972d67, Job ID: ea088f15-8c07-4c8f-bd9b-7c06b1a0c718, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was activated by admin. >2014-10-08 09:57:30,059 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [6c972d67] Lock freed to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 09:57:30,075 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 09:57:30,075 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] Before acquiring lock in order to prevent monitoring for host dell-r210ii-03 from data-center Default >2014-10-08 09:57:30,075 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-03 from data-center Default >2014-10-08 09:57:30,098 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 144af1c5 >2014-10-08 09:57:30,105 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] FINISH, SetVdsStatusVDSCommand, log id: 144af1c5 >2014-10-08 09:57:30,149 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-03 from data-center Default >2014-10-08 09:57:30,153 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-7) [3925fce3] Correlation ID: 3925fce3, Job ID: c99910bd-1381-424b-9952-a725f88d0754, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was activated by admin. >2014-10-08 09:57:30,157 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-7) [3925fce3] Lock freed to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 09:57:30,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-22) [b5200ed] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]), log id: 32c6017 >2014-10-08 09:57:30,911 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-22) [b5200ed] FINISH, GetHardwareInfoVDSCommand, log id: 32c6017 >2014-10-08 09:57:30,939 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-22) [720bf6d3] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 09:57:30,950 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-22) [73cb026a] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:57:30,960 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-22) [1e293ba3] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:57:30,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-22) [1e293ba3] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3d95f381 >2014-10-08 09:57:31,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 27db3250 >2014-10-08 09:57:31,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetHardwareInfoVDSCommand, log id: 27db3250 >2014-10-08 09:57:31,305 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-58) [13c293b5] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 09:57:31,328 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-58) [3ce73bfa] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:57:31,343 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-58) [4c04d64d] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 09:57:31,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-58) [4c04d64d] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 46e23b36 >2014-10-08 09:57:31,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-22) [1e293ba3] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 3d95f381 >2014-10-08 09:57:31,500 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-22) [1e293ba3] Host dell-r210ii-04 storage connection was succeeded >2014-10-08 09:57:31,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-30) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 6cde8ad7 >2014-10-08 09:57:31,725 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-58) [4c04d64d] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 46e23b36 >2014-10-08 09:57:31,725 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-58) [4c04d64d] Host dell-r210ii-03 storage connection was succeeded >2014-10-08 09:57:32,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-30) FINISH, ConnectStoragePoolVDSCommand, log id: 6cde8ad7 >2014-10-08 09:57:32,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-22) [1e293ba3] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 5cd26ae5 >2014-10-08 09:57:32,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-38) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 45f22b7a >2014-10-08 09:57:32,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-22) [1e293ba3] FINISH, SetMOMPolicyParametersVDSCommand, log id: 5cd26ae5 >2014-10-08 09:57:32,356 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [1e293ba3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-04 was set to Up. >2014-10-08 09:57:32,361 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [1e293ba3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 09:57:32,384 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-22) [7edfc2cc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 09:57:32,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-38) FINISH, ConnectStoragePoolVDSCommand, log id: 45f22b7a >2014-10-08 09:57:32,927 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-58) [4c04d64d] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 3d87ad0 >2014-10-08 09:57:33,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-58) [4c04d64d] FINISH, SetMOMPolicyParametersVDSCommand, log id: 3d87ad0 >2014-10-08 09:57:33,041 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-58) [4c04d64d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-03 was set to Up. >2014-10-08 09:57:33,075 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-58) [4c04d64d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-08 09:57:33,123 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-58) [6f213e2c] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 09:57:34,036 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-53) hostFromVds::selectedVds - dell-r210ii-03, spmStatus Free, storage pool Default >2014-10-08 09:57:34,040 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-53) starting spm on vds dell-r210ii-03, storage pool Default, prevId -1, LVER -1 >2014-10-08 09:57:34,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) START, SpmStartVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 53a46c0d >2014-10-08 09:57:34,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) spmStart polling started: taskId = 1c829adb-de03-46da-baa3-9a64c1b0b3f0 >2014-10-08 09:57:55,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) spmStart polling ended: taskId = 1c829adb-de03-46da-baa3-9a64c1b0b3f0 task status = finished >2014-10-08 09:57:55,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) spmStart polling ended, spm status: SPM >2014-10-08 09:57:55,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-53) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=1c829adb-de03-46da-baa3-9a64c1b0b3f0), log id: 4bd2b28c >2014-10-08 09:57:55,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, HSMClearTaskVDSCommand, log id: 4bd2b28c >2014-10-08 09:57:55,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@68b29304, log id: 53a46c0d >2014-10-08 09:57:55,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-53) Initialize Irs proxy from vds: 10.34.63.222 >2014-10-08 09:57:55,269 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dell-r210ii-03 (Address: 10.34.63.222). >2014-10-08 09:57:55,270 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 09:57:55,278 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false), log id: 4dbe46cc >2014-10-08 09:57:55,386 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-23) [302872c0] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 09:57:55,393 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-1) [4b1e1e4a] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 09:57:55,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-0000000001f1 >2014-10-08 09:57:55,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) START, HSMGetAllTasksInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 4d8a34d3 >2014-10-08 09:57:55,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-1) [4b1e1e4a] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 13ae7470 >2014-10-08 09:57:55,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 4d8a34d3 >2014-10-08 09:57:55,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 4dbe46cc >2014-10-08 09:57:55,459 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-25) Discovered no tasks on Storage Pool Default >2014-10-08 09:57:55,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-23) [302872c0] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 7ebbe500 >2014-10-08 09:57:55,753 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-1) [4b1e1e4a] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 13ae7470 >2014-10-08 09:57:55,793 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-23) [302872c0] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 7ebbe500 >2014-10-08 09:59:09,423 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-7) [6fbfb6f1] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:59:09,450 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [6fbfb6f1] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 1a925509 >2014-10-08 09:59:09,450 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [6fbfb6f1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1a925509 >2014-10-08 09:59:09,520 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 09:59:09,580 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] Started HA reservation scoring method >2014-10-08 09:59:09,594 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@37e011dd), log id: 5fbd1999 >2014-10-08 09:59:09,597 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] FINISH, UpdateVmDynamicDataVDSCommand, log id: 5fbd1999 >2014-10-08 09:59:09,602 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] START, CreateVmVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 3dc01515 >2014-10-08 09:59:09,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] START, CreateVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 11465f19 >2014-10-08 09:59:09,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 09:59:09,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] FINISH, CreateVDSCommand, log id: 11465f19 >2014-10-08 09:59:09,674 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3dc01515 >2014-10-08 09:59:09,674 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:59:09,679 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-8) [6fbfb6f1] Correlation ID: 6fbfb6f1, Job ID: f870a260-7249-4516-addb-bacfab526923, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-04). >2014-10-08 09:59:12,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-18) START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 358f79c6 >2014-10-08 09:59:12,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, DestroyVDSCommand, log id: 358f79c6 >2014-10-08 09:59:12,940 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 09:59:12,940 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) Running on vds during rerun failed vm: null >2014-10-08 09:59:12,941 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-04 >2014-10-08 09:59:12,967 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-04 >2014-10-08 09:59:12,976 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-46) Correlation ID: 6fbfb6f1, Job ID: f870a260-7249-4516-addb-bacfab526923, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-04. >2014-10-08 09:59:12,984 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:59:13,027 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 2046ea7b >2014-10-08 09:59:13,027 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2046ea7b >2014-10-08 09:59:13,082 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-46) Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 09:59:13,183 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@e473fa0e), log id: 2c27e1e0 >2014-10-08 09:59:13,186 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, UpdateVmDynamicDataVDSCommand, log id: 2c27e1e0 >2014-10-08 09:59:13,211 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 685a704c >2014-10-08 09:59:13,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, CreateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 732ec2a4 >2014-10-08 09:59:13,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-46) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 09:59:13,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, CreateVDSCommand, log id: 732ec2a4 >2014-10-08 09:59:13,293 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 685a704c >2014-10-08 09:59:13,293 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-46) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:59:13,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-46) Correlation ID: 6fbfb6f1, Job ID: f870a260-7249-4516-addb-bacfab526923, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-03). >2014-10-08 09:59:13,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-54) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 1df03300 >2014-10-08 09:59:13,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-54) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=0, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=WaitForLaunch, bootMenuEnable=false, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, copyPasteEnable=true, displayIp=10.34.63.222, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@4a4545b, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 1df03300 >2014-10-08 09:59:13,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a qxl Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=qxl, specParams={vram=32768, ram=65536, heads=1}, deviceType=video, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa} >2014-10-08 09:59:13,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a cdrom Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=2, iface=ide, specParams={path=}, readonly=true, deviceType=disk, deviceId=178844c3-0795-4273-b354-36f0d6175a32, path=, device=cdrom, shared=false, type=disk} >2014-10-08 09:59:13,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a disk Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=0, iface=virtio, reqsize=0, format=raw, deviceType=disk, bootOrder=1, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, apparentsize=1073741824, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, readonly=false, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, optional=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa, truesize=1073741824, poolID=00000002-0002-0002-0002-0000000001f1, device=disk, shared=false, propagateErrors=off, type=disk} >2014-10-08 09:59:13,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a bridge Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {nicModel=pv, macAddr=00:1a:4a:76:fa:00, linkActive=true, network=rhevm, filter=vdsm-no-mac-spoofing, specParams={inbound={}, outbound={}}, deviceType=interface, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28, device=bridge, type=interface} >2014-10-08 09:59:13,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a ich6 Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=ich6, specParams={}, deviceType=sound, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc} >2014-10-08 09:59:13,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a memballoon Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {target=1048576, specParams={model=virtio}, deviceType=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a, device=memballoon, type=balloon} >2014-10-08 09:59:13,790 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a scsi Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=0, specParams={}, deviceType=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424, device=scsi, model=virtio-scsi, type=controller} >2014-10-08 09:59:13,790 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Received a virtio-serial Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=virtio-serial, specParams={}, deviceType=controller, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823} >2014-10-08 09:59:16,898 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-98) START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 6435ac88 >2014-10-08 09:59:17,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, DestroyVDSCommand, log id: 6435ac88 >2014-10-08 09:59:17,252 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 09:59:17,252 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Running on vds during rerun failed vm: null >2014-10-08 09:59:17,257 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-03 >2014-10-08 09:59:17,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 5bb753f5 >2014-10-08 09:59:17,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) FINISH, FullListVdsCommand, return: [], log id: 5bb753f5 >2014-10-08 09:59:17,301 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-03 >2014-10-08 09:59:17,314 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-14) Correlation ID: 6fbfb6f1, Job ID: f870a260-7249-4516-addb-bacfab526923, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-03. >2014-10-08 09:59:17,322 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-14) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:59:17,365 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-14) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 1807bdbd >2014-10-08 09:59:17,365 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-14) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1807bdbd >2014-10-08 09:59:17,418 WARN [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-14) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_NO_HOSTS >2014-10-08 09:59:17,418 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-14) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 09:59:17,428 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-14) Correlation ID: 6fbfb6f1, Job ID: f870a260-7249-4516-addb-bacfab526923, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test (User: admin). >2014-10-08 09:59:17,436 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-7-thread-40) [242b31a1] Running command: ProcessDownVmCommand internal: true. >2014-10-08 10:03:13,024 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-2) [133c6200] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 10:03:13,064 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN, ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:03:13,066 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 2e59abef >2014-10-08 10:03:13,070 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] FINISH, SetVdsStatusVDSCommand, log id: 2e59abef >2014-10-08 10:03:13,088 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 67ad76a5 >2014-10-08 10:03:13,089 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] VDS dell-r210ii-03 is spm and moved from up calling resetIrs. >2014-10-08 10:03:13,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, ignoreStopFailed = false), log id: 54d4d538 >2014-10-08 10:03:13,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] START, SpmStopVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1), log id: 7c6a08d2 >2014-10-08 10:03:13,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] SpmStopVDSCommand::Stopping SPM on vds dell-r210ii-03, pool id 00000002-0002-0002-0002-0000000001f1 >2014-10-08 10:03:13,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] FINISH, SpmStopVDSCommand, log id: 7c6a08d2 >2014-10-08 10:03:13,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] FINISH, ResetIrsVDSCommand, log id: 54d4d538 >2014-10-08 10:03:13,204 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] FINISH, SetVdsStatusVDSCommand, log id: 67ad76a5 >2014-10-08 10:03:13,313 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 10:03:13,337 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:03:13,346 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) [133c6200] Correlation ID: 133c6200, Job ID: b3da8f1c-fb34-49be-b46b-ea10d62c436e, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was switched to Maintenance mode by admin. >2014-10-08 10:03:13,447 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-25) [133c6200] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:03:13,453 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) [133c6200] Correlation ID: 133c6200, Job ID: a54a688c-a67b-4505-8c65-4f728d99d4b7, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was switched to Maintenance mode by admin. >2014-10-08 10:03:14,776 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04 >2014-10-08 10:03:14,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-23) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-04. >2014-10-08 10:03:14,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-23) Removing vds [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from the domain in maintenance cache >2014-10-08 10:03:14,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-23) Removing host(s) [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from hosts unseen domain report cache >2014-10-08 10:03:14,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-49) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2), log id: 8273e38 >2014-10-08 10:03:15,171 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-52) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03 >2014-10-08 10:03:15,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-33) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-03. >2014-10-08 10:03:15,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-33) Removing vds [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from the domain in maintenance cache >2014-10-08 10:03:15,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-33) Removing host(s) [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from hosts unseen domain report cache >2014-10-08 10:03:15,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-52) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 1), log id: 31028678 >2014-10-08 10:03:18,523 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-60) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : no reporting hosts >2014-10-08 10:03:18,525 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-60) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : no reporting hosts >2014-10-08 10:03:18,535 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-60) [337326ad] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:03:18,542 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-60) [337326ad] Correlation ID: 337326ad, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-08 10:03:22,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, DisconnectStoragePoolVDSCommand, log id: 8273e38 >2014-10-08 10:03:22,274 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-49) [9830ee8] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:03:22,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-49) [9830ee8] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5298290b >2014-10-08 10:03:22,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-49) [9830ee8] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 5298290b >2014-10-08 10:03:22,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, DisconnectStoragePoolVDSCommand, log id: 31028678 >2014-10-08 10:03:22,883 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-52) [5c5ccb32] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:03:22,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-52) [5c5ccb32] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 29765e45 >2014-10-08 10:03:23,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-52) [5c5ccb32] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 29765e45 >2014-10-08 10:03:40,557 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcherImpl.read0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.read(IOUtil.java:197) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.read(SSLEngineNioHelper.java:51) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.read(SSLClient.java:81) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.stomp.StompCommonClient.processIncoming(StompCommonClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:168) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:54,648 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcherImpl.read0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.read(IOUtil.java:197) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.read(SSLEngineNioHelper.java:51) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.read(SSLClient.java:81) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.stomp.StompCommonClient.processIncoming(StompCommonClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:168) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:58,166 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-37) [4ead78d3] Start running CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 10:03:58,166 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-18) [5ed78cff] Start running CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 10:03:58,168 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-37) [4ead78d3] Lock Acquired to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 10:03:58,168 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-18) [5ed78cff] Lock Acquired to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 10:03:58,170 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-37) [4ead78d3] Finish handling CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 10:03:58,199 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-18) [5ed78cff] Finish handling CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 10:03:58,224 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:03:58,225 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] Before acquiring lock in order to prevent monitoring for host dell-r210ii-04 from data-center Default >2014-10-08 10:03:58,225 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-04 from data-center Default >2014-10-08 10:03:58,246 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 13bbca04 >2014-10-08 10:03:58,254 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] FINISH, SetVdsStatusVDSCommand, log id: 13bbca04 >2014-10-08 10:03:58,298 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-04 from data-center Default >2014-10-08 10:03:58,302 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] Correlation ID: 4ead78d3, Job ID: e7f84f8a-48d1-4877-8aa5-c9a9e0aa09f0, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was activated by admin. >2014-10-08 10:03:58,306 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [4ead78d3] Lock freed to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 10:03:58,324 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:03:58,325 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] Before acquiring lock in order to prevent monitoring for host dell-r210ii-03 from data-center Default >2014-10-08 10:03:58,325 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-03 from data-center Default >2014-10-08 10:03:58,369 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 39779b0b >2014-10-08 10:03:58,374 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] FINISH, SetVdsStatusVDSCommand, log id: 39779b0b >2014-10-08 10:03:58,410 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-03 from data-center Default >2014-10-08 10:03:58,414 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] Correlation ID: 5ed78cff, Job ID: f6b4111c-6169-4d5a-8df1-0afc2f2fdc52, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was activated by admin. >2014-10-08 10:03:58,419 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-2) [5ed78cff] Lock freed to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 10:03:58,478 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:03:58,479 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:58,479 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:58,479 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-24) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:58,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:03:58,484 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-24) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:03:58,491 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:03:58,498 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:58,501 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-24) Failed to refresh VDS , vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:03:59,426 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:03:59,427 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:59,427 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:59,428 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-49) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:59,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [9830ee8] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:03:59,431 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-49) [9830ee8] Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:03:59,468 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-49) [9830ee8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:03:59,474 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) [9830ee8] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:03:59,478 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-49) [9830ee8] Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:01,506 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:01,507 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:01,508 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:01,508 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-43) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:01,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:01,515 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-43) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:01,527 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:01,531 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-43) Failed to refresh VDS , vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:02,502 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:02,503 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:02,503 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:02,504 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-35) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:02,506 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [30606a26] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:02,506 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-35) [30606a26] Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:02,530 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-35) [30606a26] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:02,537 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-35) [30606a26] Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:04,536 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:04,536 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:04,537 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:04,537 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-45) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:04,540 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:04,540 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-45) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:04,543 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-45) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:04,551 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-45) Failed to refresh VDS , vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:05,570 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:05,570 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:05,571 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:05,572 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-94) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:05,574 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:05,574 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-94) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:05,608 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-94) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:05,611 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-94) Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:07,557 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:07,558 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:07,558 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:07,559 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-63) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:07,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:07,561 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-63) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:07,565 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:07,569 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-63) Failed to refresh VDS , vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:08,652 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:08,653 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:08,653 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:08,654 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-76) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:08,657 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:08,657 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-76) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:08,689 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:08,693 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-76) Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:10,575 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:10,576 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:10,576 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:10,576 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-62) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:10,579 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:10,579 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-62) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:10,582 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:10,586 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-62) Failed to refresh VDS , vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:11,713 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:11,713 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:11,714 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:11,714 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-90) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:11,716 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:11,716 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-90) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:11,745 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:11,748 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-90) Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:13,591 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:13,591 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:13,592 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:13,592 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-31) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:13,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:13,595 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:13,598 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-31) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:13,601 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) Failed to refresh VDS , vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:14,790 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:14,791 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:14,791 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:14,792 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-93) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:14,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:14,795 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-93) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:14,827 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-93) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:14,830 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-93) Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-10-08 10:04:16,607 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:16,607 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:16,608 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:16,608 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-26) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:16,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:16,611 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-26) Host dell-r210ii-04 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:16,618 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-26) Server failed to respond, vds_id = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds_name = dell-r210ii-04, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.ConnectException: Connection refused >2014-10-08 10:04:16,631 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) >, Custom Event ID: -1, Message: Host dell-r210ii-04 is non responsive. >2014-10-08 10:04:16,642 INFO [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-7-thread-8) ResourceManager::vdsNotResponding entered for Host 7f0606fe-4272-40af-973f-ddfb3f78ab4f, 10.34.63.223 >2014-10-08 10:04:16,653 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:16,668 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-7-thread-8) [134794e6] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:04:16,671 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-7-thread-8) [134794e6] Opening SSH Soft Fencing session on host 10.34.63.223 >2014-10-08 10:04:16,833 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-7-thread-8) [134794e6] Executing SSH Soft Fencing command on host 10.34.63.223 >2014-10-08 10:04:17,863 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:17,864 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:17,865 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:17,865 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-70) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:17,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 10:04:17,867 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-70) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 10:04:17,904 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-70) Server failed to respond, vds_id = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds_name = dell-r210ii-03, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.ConnectException: Connection refused >2014-10-08 10:04:17,938 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) >, Custom Event ID: -1, Message: Host dell-r210ii-03 is non responsive. >2014-10-08 10:04:17,950 INFO [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-7-thread-7) ResourceManager::vdsNotResponding entered for Host 04f67d65-72bc-4ddc-88b7-81d0053dff0b, 10.34.63.222 >2014-10-08 10:04:17,967 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:04:18,005 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-7-thread-7) [4bd6670b] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:04:18,038 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-7-thread-7) [4bd6670b] Opening SSH Soft Fencing session on host 10.34.63.222 >2014-10-08 10:04:18,192 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-7-thread-7) [4bd6670b] Executing SSH Soft Fencing command on host 10.34.63.222 >2014-10-08 10:04:19,672 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:20,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]), log id: 1b3a6dc >2014-10-08 10:04:20,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetHardwareInfoVDSCommand, log id: 1b3a6dc >2014-10-08 10:04:20,214 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-36) [6ab88737] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:04:20,221 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-36) [41278cca] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:04:20,226 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-36) [690d533c] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:04:20,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-36) [690d533c] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1486b248 >2014-10-08 10:04:20,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-36) [690d533c] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 1486b248 >2014-10-08 10:04:20,471 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-36) [690d533c] Host dell-r210ii-04 storage connection was succeeded >2014-10-08 10:04:20,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-31) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 5cd2bc26 >2014-10-08 10:04:20,991 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:04:21,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-31) FINISH, ConnectStoragePoolVDSCommand, log id: 5cd2bc26 >2014-10-08 10:04:21,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-36) [690d533c] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 7087bca9 >2014-10-08 10:04:21,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-36) [690d533c] FINISH, SetMOMPolicyParametersVDSCommand, log id: 7087bca9 >2014-10-08 10:04:21,552 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-36) [690d533c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-04 was set to Up. >2014-10-08 10:04:21,556 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-36) [690d533c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 10:04:21,565 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-36) [196151bd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:04:21,650 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-19) [76a76e91] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 6ac33a0b >2014-10-08 10:04:21,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-19) [76a76e91] FINISH, GetHardwareInfoVDSCommand, log id: 6ac33a0b >2014-10-08 10:04:21,741 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-19) [275dec8d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:04:21,755 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-19) [3e4f708c] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:04:21,765 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-19) [37fe7c83] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:04:21,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-19) [37fe7c83] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6afb14cb >2014-10-08 10:04:22,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-19) [37fe7c83] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 6afb14cb >2014-10-08 10:04:22,027 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-19) [37fe7c83] Host dell-r210ii-03 storage connection was succeeded >2014-10-08 10:04:22,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-19) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 1d545282 >2014-10-08 10:04:22,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-19) FINISH, ConnectStoragePoolVDSCommand, log id: 1d545282 >2014-10-08 10:04:22,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-19) [37fe7c83] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 661a80c2 >2014-10-08 10:04:22,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-19) [37fe7c83] FINISH, SetMOMPolicyParametersVDSCommand, log id: 661a80c2 >2014-10-08 10:04:22,810 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [37fe7c83] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-03 was set to Up. >2014-10-08 10:04:22,842 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [37fe7c83] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-08 10:04:22,892 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-19) [6418e974] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:04:28,735 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-92) hostFromVds::selectedVds - dell-r210ii-04, spmStatus Free, storage pool Default >2014-10-08 10:04:28,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-92) starting spm on vds dell-r210ii-04, storage pool Default, prevId -1, LVER -1 >2014-10-08 10:04:28,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-92) START, SpmStartVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6919478a >2014-10-08 10:04:28,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-92) spmStart polling started: taskId = bfb8650a-e7ce-4a9d-92d3-3759a338cfc6 >2014-10-08 10:04:43,827 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-92) spmStart polling ended: taskId = bfb8650a-e7ce-4a9d-92d3-3759a338cfc6 task status = finished >2014-10-08 10:04:43,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-92) spmStart polling ended, spm status: SPM >2014-10-08 10:04:43,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-92) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=bfb8650a-e7ce-4a9d-92d3-3759a338cfc6), log id: 1a0500ad >2014-10-08 10:04:43,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, HSMClearTaskVDSCommand, log id: 1a0500ad >2014-10-08 10:04:43,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@391a4a3c, log id: 6919478a >2014-10-08 10:04:43,851 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-92) Initialize Irs proxy from vds: 10.34.63.223 >2014-10-08 10:04:43,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-92) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dell-r210ii-04 (Address: 10.34.63.223). >2014-10-08 10:04:43,858 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:04:43,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false), log id: b18b2c5 >2014-10-08 10:04:43,974 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-39) [6c3a8e66] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 10:04:43,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-39) [6c3a8e66] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 2c514632 >2014-10-08 10:04:43,981 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-17) [1e4d5f26] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 10:04:43,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-17) [1e4d5f26] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 4c5f6ef2 >2014-10-08 10:04:43,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-33) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-0000000001f1 >2014-10-08 10:04:43,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, HSMGetAllTasksInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 2dc7b1db >2014-10-08 10:04:44,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2dc7b1db >2014-10-08 10:04:44,041 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: b18b2c5 >2014-10-08 10:04:44,041 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-33) Discovered no tasks on Storage Pool Default >2014-10-08 10:04:44,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-39) [6c3a8e66] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 2c514632 >2014-10-08 10:04:44,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-17) [1e4d5f26] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 4c5f6ef2 >2014-10-08 10:05:03,779 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-1) [3158540] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:05:03,807 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [3158540] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 6cac8d70 >2014-10-08 10:05:03,808 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [3158540] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6cac8d70 >2014-10-08 10:05:03,888 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 10:05:03,946 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-7) [3158540] Started HA reservation scoring method >2014-10-08 10:05:04,029 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@1bebe88d), log id: 5b9c4cee >2014-10-08 10:05:04,032 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] FINISH, UpdateVmDynamicDataVDSCommand, log id: 5b9c4cee >2014-10-08 10:05:04,082 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 357e6a0 >2014-10-08 10:05:04,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] START, CreateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 5d9b8500 >2014-10-08 10:05:04,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 10:05:04,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] FINISH, CreateVDSCommand, log id: 5d9b8500 >2014-10-08 10:05:04,207 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 357e6a0 >2014-10-08 10:05:04,208 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-7) [3158540] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:05:04,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-7) [3158540] Correlation ID: 3158540, Job ID: a48e1896-93ff-449c-9fd3-685a1cabbe6e, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-03). >2014-10-08 10:05:05,569 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-50) START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 7daa1fe7 >2014-10-08 10:05:05,881 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, DestroyVDSCommand, log id: 7daa1fe7 >2014-10-08 10:05:05,907 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-50) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 10:05:05,907 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) Running on vds during rerun failed vm: null >2014-10-08 10:05:05,911 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-03 >2014-10-08 10:05:05,918 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-03 >2014-10-08 10:05:05,924 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-46) Correlation ID: 3158540, Job ID: a48e1896-93ff-449c-9fd3-685a1cabbe6e, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-03. >2014-10-08 10:05:05,929 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-46) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:05:05,946 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 74a21996 >2014-10-08 10:05:05,946 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 74a21996 >2014-10-08 10:05:05,988 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-46) Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 10:05:06,050 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@f888ff53), log id: 53b21033 >2014-10-08 10:05:06,052 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, UpdateVmDynamicDataVDSCommand, log id: 53b21033 >2014-10-08 10:05:06,056 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, CreateVmVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 7609d6f2 >2014-10-08 10:05:06,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-46) START, CreateVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 6587ea61 >2014-10-08 10:05:06,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-46) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 10:05:06,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, CreateVDSCommand, log id: 6587ea61 >2014-10-08 10:05:06,137 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-46) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7609d6f2 >2014-10-08 10:05:06,137 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-46) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:05:06,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-46) Correlation ID: 3158540, Job ID: a48e1896-93ff-449c-9fd3-685a1cabbe6e, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-04). >2014-10-08 10:05:06,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) START, FullListVdsCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 5114e0cd >2014-10-08 10:05:06,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=0, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=WaitForLaunch, bootMenuEnable=false, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, copyPasteEnable=true, displayIp=10.34.63.223, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@31b2dc51, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 5114e0cd >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a ich6 Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=ich6, specParams={}, deviceType=sound, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a memballoon Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {target=1048576, specParams={model=virtio}, deviceType=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a, device=memballoon, type=balloon} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a scsi Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=0, specParams={}, deviceType=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424, device=scsi, model=virtio-scsi, type=controller} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a virtio-serial Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=virtio-serial, specParams={}, deviceType=controller, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a qxl Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=qxl, specParams={vram=32768, ram=65536, heads=1}, deviceType=video, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a spice Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.223, displayNetwork=rhevm}, deviceType=graphics, type=graphics} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a bridge Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {nicModel=pv, macAddr=00:1a:4a:76:fa:00, linkActive=true, network=rhevm, filter=vdsm-no-mac-spoofing, specParams={inbound={}, outbound={}}, deviceType=interface, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28, device=bridge, type=interface} >2014-10-08 10:05:06,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a cdrom Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=2, iface=ide, specParams={path=}, readonly=true, deviceType=disk, deviceId=178844c3-0795-4273-b354-36f0d6175a32, path=, device=cdrom, shared=false, type=disk} >2014-10-08 10:05:06,945 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Received a disk Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {volumeInfo={domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, volType=path, leaseOffset=111149056, path=/rhev/data-center/mnt/blockSD/322e3360-066e-4e98-a0e9-dd44e82f0992/images/0dbe1f65-c19d-4e40-941c-bf912d2380fa/4d141588-ecbd-4e67-b588-55859e059aa0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, leasePath=/dev/322e3360-066e-4e98-a0e9-dd44e82f0992/leases, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, index=0, iface=virtio, apparentsize=1073741824, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, readonly=false, deviceType=disk, shared=false, truesize=1073741824, type=disk, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, reqsize=0, format=raw, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa, poolID=00000002-0002-0002-0002-0000000001f1, device=disk, path=/rhev/data-center/00000002-0002-0002-0002-0000000001f1/322e3360-066e-4e98-a0e9-dd44e82f0992/images/0dbe1f65-c19d-4e40-941c-bf912d2380fa/4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, optional=false, bootOrder=1, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, specParams={}, volumeChain=[Ljava.lang.Object;@3fbc48c3} >2014-10-08 10:05:09,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-41) START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 65bdc66a >2014-10-08 10:05:10,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, DestroyVDSCommand, log id: 65bdc66a >2014-10-08 10:05:10,330 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 10:05:10,330 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-41) Running on vds during rerun failed vm: null >2014-10-08 10:05:10,330 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-41) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-04 >2014-10-08 10:05:10,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-41) START, FullListVdsCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 460a5e9e >2014-10-08 10:05:10,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-41) FINISH, FullListVdsCommand, return: [], log id: 460a5e9e >2014-10-08 10:05:10,353 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-41) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-04 >2014-10-08 10:05:10,360 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) Correlation ID: 3158540, Job ID: a48e1896-93ff-449c-9fd3-685a1cabbe6e, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-04. >2014-10-08 10:05:10,365 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-43) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:05:10,383 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-43) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 110a4346 >2014-10-08 10:05:10,383 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-43) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 110a4346 >2014-10-08 10:05:10,405 WARN [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-43) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_NO_HOSTS >2014-10-08 10:05:10,405 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-43) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:05:10,412 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) Correlation ID: 3158540, Job ID: a48e1896-93ff-449c-9fd3-685a1cabbe6e, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test (User: admin). >2014-10-08 10:05:10,417 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-7-thread-40) [6cb61cd5] Running command: ProcessDownVmCommand internal: true. >2014-10-08 10:07:27,867 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-6) Invalid locale found in configuration: >2014-10-08 10:07:27,867 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-6) Invalid locale found in configuration: >2014-10-08 10:10:30,713 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-38) [23da8a5c] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:10:30,734 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-38) [23da8a5c] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 505eeace >2014-10-08 10:10:30,737 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-38) [23da8a5c] FINISH, SetVdsStatusVDSCommand, log id: 505eeace >2014-10-08 10:10:30,791 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-38) [23da8a5c] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:10:30,797 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-38) [23da8a5c] Correlation ID: 23da8a5c, Job ID: 37285383-b34f-443c-9687-7f2985584692, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was switched to Maintenance mode by admin. >2014-10-08 10:10:32,062 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03 >2014-10-08 10:10:32,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-43) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-03. >2014-10-08 10:10:32,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-43) Removing vds [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from the domain in maintenance cache >2014-10-08 10:10:32,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-43) Removing host(s) [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from hosts unseen domain report cache >2014-10-08 10:10:32,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-7) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 1), log id: 36bf6b42 >2014-10-08 10:10:38,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, DisconnectStoragePoolVDSCommand, log id: 36bf6b42 >2014-10-08 10:10:38,625 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-7) [5f7551ce] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:10:38,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-7) [5f7551ce] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 578341d5 >2014-10-08 10:10:38,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-7) [5f7551ce] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 578341d5 >2014-10-08 10:12:24,166 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-9) [253ccb4e] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 10:12:24,202 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:12:24,205 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 2eb9aa7f >2014-10-08 10:12:24,205 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] VDS dell-r210ii-04 is spm and moved from up calling resetIrs. >2014-10-08 10:12:24,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, ignoreStopFailed = false), log id: 7494a814 >2014-10-08 10:12:24,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] START, SpmStopVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1), log id: 3193e77e >2014-10-08 10:12:24,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] SpmStopVDSCommand::Stopping SPM on vds dell-r210ii-04, pool id 00000002-0002-0002-0002-0000000001f1 >2014-10-08 10:12:24,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] FINISH, SpmStopVDSCommand, log id: 3193e77e >2014-10-08 10:12:24,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] FINISH, ResetIrsVDSCommand, log id: 7494a814 >2014-10-08 10:12:24,320 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] FINISH, SetVdsStatusVDSCommand, log id: 2eb9aa7f >2014-10-08 10:12:24,324 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 10:12:24,345 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:12:24,351 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-40) [253ccb4e] Correlation ID: 253ccb4e, Job ID: 014b28b8-3771-4992-8148-9ff0ba8b111b, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was switched to Maintenance mode by admin. >2014-10-08 10:12:25,499 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04 >2014-10-08 10:12:25,521 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-35) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-04. >2014-10-08 10:12:25,521 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-35) Removing vds [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from the domain in maintenance cache >2014-10-08 10:12:25,521 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-35) Removing host(s) [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from hosts unseen domain report cache >2014-10-08 10:12:25,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-68) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2), log id: 66055472 >2014-10-08 10:12:27,804 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-45) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : no reporting hosts >2014-10-08 10:12:27,807 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-45) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : no reporting hosts >2014-10-08 10:12:27,810 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-45) [55558e4e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:12:27,816 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-45) [55558e4e] Correlation ID: 55558e4e, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-08 10:12:32,833 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcherImpl.read0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.read(IOUtil.java:197) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.read(SSLEngineNioHelper.java:51) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.read(SSLClient.java:81) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.stomp.StompCommonClient.processIncoming(StompCommonClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:168) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 10:15:25,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-68) Command org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=5022, mMessage=Message timeout which can be caused by communication issues']] >2014-10-08 10:15:25,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-68) HostName = dell-r210ii-04 >2014-10-08 10:15:25,996 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-68) Command DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 10:15:25,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, DisconnectStoragePoolVDSCommand, log id: 66055472 >2014-10-08 10:15:26,022 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) Host encounter a problem moving to maintenance mode, probably error during disconnecting it from pool org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' (Failed with error VDS_NETWORK_ERROR and code 5022). The Host will stay in Maintenance >2014-10-08 10:19:48,174 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-24) Deactivating non existing principal admin::internal >2014-10-08 10:19:49,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) [30606a26] Attempting to update VMs/Templates Ovf. >2014-10-08 10:21:30,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-6) [7391b113] Start running CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 10:21:30,623 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-6) [7391b113] Lock Acquired to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 10:21:30,625 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-32) [620091ab] Start running CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 10:21:30,626 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-32) [620091ab] Lock Acquired to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 10:21:30,629 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-32) [620091ab] Finish handling CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 10:21:30,653 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-6) [7391b113] Finish handling CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 10:21:30,684 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:21:30,684 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] Before acquiring lock in order to prevent monitoring for host dell-r210ii-03 from data-center Default >2014-10-08 10:21:30,684 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-03 from data-center Default >2014-10-08 10:21:30,740 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7492c1a1 >2014-10-08 10:21:30,745 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] FINISH, SetVdsStatusVDSCommand, log id: 7492c1a1 >2014-10-08 10:21:30,819 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-03 from data-center Default >2014-10-08 10:21:30,825 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-4) [7391b113] Correlation ID: 7391b113, Job ID: f0152729-ab20-495a-838c-2768b54918b9, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was activated by admin. >2014-10-08 10:21:30,829 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [7391b113] Lock freed to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 10:21:30,847 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 10:21:30,847 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] Before acquiring lock in order to prevent monitoring for host dell-r210ii-04 from data-center Default >2014-10-08 10:21:30,847 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-04 from data-center Default >2014-10-08 10:21:30,856 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4fc556b9 >2014-10-08 10:21:30,861 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] FINISH, SetVdsStatusVDSCommand, log id: 4fc556b9 >2014-10-08 10:21:30,929 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-04 from data-center Default >2014-10-08 10:21:30,935 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-4) [620091ab] Correlation ID: 620091ab, Job ID: 5efd73cd-e26d-4f60-9269-c0bd6279dc00, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was activated by admin. >2014-10-08 10:21:30,938 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-4) [620091ab] Lock freed to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 10:21:32,351 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:21:33,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]), log id: 414d0fcf >2014-10-08 10:21:33,169 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 10:21:33,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetHardwareInfoVDSCommand, log id: 414d0fcf >2014-10-08 10:21:33,217 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [6c69553d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:21:33,224 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-23) [7a7bdf5a] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:21:33,229 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [7eec1dee] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:21:33,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [7eec1dee] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3f71d914 >2014-10-08 10:21:33,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [7eec1dee] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 3f71d914 >2014-10-08 10:21:33,514 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [7eec1dee] Host dell-r210ii-04 storage connection was succeeded >2014-10-08 10:21:33,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-36) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 40d5cfe8 >2014-10-08 10:21:33,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 14dab3b4 >2014-10-08 10:21:33,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GetHardwareInfoVDSCommand, log id: 14dab3b4 >2014-10-08 10:21:34,026 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-30) [15325c38] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:21:34,038 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-30) [5708a700] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:21:34,044 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-30) [27cbc732] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 10:21:34,078 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-30) [27cbc732] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e4715e5 >2014-10-08 10:21:34,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-30) [27cbc732] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 2e4715e5 >2014-10-08 10:21:34,373 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-30) [27cbc732] Host dell-r210ii-03 storage connection was succeeded >2014-10-08 10:21:35,203 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-36) FINISH, ConnectStoragePoolVDSCommand, log id: 40d5cfe8 >2014-10-08 10:21:35,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [7eec1dee] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 7196c556 >2014-10-08 10:21:35,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-34) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 69e36385 >2014-10-08 10:21:35,282 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [7eec1dee] FINISH, SetMOMPolicyParametersVDSCommand, log id: 7196c556 >2014-10-08 10:21:35,290 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [7eec1dee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-04 was set to Up. >2014-10-08 10:21:35,295 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [7eec1dee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 10:21:35,321 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-23) [79fdfbaa] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 10:21:37,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-34) FINISH, ConnectStoragePoolVDSCommand, log id: 69e36385 >2014-10-08 10:21:37,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-30) [27cbc732] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 2a843639 >2014-10-08 10:21:37,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-30) [27cbc732] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2a843639 >2014-10-08 10:21:37,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) [27cbc732] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-03 was set to Up. >2014-10-08 10:21:37,235 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) [27cbc732] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-08 10:21:37,276 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-30) [7356de8d] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 10:21:38,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-41) hostFromVds::selectedVds - dell-r210ii-04, spmStatus Free, storage pool Default >2014-10-08 10:21:38,721 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-41) starting spm on vds dell-r210ii-04, storage pool Default, prevId -1, LVER -1 >2014-10-08 10:21:38,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) START, SpmStartVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 56b623ee >2014-10-08 10:21:38,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) spmStart polling started: taskId = 720e1bd4-efc8-4905-afc3-c3513fceca61 >2014-10-08 10:21:57,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) spmStart polling ended: taskId = 720e1bd4-efc8-4905-afc3-c3513fceca61 task status = finished >2014-10-08 10:21:57,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) spmStart polling ended, spm status: SPM >2014-10-08 10:21:57,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-41) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=720e1bd4-efc8-4905-afc3-c3513fceca61), log id: 66208a5 >2014-10-08 10:21:57,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, HSMClearTaskVDSCommand, log id: 66208a5 >2014-10-08 10:21:57,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@26139a38, log id: 56b623ee >2014-10-08 10:21:57,866 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-41) Initialize Irs proxy from vds: 10.34.63.223 >2014-10-08 10:21:57,872 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dell-r210ii-04 (Address: 10.34.63.223). >2014-10-08 10:21:57,873 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 10:21:57,893 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-20) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false), log id: 371b08e1 >2014-10-08 10:21:57,982 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-27) [72b8f4cf] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 10:21:57,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-27) [72b8f4cf] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 16c1c51 >2014-10-08 10:21:57,990 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-21) [2cfc7121] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 10:21:57,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-20) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-0000000001f1 >2014-10-08 10:21:57,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-20) START, HSMGetAllTasksInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 6a2e1d40 >2014-10-08 10:21:57,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [2cfc7121] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 6b1d3ff1 >2014-10-08 10:21:58,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-20) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 6a2e1d40 >2014-10-08 10:21:58,047 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-20) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 371b08e1 >2014-10-08 10:21:58,047 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-20) Discovered no tasks on Storage Pool Default >2014-10-08 10:21:58,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-27) [72b8f4cf] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 16c1c51 >2014-10-08 10:21:58,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [2cfc7121] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 6b1d3ff1 >2014-10-08 10:59:33,373 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-4) [7ba86b7c] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:59:33,403 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [7ba86b7c] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 562f366 >2014-10-08 10:59:33,404 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [7ba86b7c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 562f366 >2014-10-08 10:59:33,488 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 10:59:33,552 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] Started HA reservation scoring method >2014-10-08 10:59:33,643 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@e208d83e), log id: 1b7fe6c9 >2014-10-08 10:59:33,646 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] FINISH, UpdateVmDynamicDataVDSCommand, log id: 1b7fe6c9 >2014-10-08 10:59:33,683 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 99182e8 >2014-10-08 10:59:33,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] START, CreateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 64618a3d >2014-10-08 10:59:33,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 10:59:33,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] FINISH, CreateVDSCommand, log id: 64618a3d >2014-10-08 10:59:33,801 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 99182e8 >2014-10-08 10:59:33,801 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:59:33,808 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-36) [7ba86b7c] Correlation ID: 7ba86b7c, Job ID: 76c5843a-adc0-4bdf-8473-e64a20876c17, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-03). >2014-10-08 10:59:34,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-96) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 58028893 >2014-10-08 10:59:34,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-96) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=0, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=WaitForLaunch, bootMenuEnable=false, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, copyPasteEnable=true, displayIp=10.34.63.222, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@e549809, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 58028893 >2014-10-08 10:59:34,920 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a ich6 Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=ich6, specParams={}, deviceType=sound, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a memballoon Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {target=1048576, specParams={model=virtio}, deviceType=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a, device=memballoon, type=balloon} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a scsi Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=0, specParams={}, deviceType=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424, device=scsi, model=virtio-scsi, type=controller} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a virtio-serial Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=virtio-serial, specParams={}, deviceType=controller, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a qxl Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=qxl, specParams={vram=32768, ram=65536, heads=1}, deviceType=video, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a spice Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.222, displayNetwork=rhevm}, deviceType=graphics, type=graphics} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a bridge Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {nicModel=pv, macAddr=00:1a:4a:76:fa:00, linkActive=true, network=rhevm, filter=vdsm-no-mac-spoofing, specParams={inbound={}, outbound={}}, deviceType=interface, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28, device=bridge, type=interface} >2014-10-08 10:59:34,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a cdrom Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=2, iface=ide, specParams={path=}, readonly=true, deviceType=disk, deviceId=178844c3-0795-4273-b354-36f0d6175a32, path=, device=cdrom, shared=false, type=disk} >2014-10-08 10:59:34,922 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a disk Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {volumeInfo={domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, volType=path, leaseOffset=111149056, path=/rhev/data-center/mnt/blockSD/322e3360-066e-4e98-a0e9-dd44e82f0992/images/0dbe1f65-c19d-4e40-941c-bf912d2380fa/4d141588-ecbd-4e67-b588-55859e059aa0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, leasePath=/dev/322e3360-066e-4e98-a0e9-dd44e82f0992/leases, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, index=0, iface=virtio, apparentsize=1073741824, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, readonly=false, deviceType=disk, shared=false, truesize=1073741824, type=disk, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, reqsize=0, format=raw, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa, poolID=00000002-0002-0002-0002-0000000001f1, device=disk, path=/rhev/data-center/00000002-0002-0002-0002-0000000001f1/322e3360-066e-4e98-a0e9-dd44e82f0992/images/0dbe1f65-c19d-4e40-941c-bf912d2380fa/4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, optional=false, bootOrder=1, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, specParams={}, volumeChain=[Ljava.lang.Object;@5ff0f759} >2014-10-08 10:59:38,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-39) START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 1fa79023 >2014-10-08 10:59:38,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, DestroyVDSCommand, log id: 1fa79023 >2014-10-08 10:59:38,368 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 10:59:38,368 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) Running on vds during rerun failed vm: null >2014-10-08 10:59:38,369 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-03 >2014-10-08 10:59:38,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 7f44ab7b >2014-10-08 10:59:38,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) FINISH, FullListVdsCommand, return: [], log id: 7f44ab7b >2014-10-08 10:59:38,380 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-03 >2014-10-08 10:59:38,390 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-33) Correlation ID: 7ba86b7c, Job ID: 76c5843a-adc0-4bdf-8473-e64a20876c17, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-03. >2014-10-08 10:59:38,397 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-33) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:59:38,425 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 54fc511a >2014-10-08 10:59:38,426 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 54fc511a >2014-10-08 10:59:38,492 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-33) Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 10:59:38,562 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@93b9e803), log id: 6d353a5b >2014-10-08 10:59:38,565 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, UpdateVmDynamicDataVDSCommand, log id: 6d353a5b >2014-10-08 10:59:38,569 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, CreateVmVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 7f04af31 >2014-10-08 10:59:38,572 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-33) START, CreateVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 404292e2 >2014-10-08 10:59:38,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-33) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 10:59:38,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, CreateVDSCommand, log id: 404292e2 >2014-10-08 10:59:38,637 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-33) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7f04af31 >2014-10-08 10:59:38,637 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-33) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:59:38,640 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-33) Correlation ID: 7ba86b7c, Job ID: 76c5843a-adc0-4bdf-8473-e64a20876c17, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-04). >2014-10-08 10:59:38,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-48) START, FullListVdsCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 5315bb30 >2014-10-08 10:59:38,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-48) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=0, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=WaitForLaunch, bootMenuEnable=false, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, copyPasteEnable=true, displayIp=10.34.63.223, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@37b476ed, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 5315bb30 >2014-10-08 10:59:38,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a qxl Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=qxl, specParams={vram=32768, ram=65536, heads=1}, deviceType=video, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa} >2014-10-08 10:59:38,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a cdrom Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=2, iface=ide, specParams={path=}, readonly=true, deviceType=disk, deviceId=178844c3-0795-4273-b354-36f0d6175a32, path=, device=cdrom, shared=false, type=disk} >2014-10-08 10:59:38,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a disk Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=0, iface=virtio, reqsize=0, format=raw, deviceType=disk, bootOrder=1, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, apparentsize=1073741824, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, readonly=false, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, optional=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa, truesize=1073741824, poolID=00000002-0002-0002-0002-0000000001f1, device=disk, shared=false, propagateErrors=off, type=disk} >2014-10-08 10:59:38,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a bridge Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {nicModel=pv, macAddr=00:1a:4a:76:fa:00, linkActive=true, network=rhevm, filter=vdsm-no-mac-spoofing, specParams={inbound={}, outbound={}}, deviceType=interface, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28, device=bridge, type=interface} >2014-10-08 10:59:38,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a ich6 Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=ich6, specParams={}, deviceType=sound, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc} >2014-10-08 10:59:38,771 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a memballoon Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {target=1048576, specParams={model=virtio}, deviceType=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a, device=memballoon, type=balloon} >2014-10-08 10:59:38,771 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a scsi Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {index=0, specParams={}, deviceType=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424, device=scsi, model=virtio-scsi, type=controller} >2014-10-08 10:59:38,771 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a virtio-serial Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=virtio-serial, specParams={}, deviceType=controller, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823} >2014-10-08 10:59:41,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-24) START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 40aa337 >2014-10-08 10:59:42,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, DestroyVDSCommand, log id: 40aa337 >2014-10-08 10:59:42,113 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test is down with error. Exit message: Child quit during startup handshake: Input/output error. >2014-10-08 10:59:42,113 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) Running on vds during rerun failed vm: null >2014-10-08 10:59:42,114 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) VM test (057790fa-b736-49e7-a7c1-4c832c1c3511) is running in db and not running in VDS dell-r210ii-04 >2014-10-08 10:59:42,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-24) START, FullListVdsCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 3cbeb732 >2014-10-08 10:59:42,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-24) FINISH, FullListVdsCommand, return: [], log id: 3cbeb732 >2014-10-08 10:59:42,127 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) Rerun vm 057790fa-b736-49e7-a7c1-4c832c1c3511. Called from vds dell-r210ii-04 >2014-10-08 10:59:42,137 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) Correlation ID: 7ba86b7c, Job ID: 76c5843a-adc0-4bdf-8473-e64a20876c17, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test on Host dell-r210ii-04. >2014-10-08 10:59:42,157 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-13) Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:59:42,187 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-13) START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 6dcb0252 >2014-10-08 10:59:42,188 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-7-thread-13) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6dcb0252 >2014-10-08 10:59:42,222 WARN [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-13) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_NO_HOSTS >2014-10-08 10:59:42,222 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-13) Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 10:59:42,232 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) Correlation ID: 7ba86b7c, Job ID: 76c5843a-adc0-4bdf-8473-e64a20876c17, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM test (User: admin). >2014-10-08 10:59:42,238 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-7-thread-23) [4e667143] Running command: ProcessDownVmCommand internal: true. >2014-10-08 11:02:48,314 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-1) [2741f391] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 11:02:48,378 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN, ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 11:02:48,409 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: a2683fb >2014-10-08 11:02:48,415 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] FINISH, SetVdsStatusVDSCommand, log id: a2683fb >2014-10-08 11:02:48,417 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 2af61a04 >2014-10-08 11:02:48,417 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] VDS dell-r210ii-04 is spm and moved from up calling resetIrs. >2014-10-08 11:02:48,418 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, ignoreStopFailed = false), log id: 7620bc87 >2014-10-08 11:02:48,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] START, SpmStopVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1), log id: 1d62d18 >2014-10-08 11:02:48,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] SpmStopVDSCommand::Stopping SPM on vds dell-r210ii-04, pool id 00000002-0002-0002-0002-0000000001f1 >2014-10-08 11:02:48,517 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] FINISH, SpmStopVDSCommand, log id: 1d62d18 >2014-10-08 11:02:48,523 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] FINISH, ResetIrsVDSCommand, log id: 7620bc87 >2014-10-08 11:02:48,528 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] FINISH, SetVdsStatusVDSCommand, log id: 2af61a04 >2014-10-08 11:02:48,533 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 11:02:48,552 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 11:02:48,559 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-31) [2741f391] Correlation ID: 2741f391, Job ID: fdd13704-b305-41f0-9c42-66df126828bb, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was switched to Maintenance mode by admin. >2014-10-08 11:02:48,642 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-31) [2741f391] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 11:02:48,647 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-31) [2741f391] Correlation ID: 2741f391, Job ID: 15d9de11-a9d0-41ac-9edd-ccaa0a9c8a26, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was switched to Maintenance mode by admin. >2014-10-08 11:02:49,416 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04 >2014-10-08 11:02:49,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-12) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-04. >2014-10-08 11:02:49,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-12) Removing vds [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from the domain in maintenance cache >2014-10-08 11:02:49,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-12) Removing host(s) [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from hosts unseen domain report cache >2014-10-08 11:02:49,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-4) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2), log id: 1a03195b >2014-10-08 11:02:50,418 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03 >2014-10-08 11:02:50,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-38) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-03. >2014-10-08 11:02:50,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-38) Removing vds [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from the domain in maintenance cache >2014-10-08 11:02:50,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-38) Removing host(s) [04f67d65-72bc-4ddc-88b7-81d0053dff0b] from hosts unseen domain report cache >2014-10-08 11:02:50,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-48) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 1), log id: 2b22966e >2014-10-08 11:02:51,437 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-33) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : no reporting hosts >2014-10-08 11:02:51,446 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-33) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : no reporting hosts >2014-10-08 11:02:51,451 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-33) [7993cf81] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:02:51,464 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) [7993cf81] Correlation ID: 7993cf81, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-08 11:02:54,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, DisconnectStoragePoolVDSCommand, log id: 1a03195b >2014-10-08 11:02:54,564 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-4) [1850603] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:02:54,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-4) [1850603] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6aec8d76 >2014-10-08 11:02:54,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-4) [1850603] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 6aec8d76 >2014-10-08 11:02:57,272 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, DisconnectStoragePoolVDSCommand, log id: 2b22966e >2014-10-08 11:02:57,273 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-48) [1e35a748] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:02:57,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-48) [1e35a748] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1c67dc5a >2014-10-08 11:02:57,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-48) [1e35a748] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 1c67dc5a >2014-10-08 11:03:57,542 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-6) [33c2f248] Start running CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 11:03:57,542 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-3) [43b06f84] Start running CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 11:03:57,544 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-3) [43b06f84] Lock Acquired to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 11:03:57,544 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-6) [33c2f248] Lock Acquired to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 11:03:57,547 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-6) [33c2f248] Finish handling CanDoAction for command number 1/2 (Command type: ActivateVds) >2014-10-08 11:03:57,576 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-7-thread-3) [43b06f84] Finish handling CanDoAction for command number 2/2 (Command type: ActivateVds) >2014-10-08 11:03:57,601 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 11:03:57,602 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] Before acquiring lock in order to prevent monitoring for host dell-r210ii-04 from data-center Default >2014-10-08 11:03:57,602 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-04 from data-center Default >2014-10-08 11:03:57,612 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 5472e9ed >2014-10-08 11:03:57,617 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] FINISH, SetVdsStatusVDSCommand, log id: 5472e9ed >2014-10-08 11:03:57,680 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-04 from data-center Default >2014-10-08 11:03:57,684 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-35) [33c2f248] Correlation ID: 33c2f248, Job ID: 4c7d2086-a095-4ae4-b167-562ebba43a83, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was activated by admin. >2014-10-08 11:03:57,689 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [33c2f248] Lock freed to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 11:03:57,710 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 11:03:57,710 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] Before acquiring lock in order to prevent monitoring for host dell-r210ii-03 from data-center Default >2014-10-08 11:03:57,710 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-03 from data-center Default >2014-10-08 11:03:57,760 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1b811ebc >2014-10-08 11:03:57,766 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] FINISH, SetVdsStatusVDSCommand, log id: 1b811ebc >2014-10-08 11:03:57,831 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] Activate finished. Lock released. Monitoring can run now for host dell-r210ii-03 from data-center Default >2014-10-08 11:03:57,837 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-35) [43b06f84] Correlation ID: 43b06f84, Job ID: ce0b460c-b5c7-4491-b9e3-3240857502c6, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 was activated by admin. >2014-10-08 11:03:57,841 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-35) [43b06f84] Lock freed to object EngineLock [exclusiveLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS >, sharedLocks= ] >2014-10-08 11:03:57,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vds=Host[dell-r210ii-04,7f0606fe-4272-40af-973f-ddfb3f78ab4f]), log id: 576b68fa >2014-10-08 11:03:57,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GetHardwareInfoVDSCommand, log id: 576b68fa >2014-10-08 11:03:57,915 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-54) [681e1ae1] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 11:03:57,923 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-54) [65796611] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:03:57,929 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-54) [462abdf1] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:03:57,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-54) [462abdf1] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d4d33ae >2014-10-08 11:03:58,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 19f31095 >2014-10-08 11:03:58,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetHardwareInfoVDSCommand, log id: 19f31095 >2014-10-08 11:03:58,207 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-53) [1492fb22] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 11:03:58,216 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-53) [1be1067] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:03:58,224 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-53) [6df5e041] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 11:03:58,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-54) [462abdf1] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 2d4d33ae >2014-10-08 11:03:58,311 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-54) [462abdf1] Host dell-r210ii-04 storage connection was succeeded >2014-10-08 11:03:58,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-9) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: cc0ed9e >2014-10-08 11:03:58,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-53) [6df5e041] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69eabc10 >2014-10-08 11:03:58,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-53) [6df5e041] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 69eabc10 >2014-10-08 11:03:58,690 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-53) [6df5e041] Host dell-r210ii-03 storage connection was succeeded >2014-10-08 11:03:58,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-9) FINISH, ConnectStoragePoolVDSCommand, log id: cc0ed9e >2014-10-08 11:03:58,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-54) [462abdf1] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 2949e5a7 >2014-10-08 11:03:58,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-37) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 31a74b4a >2014-10-08 11:03:58,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-54) [462abdf1] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2949e5a7 >2014-10-08 11:03:58,956 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) [462abdf1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-04 was set to Up. >2014-10-08 11:03:58,961 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) [462abdf1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 11:03:58,975 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 11:03:59,502 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-37) FINISH, ConnectStoragePoolVDSCommand, log id: 31a74b4a >2014-10-08 11:03:59,572 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [6df5e041] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 6d340f54 >2014-10-08 11:03:59,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [6df5e041] FINISH, SetMOMPolicyParametersVDSCommand, log id: 6d340f54 >2014-10-08 11:03:59,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [6df5e041] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-03 was set to Up. >2014-10-08 11:03:59,792 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [6df5e041] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-08 11:03:59,848 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-53) [712dcc3c] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 11:04:01,662 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-44) hostFromVds::selectedVds - dell-r210ii-04, spmStatus Free, storage pool Default >2014-10-08 11:04:01,666 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-44) starting spm on vds dell-r210ii-04, storage pool Default, prevId -1, LVER -1 >2014-10-08 11:04:01,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-44) START, SpmStartVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 203c181a >2014-10-08 11:04:01,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-44) spmStart polling started: taskId = e6bad0f3-b201-4018-8e22-38bf32a63739 >2014-10-08 11:04:21,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-44) spmStart polling ended: taskId = e6bad0f3-b201-4018-8e22-38bf32a63739 task status = finished >2014-10-08 11:04:21,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-44) spmStart polling ended, spm status: SPM >2014-10-08 11:04:21,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-44) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=e6bad0f3-b201-4018-8e22-38bf32a63739), log id: 6c401fbc >2014-10-08 11:04:21,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, HSMClearTaskVDSCommand, log id: 6c401fbc >2014-10-08 11:04:21,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7d94302f, log id: 203c181a >2014-10-08 11:04:21,811 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-44) Initialize Irs proxy from vds: 10.34.63.223 >2014-10-08 11:04:21,817 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-44) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dell-r210ii-04 (Address: 10.34.63.223). >2014-10-08 11:04:21,817 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 11:04:21,837 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-2) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false), log id: 32dab58e >2014-10-08 11:04:21,937 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-10) [371f526e] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 11:04:21,946 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-49) [4bd9b3fa] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:04:21,947 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-10) [371f526e] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 6dae439f >2014-10-08 11:04:21,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-2) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-0000000001f1 >2014-10-08 11:04:21,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-2) START, HSMGetAllTasksInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 24f80686 >2014-10-08 11:04:21,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-49) [4bd9b3fa] START, GetVGInfoVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 5947f9f4 >2014-10-08 11:04:22,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-2) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 24f80686 >2014-10-08 11:04:22,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-2) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 32dab58e >2014-10-08 11:04:22,006 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-2) Discovered no tasks on Storage Pool Default >2014-10-08 11:04:22,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-10) [371f526e] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 6dae439f >2014-10-08 11:04:22,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-49) [4bd9b3fa] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 5947f9f4 >2014-10-08 11:06:27,278 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-2) [2d636d17] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 11:06:27,324 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [2d636d17] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 44c775f9 >2014-10-08 11:06:27,324 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [2d636d17] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 44c775f9 >2014-10-08 11:06:27,403 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] Running command: RunVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 11:06:27,474 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-14) [2d636d17] Started HA reservation scoring method >2014-10-08 11:06:27,547 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@f7f17236), log id: 65fb9449 >2014-10-08 11:06:27,550 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] FINISH, UpdateVmDynamicDataVDSCommand, log id: 65fb9449 >2014-10-08 11:06:27,583 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 8e23bca >2014-10-08 11:06:27,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] START, CreateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, vm=VM [test]), log id: 70b0d980 >2014-10-08 11:06:27,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=057790fa-b736-49e7-a7c1-4c832c1c3511,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=6ac52311-34b0-4cb3-824f-0595ac1d40fa}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=178844c3-0795-4273-b354-36f0d6175a32}, {shared=false, index=0, volumeID=4d141588-ecbd-4e67-b588-55859e059aa0, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=0dbe1f65-c19d-4e40-941c-bf912d2380fa, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=0dbe1f65-c19d-4e40-941c-bf912d2380fa}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=aa436a7a-14af-48dd-9787-337598ee6e28}, {specParams={}, device=ich6, type=sound, deviceId=a0133f58-b1b8-43ee-93c7-2cb028758ecc}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a364e7bd-dd85-48b3-abe3-d86e7ffb225a}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=741849bd-7853-4ca1-a4c5-c9129c413424}, {specParams={}, device=virtio-serial, type=controller, deviceId=4f50e964-c80b-437f-92f7-34053722c823}],vmName=test,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 11:06:27,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] FINISH, CreateVDSCommand, log id: 70b0d980 >2014-10-08 11:06:27,669 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 8e23bca >2014-10-08 11:06:27,670 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-14) [2d636d17] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 11:06:27,675 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-14) [2d636d17] Correlation ID: 2d636d17, Job ID: cccc6ba9-ea14-41a6-bcef-35ad179f587a, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin (Host: dell-r210ii-03). >2014-10-08 11:06:29,418 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM test 057790fa-b736-49e7-a7c1-4c832c1c3511 moved from WaitForLaunch --> PoweringUp >2014-10-08 11:06:29,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[057790fa-b736-49e7-a7c1-4c832c1c3511]), log id: 233012bd >2014-10-08 11:06:29,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=9242, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=5900, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, pauseCode=NOERR, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, copyPasteEnable=true, displayIp=10.34.63.222, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@18bad3c8, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 233012bd >2014-10-08 11:06:29,434 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Received a spice Device without an address when processing VM 057790fa-b736-49e7-a7c1-4c832c1c3511 devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.222, displayNetwork=rhevm}, deviceType=graphics, type=graphics, tlsPort=5900} >2014-10-08 11:07:27,672 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) VM test 057790fa-b736-49e7-a7c1-4c832c1c3511 moved from PoweringUp --> Up >2014-10-08 11:07:27,691 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) Correlation ID: 2d636d17, Job ID: cccc6ba9-ea14-41a6-bcef-35ad179f587a, Call Stack: null, Custom Event ID: -1, Message: VM test started on Host dell-r210ii-03 >2014-10-08 11:07:52,085 INFO [org.ovirt.engine.core.bll.MoveDisksCommand] (ajp-/127.0.0.1:8702-6) [11754d0a] Running command: MoveDisksCommand internal: false. Entities affected : ID: 0dbe1f65-c19d-4e40-941c-bf912d2380fa Type: DiskAction group CONFIGURE_DISK_STORAGE with role type USER >2014-10-08 11:07:52,213 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (ajp-/127.0.0.1:8702-6) [11754d0a] Lock Acquired to object EngineLock [exclusiveLocks= key: 0dbe1f65-c19d-4e40-941c-bf912d2380fa value: DISK >, sharedLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >] >2014-10-08 11:07:52,306 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (org.ovirt.thread.pool-7-thread-2) [11754d0a] Running command: LiveMigrateVmDisksCommand Task handler: LiveSnapshotTaskHandler internal: false. Entities affected : ID: 0dbe1f65-c19d-4e40-941c-bf912d2380fa Type: DiskAction group CONFIGURE_DISK_STORAGE with role type USER, ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: StorageAction group CREATE_DISK with role type USER >2014-10-08 11:07:52,353 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-7-thread-2) Command acdcf669-eada-42f1-a4fc-5614954471f4 persisting async task placeholder for child command be573c8f-6df7-4a60-973c-2e56e9f56fd2 >2014-10-08 11:07:52,508 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-7-thread-2) CanDoAction of action CreateAllSnapshotsFromVm failed. Reasons:VAR__ACTION__CREATE,VAR__TYPE__SNAPSHOT,ACTION_TYPE_FAILED_QEMU_UNSUPPORTED_OPERATION >2014-10-08 11:07:52,523 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-2) Removed task f0bbbd7a-5988-4f3e-a626-cf2d13de0e10 from DataBase >2014-10-08 11:07:52,532 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (org.ovirt.thread.pool-7-thread-2) Lock freed to object EngineLock [exclusiveLocks= key: 0dbe1f65-c19d-4e40-941c-bf912d2380fa value: DISK >, sharedLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >] >2014-10-08 11:19:49,271 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-10-08 11:19:49,384 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-57) [59a80906] Lock Acquired to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 11:19:49,386 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-57) [59a80906] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:49,397 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (DefaultQuartzScheduler_Worker-57) [7c5ab734] Running command: CreateOvfStoresForStorageDomainCommand internal: true. >2014-10-08 11:19:49,398 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-57) [27b1f6b4] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:49,412 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-57) [406210b0] Running command: AddDiskCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: StorageAction group CREATE_DISK with role type USER >2014-10-08 11:19:49,462 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-57) [7329d863] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:49,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-57) [7329d863] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = 85417fc3-7f4d-46c4-b01e-d7d0523c76cf, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 19185b82-eb25-4a21-a160-aaf242803eaf, newImageDescription = OVF_STORE), log id: 467f242d >2014-10-08 11:19:49,469 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-57) [7329d863] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-08 11:19:49,520 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-57) [7329d863] FINISH, CreateImageVDSCommand, return: 19185b82-eb25-4a21-a160-aaf242803eaf, log id: 467f242d >2014-10-08 11:19:49,522 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-57) [7329d863] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 4180fdce-da98-4610-b731-754a843e03ad >2014-10-08 11:19:49,522 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-57) [7329d863] CommandMultiAsyncTasks::AttachTask: Attaching task 4834f875-bd81-4e5b-bfae-2de0830b0ae3 to command 4180fdce-da98-4610-b731-754a843e03ad. >2014-10-08 11:19:49,536 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-57) [7329d863] Adding task 4834f875-bd81-4e5b-bfae-2de0830b0ae3 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 11:19:49,551 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-57) [7329d863] Correlation ID: 406210b0, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-10-08 11:19:49,555 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-57) [2c6a5d31] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:49,612 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-57) [737bb96e] Running command: AddDiskCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: StorageAction group CREATE_DISK with role type USER >2014-10-08 11:19:49,633 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:49,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = e829152f-8a2d-4573-898e-8caca2f041b0, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 0792a886-4908-46ee-9b36-1f40cc4edf6e, newImageDescription = OVF_STORE), log id: 3636419d >2014-10-08 11:19:49,645 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-08 11:19:49,775 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] FINISH, CreateImageVDSCommand, return: 0792a886-4908-46ee-9b36-1f40cc4edf6e, log id: 3636419d >2014-10-08 11:19:49,777 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] CommandMultiAsyncTasks::AttachTask: Attaching task d4f7db12-7904-4c40-b7c6-7b6477b5d052 to command 4180fdce-da98-4610-b731-754a843e03ad. >2014-10-08 11:19:49,793 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] Adding task d4f7db12-7904-4c40-b7c6-7b6477b5d052 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 11:19:49,812 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] Correlation ID: 737bb96e, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-10-08 11:19:49,821 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] BaseAsyncTask::startPollingTask: Starting to poll task 4834f875-bd81-4e5b-bfae-2de0830b0ae3. >2014-10-08 11:19:49,822 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] BaseAsyncTask::startPollingTask: Starting to poll task d4f7db12-7904-4c40-b7c6-7b6477b5d052. >2014-10-08 11:19:49,822 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-57) [40ce3b6d] Lock freed to object EngineLock [exclusiveLocks= key: a27ef16b-ef58-4130-8d71-e5183b8556d5 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 11:19:57,295 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-15) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-10-08 11:19:57,301 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-15) SPMAsyncTask::PollTask: Polling task d4f7db12-7904-4c40-b7c6-7b6477b5d052 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 11:19:57,301 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-15) BaseAsyncTask::onTaskEndSuccess: Task d4f7db12-7904-4c40-b7c6-7b6477b5d052 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 11:19:57,301 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-15) Task with DB Task ID 0ab3badc-03ca-4a4a-8050-2fb1b9ea9a49 and VDSM Task ID 4834f875-bd81-4e5b-bfae-2de0830b0ae3 is in state Polling. End action for command 4180fdce-da98-4610-b731-754a843e03ad will proceed when all the entitys tasks are completed. >2014-10-08 11:19:57,302 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-15) SPMAsyncTask::PollTask: Polling task 4834f875-bd81-4e5b-bfae-2de0830b0ae3 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 11:19:57,302 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-15) BaseAsyncTask::onTaskEndSuccess: Task 4834f875-bd81-4e5b-bfae-2de0830b0ae3 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 11:19:57,302 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-15) CommandAsyncTask::endActionIfNecessary: All tasks of command 4180fdce-da98-4610-b731-754a843e03ad has ended -> executing endAction >2014-10-08 11:19:57,302 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-15) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 4180fdce-da98-4610-b731-754a843e03ad): calling endAction . >2014-10-08 11:19:57,302 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-15) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateOvfStoresForStorageDomain, executionIndex: 0 >2014-10-08 11:19:57,310 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [7c5ab734] Ending command successfully: org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand >2014-10-08 11:19:57,318 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-15) [40ce3b6d] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-08 11:19:57,334 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-15) [40ce3b6d] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = e829152f-8a2d-4573-898e-8caca2f041b0, imageId = 0792a886-4908-46ee-9b36-1f40cc4edf6e), log id: 5d85f883 >2014-10-08 11:19:57,348 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-15) [40ce3b6d] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@e7fb79b4, log id: 5d85f883 >2014-10-08 11:19:57,364 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-15) [7329d863] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-08 11:19:57,384 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-15) [7329d863] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = 85417fc3-7f4d-46c4-b01e-d7d0523c76cf, imageId = 19185b82-eb25-4a21-a160-aaf242803eaf), log id: 6d8bdff >2014-10-08 11:19:57,397 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-15) [7329d863] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f04f9d24, log id: 6d8bdff >2014-10-08 11:19:57,469 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [7c5ab734] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:57,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [7c5ab734] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = 85417fc3-7f4d-46c4-b01e-d7d0523c76cf, imageId = 19185b82-eb25-4a21-a160-aaf242803eaf), log id: 177ee73d >2014-10-08 11:19:57,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [7c5ab734] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 11:19:57,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [7c5ab734] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=a27ef16b-ef58-4130-8d71-e5183b8556d5 > imageGroupGUID=85417fc3-7f4d-46c4-b01e-d7d0523c76cf > volUUID=19185b82-eb25-4a21-a160-aaf242803eaf > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a27ef16b-ef58-4130-8d71-e5183b8556d5"}],"Last Updated":null} > >2014-10-08 11:19:57,641 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [7c5ab734] FINISH, SetVolumeDescriptionVDSCommand, log id: 177ee73d >2014-10-08 11:19:57,663 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-08 11:19:57,670 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] Running command: UploadStreamCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:19:57,676 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] START, UploadStreamVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 65d7abce >2014-10-08 11:19:57,676 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] -- executeVdsBrokerCommand: >2014-10-08 11:19:57,676 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=a27ef16b-ef58-4130-8d71-e5183b8556d5 > imageGUID=85417fc3-7f4d-46c4-b01e-d7d0523c76cf > volUUID=19185b82-eb25-4a21-a160-aaf242803eaf > size=10,240 > >2014-10-08 11:19:59,642 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] FINISH, UploadStreamVDSCommand, log id: 65d7abce >2014-10-08 11:19:59,644 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] CommandMultiAsyncTasks::AttachTask: Attaching task 1818b943-d543-4798-abe4-17323eaac993 to command 4180fdce-da98-4610-b731-754a843e03ad. >2014-10-08 11:19:59,656 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] Adding task 1818b943-d543-4798-abe4-17323eaac993 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 11:19:59,662 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-08 11:19:59,670 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = 85417fc3-7f4d-46c4-b01e-d7d0523c76cf, imageId = 19185b82-eb25-4a21-a160-aaf242803eaf), log id: c2b6e0f >2014-10-08 11:19:59,671 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 11:19:59,671 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=a27ef16b-ef58-4130-8d71-e5183b8556d5 > imageGroupGUID=85417fc3-7f4d-46c4-b01e-d7d0523c76cf > volUUID=19185b82-eb25-4a21-a160-aaf242803eaf > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a27ef16b-ef58-4130-8d71-e5183b8556d5"}],"Last Updated":"Wed Oct 08 11:19:57 CEST 2014","Size":10240} > >2014-10-08 11:19:59,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] FINISH, SetVolumeDescriptionVDSCommand, log id: c2b6e0f >2014-10-08 11:19:59,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = e829152f-8a2d-4573-898e-8caca2f041b0, imageId = 0792a886-4908-46ee-9b36-1f40cc4edf6e), log id: 4478a6e6 >2014-10-08 11:19:59,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 11:19:59,829 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=a27ef16b-ef58-4130-8d71-e5183b8556d5 > imageGroupGUID=e829152f-8a2d-4573-898e-8caca2f041b0 > volUUID=0792a886-4908-46ee-9b36-1f40cc4edf6e > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a27ef16b-ef58-4130-8d71-e5183b8556d5"}],"Last Updated":null} > >2014-10-08 11:19:59,975 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [2aa2e97c] FINISH, SetVolumeDescriptionVDSCommand, log id: 4478a6e6 >2014-10-08 11:20:00,014 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-08 11:20:00,020 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] Running command: UploadStreamCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 11:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] START, UploadStreamVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 685eced9 >2014-10-08 11:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] -- executeVdsBrokerCommand: >2014-10-08 11:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=a27ef16b-ef58-4130-8d71-e5183b8556d5 > imageGUID=e829152f-8a2d-4573-898e-8caca2f041b0 > volUUID=0792a886-4908-46ee-9b36-1f40cc4edf6e > size=10,240 > >2014-10-08 11:20:02,272 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] FINISH, UploadStreamVDSCommand, log id: 685eced9 >2014-10-08 11:20:02,274 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-15) [5c170702] CommandMultiAsyncTasks::AttachTask: Attaching task ff1f314b-6b8d-4d90-a279-af4e775ba93d to command 4180fdce-da98-4610-b731-754a843e03ad. >2014-10-08 11:20:02,286 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-15) [5c170702] Adding task ff1f314b-6b8d-4d90-a279-af4e775ba93d (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 11:20:02,291 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS_EXECUTION >] >2014-10-08 11:20:02,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = a27ef16b-ef58-4130-8d71-e5183b8556d5, imageGroupId = e829152f-8a2d-4573-898e-8caca2f041b0, imageId = 0792a886-4908-46ee-9b36-1f40cc4edf6e), log id: 8e5888c >2014-10-08 11:20:02,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 11:20:02,293 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=a27ef16b-ef58-4130-8d71-e5183b8556d5 > imageGroupGUID=e829152f-8a2d-4573-898e-8caca2f041b0 > volUUID=0792a886-4908-46ee-9b36-1f40cc4edf6e > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a27ef16b-ef58-4130-8d71-e5183b8556d5"}],"Last Updated":"Wed Oct 08 11:19:57 CEST 2014","Size":10240} > >2014-10-08 11:20:02,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] FINISH, SetVolumeDescriptionVDSCommand, log id: 8e5888c >2014-10-08 11:20:02,445 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] BaseAsyncTask::startPollingTask: Starting to poll task 1818b943-d543-4798-abe4-17323eaac993. >2014-10-08 11:20:02,445 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] BaseAsyncTask::startPollingTask: Starting to poll task ff1f314b-6b8d-4d90-a279-af4e775ba93d. >2014-10-08 11:20:02,445 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain completed, handling the result. >2014-10-08 11:20:02,446 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain succeeded, clearing tasks. >2014-10-08 11:20:02,446 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] SPMAsyncTask::ClearAsyncTask: Attempting to clear task d4f7db12-7904-4c40-b7c6-7b6477b5d052 >2014-10-08 11:20:02,446 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = d4f7db12-7904-4c40-b7c6-7b6477b5d052), log id: 1d18cd91 >2014-10-08 11:20:02,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=d4f7db12-7904-4c40-b7c6-7b6477b5d052), log id: 475ff983 >2014-10-08 11:20:02,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] FINISH, HSMClearTaskVDSCommand, log id: 475ff983 >2014-10-08 11:20:02,465 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] FINISH, SPMClearTaskVDSCommand, log id: 1d18cd91 >2014-10-08 11:20:02,469 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] BaseAsyncTask::removeTaskFromDB: Removed task d4f7db12-7904-4c40-b7c6-7b6477b5d052 from DataBase >2014-10-08 11:20:02,469 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4834f875-bd81-4e5b-bfae-2de0830b0ae3 >2014-10-08 11:20:02,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 4834f875-bd81-4e5b-bfae-2de0830b0ae3), log id: 54249a7 >2014-10-08 11:20:02,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=4834f875-bd81-4e5b-bfae-2de0830b0ae3), log id: 42f175a3 >2014-10-08 11:20:02,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] FINISH, HSMClearTaskVDSCommand, log id: 42f175a3 >2014-10-08 11:20:02,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-15) [5c170702] FINISH, SPMClearTaskVDSCommand, log id: 54249a7 >2014-10-08 11:20:02,492 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-15) [5c170702] BaseAsyncTask::removeTaskFromDB: Removed task 4834f875-bd81-4e5b-bfae-2de0830b0ae3 from DataBase >2014-10-08 11:20:02,493 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-15) [5c170702] [within thread]: Some of the tasks related to command id 4180fdce-da98-4610-b731-754a843e03ad were not cleared yet (Task id ff1f314b-6b8d-4d90-a279-af4e775ba93d is in state Polling). >2014-10-08 11:20:07,302 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-69) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) SPMAsyncTask::PollTask: Polling task 1818b943-d543-4798-abe4-17323eaac993 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) BaseAsyncTask::onTaskEndSuccess: Task 1818b943-d543-4798-abe4-17323eaac993 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-69) Task with DB Task ID 73a8265b-0a76-47db-94b9-17cc293cc9c1 and VDSM Task ID ff1f314b-6b8d-4d90-a279-af4e775ba93d is in state Polling. End action for command 4180fdce-da98-4610-b731-754a843e03ad will proceed when all the entitys tasks are completed. >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) SPMAsyncTask::PollTask: Polling task ff1f314b-6b8d-4d90-a279-af4e775ba93d (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) BaseAsyncTask::onTaskEndSuccess: Task ff1f314b-6b8d-4d90-a279-af4e775ba93d (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-69) CommandAsyncTask::endActionIfNecessary: All tasks of command 4180fdce-da98-4610-b731-754a843e03ad has ended -> executing endAction >2014-10-08 11:20:07,308 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-69) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 4180fdce-da98-4610-b731-754a843e03ad): calling endAction . >2014-10-08 11:20:07,309 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-35) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-10-08 11:20:07,344 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-10-08 11:20:07,344 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-10-08 11:20:07,344 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-10-08 11:20:07,344 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] SPMAsyncTask::ClearAsyncTask: Attempting to clear task ff1f314b-6b8d-4d90-a279-af4e775ba93d >2014-10-08 11:20:07,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = ff1f314b-6b8d-4d90-a279-af4e775ba93d), log id: 55a03ca7 >2014-10-08 11:20:07,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=ff1f314b-6b8d-4d90-a279-af4e775ba93d), log id: aee23dc >2014-10-08 11:20:07,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] FINISH, HSMClearTaskVDSCommand, log id: aee23dc >2014-10-08 11:20:07,358 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] FINISH, SPMClearTaskVDSCommand, log id: 55a03ca7 >2014-10-08 11:20:07,362 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] BaseAsyncTask::removeTaskFromDB: Removed task ff1f314b-6b8d-4d90-a279-af4e775ba93d from DataBase >2014-10-08 11:20:07,362 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 1818b943-d543-4798-abe4-17323eaac993 >2014-10-08 11:20:07,362 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 1818b943-d543-4798-abe4-17323eaac993), log id: 60c23c9d >2014-10-08 11:20:07,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, taskId=1818b943-d543-4798-abe4-17323eaac993), log id: 7019990b >2014-10-08 11:20:07,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] FINISH, HSMClearTaskVDSCommand, log id: 7019990b >2014-10-08 11:20:07,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] FINISH, SPMClearTaskVDSCommand, log id: 60c23c9d >2014-10-08 11:20:07,379 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] BaseAsyncTask::removeTaskFromDB: Removed task 1818b943-d543-4798-abe4-17323eaac993 from DataBase >2014-10-08 11:20:07,379 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-35) [7c5ab734] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 4180fdce-da98-4610-b731-754a843e03ad >2014-10-08 11:21:18,924 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-36) [196151bd] Setting new tasks map. The map contains now 0 tasks >2014-10-08 11:21:18,924 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-36) [196151bd] Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-08 11:29:12,478 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-2) Invalid locale found in configuration: >2014-10-08 11:29:12,478 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-2) Invalid locale found in configuration: >2014-10-08 11:35:14,850 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-10-08 11:35:14,861 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 11:53:44,400 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [33b3f586] Running command: LogoutUserCommand internal: false. >2014-10-08 11:53:44,408 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [33b3f586] Correlation ID: 33b3f586, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 11:53:44,477 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-9) Invalid locale found in configuration: >2014-10-08 11:53:44,477 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-9) Invalid locale found in configuration: >2014-10-08 11:55:06,674 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-3) Invalid locale found in configuration: >2014-10-08 11:55:06,674 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-3) Invalid locale found in configuration: >2014-10-08 11:55:25,929 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-11) Invalid locale found in configuration: >2014-10-08 11:55:25,929 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-11) Invalid locale found in configuration: >2014-10-08 11:55:31,291 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-9) Running command: LoginAdminUserCommand internal: false. >2014-10-08 11:55:31,308 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 11:56:40,640 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp-/127.0.0.1:8702-4) [76527aa5] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_POOL with role type ADMIN >2014-10-08 11:56:40,665 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [76527aa5] Correlation ID: 76527aa5, Call Stack: null, Custom Event ID: -1, Message: Data Center 34, Compatibility Version 3.4 and Quota Type DISABLED was added by admin >2014-10-08 11:56:50,512 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-10) [4ce41771] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: a1bd2d4e-edc2-4be0-a46b-5dadc973c44d Type: StoragePoolAction group CREATE_CLUSTER with role type ADMIN >2014-10-08 11:56:50,533 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [4ce41771] Correlation ID: 4ce41771, Call Stack: null, Custom Event ID: -1, Message: Cluster 34 was added by admin >2014-10-08 11:57:07,459 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginUserCommand internal: false. >2014-10-08 11:57:07,463 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 11:57:08,099 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-1) [4d486f] Running command: LogoutBySessionCommand internal: false. >2014-10-08 11:57:08,103 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-1) [4cc4c1c1] Running command: LogoutUserCommand internal: false. >2014-10-08 11:57:08,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [4cc4c1c1] Correlation ID: 4cc4c1c1, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 11:57:12,573 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-10-08 11:57:12,578 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 11:57:13,253 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-6) [21f9e376] Running command: LogoutBySessionCommand internal: false. >2014-10-08 11:57:13,258 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-6) [328d859f] Running command: LogoutUserCommand internal: false. >2014-10-08 11:57:13,262 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [328d859f] Correlation ID: 328d859f, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 11:57:29,524 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginUserCommand internal: false. >2014-10-08 11:57:29,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 11:57:29,559 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-4) [106f9bb2] Running command: LogoutBySessionCommand internal: false. >2014-10-08 11:57:29,562 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-4) [7dc80c2f] Running command: LogoutUserCommand internal: false. >2014-10-08 11:57:29,565 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [7dc80c2f] Correlation ID: 7dc80c2f, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 11:57:34,733 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginUserCommand internal: false. >2014-10-08 11:57:34,738 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 11:57:34,854 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-2) [1ff9150f] Running command: LogoutBySessionCommand internal: false. >2014-10-08 11:57:34,856 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [68a4270d] Running command: LogoutUserCommand internal: false. >2014-10-08 11:57:34,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [68a4270d] Correlation ID: 68a4270d, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 11:58:21,225 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-7) [5f07cda2] Running command: AddVdsCommand internal: false. Entities affected : ID: 51ae64c0-ecf0-4ceb-8709-06815d8dfaca Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-08 11:58:21,241 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-7) [23a44603] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDS >2014-10-08 11:58:21,249 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-7) [23a44603] Lock freed to object EngineLock [exclusiveLocks= key: a1bd2d4e-edc2-4be0-a46b-5dadc973c44d value: REGISTER_VDS >, sharedLocks= ] >2014-10-08 11:58:21,251 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [23a44603] START, RemoveVdsVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2), log id: 50fcb567 >2014-10-08 11:58:21,251 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [23a44603] FINISH, RemoveVdsVDSCommand, log id: 50fcb567 >2014-10-08 11:58:21,253 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [23a44603] START, AddVdsVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2), log id: 5eeea623 >2014-10-08 11:58:21,253 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [23a44603] AddVds - entered , starting logic to add VDS 4d81274e-8cd8-44f9-a1f3-b09967477dd2 >2014-10-08 11:58:21,255 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [23a44603] AddVds - VDS 4d81274e-8cd8-44f9-a1f3-b09967477dd2 was added, will try to add it to the resource manager >2014-10-08 11:58:21,255 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-7) [23a44603] Entered VdsManager constructor >2014-10-08 11:58:21,272 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-7) [23a44603] Initialize vdsBroker (10.34.62.205,54,321) >2014-10-08 11:58:21,280 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-7) [23a44603] VDS 4d81274e-8cd8-44f9-a1f3-b09967477dd2 was added to the Resource Manager >2014-10-08 11:58:21,281 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [23a44603] FINISH, AddVdsVDSCommand, log id: 5eeea623 >2014-10-08 11:58:21,286 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [23a44603] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-13. >2014-10-08 11:58:21,297 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [23a44603] Correlation ID: 5f07cda2, Job ID: e9471f4e-03f2-4bb1-b349-ad726f281fa7, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13 was added by admin. >2014-10-08 11:58:21,302 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Lock Acquired to object EngineLock [exclusiveLocks= key: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 value: VDS >, sharedLocks= ] >2014-10-08 11:58:21,308 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDS >2014-10-08 11:58:21,308 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Before Installation host 4d81274e-8cd8-44f9-a1f3-b09967477dd2, dell-r210ii-13 >2014-10-08 11:58:21,312 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2566740 >2014-10-08 11:58:21,315 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] FINISH, SetVdsStatusVDSCommand, log id: 2566740 >2014-10-08 11:58:21,400 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Installation 10.34.62.205: Connected to host 10.34.62.205 with SSH key fingerprint: 97:ee:9e:f5:88:0a:5b:09:bc:13:3d:c0:ba:54:4f:dc >2014-10-08 11:58:21,409 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Connected to host 10.34.62.205 with SSH key fingerprint: 97:ee:9e:f5:88:0a:5b:09:bc:13:3d:c0:ba:54:4f:dc. >2014-10-08 11:58:21,479 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Installation of 10.34.62.205. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-08 11:58:21,583 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-7-thread-13) SSH execute root@10.34.62.205 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-08 11:58:22,114 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Initializing >2014-10-08 11:58:22,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Initializing. >2014-10-08 11:58:22,132 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment setup >2014-10-08 11:58:22,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Environment setup. >2014-10-08 11:58:22,142 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment packages setup >2014-10-08 11:58:22,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Environment packages setup. >2014-10-08 11:58:22,148 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Programs detection >2014-10-08 11:58:22,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Programs detection. >2014-10-08 11:58:22,155 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment customization >2014-10-08 11:58:22,160 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Environment customization. >2014-10-08 11:58:22,167 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Kdump unsupported >2014-10-08 11:58:22,172 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Kdump unsupported. >2014-10-08 11:58:22,177 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Host is hypervisor >2014-10-08 11:58:22,183 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Host is hypervisor. >2014-10-08 11:58:22,192 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Logs at host located at: '/tmp/ovirt-host-deploy-20141008095824-wyp20e.log' >2014-10-08 11:58:22,198 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Logs at host located at: '/tmp/ovirt-host-deploy-20141008095824-wyp20e.log'. >2014-10-08 11:58:22,269 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.62.205 reports unique id 4C4C4544-0034-5310-8052-B3C04F4A354A >2014-10-08 11:58:22,299 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0034-5310-8052-B3C04F4A354A to Host 10.34.62.205 >2014-10-08 11:58:22,356 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Disabling Kdump integration >2014-10-08 11:58:22,362 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Disabling Kdump integration. >2014-10-08 11:58:22,376 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Setup validation >2014-10-08 11:58:22,381 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Setup validation. >2014-10-08 11:58:22,429 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Hardware supports virtualization >2014-10-08 11:58:22,435 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Hardware supports virtualization. >2014-10-08 11:58:22,435 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Transaction setup >2014-10-08 11:58:22,446 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Transaction setup. >2014-10-08 11:58:22,446 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Misc configuration >2014-10-08 11:58:22,458 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Misc configuration. >2014-10-08 11:58:22,458 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Package installation >2014-10-08 11:58:22,465 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Package installation. >2014-10-08 11:58:24,283 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-51) Initializing Host: dell-r210ii-13 >2014-10-08 11:58:29,993 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Misc configuration >2014-10-08 11:58:30,003 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Misc configuration. >2014-10-08 11:58:30,196 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Enrolling certificate >2014-10-08 11:58:30,202 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Enrolling certificate. >2014-10-08 11:58:31,457 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Transaction commit >2014-10-08 11:58:31,463 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Transaction commit. >2014-10-08 11:58:32,291 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Closing up >2014-10-08 11:58:32,297 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stage: Closing up. >2014-10-08 11:58:35,198 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stopping libvirtd >2014-10-08 11:58:35,204 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Stopping libvirtd. >2014-10-08 11:58:35,834 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Starting vdsm >2014-10-08 11:58:35,840 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Starting vdsm. >2014-10-08 11:58:45,199 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141008115845-10.34.62.205-7cd6ae78.log' >2014-10-08 11:58:45,205 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7cd6ae78, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141008115845-10.34.62.205-7cd6ae78.log'. >2014-10-08 11:58:45,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-08 11:58:45,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Command PollVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-08 11:58:46,067 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Engine managed to communicate with VDSM agent on host dell-r210ii-13 >2014-10-08 11:58:46,213 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] The management network rhevm is already configured on host dell-r210ii-13 >2014-10-08 11:58:46,215 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 366d0708 >2014-10-08 11:58:46,220 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] FINISH, SetVdsStatusVDSCommand, log id: 366d0708 >2014-10-08 11:58:46,221 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] After Installation host dell-r210ii-13, oVirtNode >2014-10-08 11:58:46,232 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Correlation ID: 7cd6ae78, Job ID: e9471f4e-03f2-4bb1-b349-ad726f281fa7, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13 installed >2014-10-08 11:58:46,237 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-13) [7cd6ae78] Lock freed to object EngineLock [exclusiveLocks= key: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 value: VDS >, sharedLocks= ] >2014-10-08 11:58:48,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) [79fdfbaa] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2, vds=Host[dell-r210ii-13,4d81274e-8cd8-44f9-a1f3-b09967477dd2]), log id: 5211216 >2014-10-08 11:58:48,439 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) [79fdfbaa] FINISH, GetHardwareInfoVDSCommand, log id: 5211216 >2014-10-08 11:58:48,445 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [79fdfbaa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13 does not enforce SELinux. >2014-10-08 11:58:48,446 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-23) [79fdfbaa] Host dell-r210ii-13 does not report SELinux enforcement information. >2014-10-08 11:58:48,475 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [3adcbb86] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDS >2014-10-08 11:58:48,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) [3adcbb86] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2, vds=Host[dell-r210ii-13,4d81274e-8cd8-44f9-a1f3-b09967477dd2]), log id: 2ca48582 >2014-10-08 11:58:48,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) [3adcbb86] FINISH, GetHardwareInfoVDSCommand, log id: 2ca48582 >2014-10-08 11:58:48,581 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-23) [3adcbb86] Host dell-r210ii-13 does not report SELinux enforcement information. >2014-10-08 11:58:48,648 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-23) [587da2c5] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: a1bd2d4e-edc2-4be0-a46b-5dadc973c44d Type: StoragePool >2014-10-08 11:58:48,659 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [587da2c5] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2), log id: 29217626 >2014-10-08 11:58:48,755 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [587da2c5] FINISH, SetMOMPolicyParametersVDSCommand, log id: 29217626 >2014-10-08 11:58:48,761 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [587da2c5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-13 was set to Up. >2014-10-08 11:58:48,765 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [587da2c5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-13. >2014-10-08 11:58:48,775 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [434d1b34] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDS >2014-10-08 11:58:48,780 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-23) [4ad5eafc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDS >2014-10-08 12:02:28,319 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-28) [79f90d0e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 12:02:28,323 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-28) [79f90d0e] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13, HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: efb89f3 >2014-10-08 12:02:28,328 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-28) [79f90d0e] FINISH, SetVdsStatusVDSCommand, log id: efb89f3 >2014-10-08 12:02:28,411 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-28) [79f90d0e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDS >2014-10-08 12:02:28,418 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-28) [79f90d0e] Correlation ID: 79f90d0e, Job ID: 39535a39-bfbe-40fe-ad55-1c7d161462ec, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13 was switched to Maintenance mode by admin. >2014-10-08 12:02:30,223 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [5f7551ce] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 4d81274e-8cd8-44f9-a1f3-b09967477dd2 : dell-r210ii-13 >2014-10-08 12:02:35,092 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-8) [44f66b95] Lock Acquired to object EngineLock [exclusiveLocks= key: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 value: VDS >, sharedLocks= ] >2014-10-08 12:02:35,103 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-7) [44f66b95] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 Type: VDSAction group DELETE_HOST with role type ADMIN >2014-10-08 12:02:35,145 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-7) [44f66b95] START, RemoveVdsVDSCommand( HostId = 4d81274e-8cd8-44f9-a1f3-b09967477dd2), log id: 439f7e98 >2014-10-08 12:02:35,145 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-7-thread-7) [44f66b95] vdsManager::disposing >2014-10-08 12:02:35,146 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-7) [44f66b95] FINISH, RemoveVdsVDSCommand, log id: 439f7e98 >2014-10-08 12:02:35,151 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-7) [44f66b95] Correlation ID: 44f66b95, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13 was removed by admin. >2014-10-08 12:02:35,151 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-7) [44f66b95] Lock freed to object EngineLock [exclusiveLocks= key: 4d81274e-8cd8-44f9-a1f3-b09967477dd2 value: VDS >, sharedLocks= ] >2014-10-08 12:02:41,727 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-7) Invalid locale found in configuration: >2014-10-08 12:02:41,727 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-7) Invalid locale found in configuration: >2014-10-08 12:06:52,599 INFO [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-4) Registration request: source='10.34.62.205', secured='true', address='10.34.62.205', vdsPort=54321, name='dell-r210ii-13.rhev.lab.eng.brq.redhat.com', uniqueId='4C4C4544-0034-5310-8052-B3C04F4A354A' >2014-10-08 12:06:52,637 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-4) Running Command: RegisterVds >2014-10-08 12:06:52,863 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-4) [4f3f04bd] Running command: AddVdsCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-08 12:06:52,878 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDS >2014-10-08 12:06:52,884 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-0000000001f1 value: REGISTER_VDS >, sharedLocks= ] >2014-10-08 12:06:52,887 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] START, RemoveVdsVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553), log id: 659b7b9c >2014-10-08 12:06:52,887 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] FINISH, RemoveVdsVDSCommand, log id: 659b7b9c >2014-10-08 12:06:52,888 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] START, AddVdsVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553), log id: 6133c31f >2014-10-08 12:06:52,889 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] AddVds - entered , starting logic to add VDS be4deeea-5faf-449a-91e6-4735a3005553 >2014-10-08 12:06:52,890 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] AddVds - VDS be4deeea-5faf-449a-91e6-4735a3005553 was added, will try to add it to the resource manager >2014-10-08 12:06:52,890 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-4) [5d7a880] Entered VdsManager constructor >2014-10-08 12:06:52,902 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-4) [5d7a880] Initialize vdsBroker (10.34.62.205,54,321) >2014-10-08 12:06:52,902 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-4) [5d7a880] VDS be4deeea-5faf-449a-91e6-4735a3005553 was added to the Resource Manager >2014-10-08 12:06:52,902 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-4) [5d7a880] FINISH, AddVdsVDSCommand, log id: 6133c31f >2014-10-08 12:06:52,913 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [5d7a880] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. >2014-10-08 12:06:52,921 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [5d7a880] Correlation ID: 4f3f04bd, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com was added by <UNKNOWN>. >2014-10-08 12:06:52,921 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-4) [5d7a880] RegisterVdsQuery::Register - Registered a new VDS pending approval - Name: dell-r210ii-13.rhev.lab.eng.brq.redhat.com, Hostname: 10.34.62.205, UniqueID: 4C4C4544-0034-5310-8052-B3C04F4A354A >2014-10-08 12:06:52,924 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [5d7a880] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com registered. >2014-10-08 12:07:22,990 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginUserCommand internal: false. >2014-10-08 12:07:23,004 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 12:07:23,161 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-8) [c247dbe] Running command: LogoutBySessionCommand internal: false. >2014-10-08 12:07:23,164 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-8) [65d1b92e] Running command: LogoutUserCommand internal: false. >2014-10-08 12:07:23,168 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [65d1b92e] Correlation ID: 65d1b92e, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 12:08:05,472 ERROR [org.ovirt.engine.core.aaa.filters.BasicAuthenticationFilter] (ajp-/127.0.0.1:8702-2) Failure in authentication to profile org.ovirt.engine.core.aaa.AuthenticationProfile@3a0ff93e. Invocation Result code is 0. Authn result code is 12 >2014-10-08 12:08:27,835 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-10-08 12:08:27,838 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 12:08:29,501 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-6) [36814c1e] Running command: LogoutBySessionCommand internal: false. >2014-10-08 12:08:29,502 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-6) [68774ac1] Running command: LogoutUserCommand internal: false. >2014-10-08 12:08:29,507 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [68774ac1] Correlation ID: 68774ac1, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 12:09:05,507 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-9) Running command: LoginUserCommand internal: false. >2014-10-08 12:09:05,511 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 12:09:05,554 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] Lock Acquired to object EngineLock [exclusiveLocks= key: be4deeea-5faf-449a-91e6-4735a3005553 value: VDS >, sharedLocks= ] >2014-10-08 12:09:05,560 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 51ae64c0-ecf0-4ceb-8709-06815d8dfaca Type: VdsGroupsAction group EDIT_HOST_CONFIGURATION with role type ADMIN >2014-10-08 12:09:05,589 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] START, RemoveVdsVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553), log id: 19cf631c >2014-10-08 12:09:05,589 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [52bc0d05] vdsManager::disposing >2014-10-08 12:09:05,591 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] FINISH, RemoveVdsVDSCommand, log id: 19cf631c >2014-10-08 12:09:05,592 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] START, AddVdsVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553), log id: 6b4e0d36 >2014-10-08 12:09:05,592 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] AddVds - entered , starting logic to add VDS be4deeea-5faf-449a-91e6-4735a3005553 >2014-10-08 12:09:05,593 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] AddVds - VDS be4deeea-5faf-449a-91e6-4735a3005553 was added, will try to add it to the resource manager >2014-10-08 12:09:05,593 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [52bc0d05] Entered VdsManager constructor >2014-10-08 12:09:05,605 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [52bc0d05] Initialize vdsBroker (10.34.62.205,54,321) >2014-10-08 12:09:05,605 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [52bc0d05] VDS be4deeea-5faf-449a-91e6-4735a3005553 was added to the Resource Manager >2014-10-08 12:09:05,605 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [52bc0d05] FINISH, AddVdsVDSCommand, log id: 6b4e0d36 >2014-10-08 12:09:05,611 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [2ffaba75] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDS >2014-10-08 12:09:05,616 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [2ffaba75] Lock freed to object EngineLock [exclusiveLocks= key: a1bd2d4e-edc2-4be0-a46b-5dadc973c44d value: REGISTER_VDS >, sharedLocks= ] >2014-10-08 12:09:05,650 INFO [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-7-thread-24) [61a20150] Running command: PersistentSetupNetworksCommand internal: true. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDS >2014-10-08 12:09:05,651 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [2ffaba75] Correlation ID: 52bc0d05, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-10-08 12:09:05,651 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-9) [2ffaba75] Lock freed to object EngineLock [exclusiveLocks= key: be4deeea-5faf-449a-91e6-4735a3005553 value: VDS >, sharedLocks= ] >2014-10-08 12:09:05,657 WARN [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-7-thread-24) [61a20150] CanDoAction of action SetupNetworks failed. Reasons:VAR__ACTION__SETUP,VAR__TYPE__NETWORKS,VAR__HOST_STATUS__UP_MAINTENANCE_OR_NON_OPERATIONAL,ACTION_TYPE_FAILED_VDS_STATUS_ILLEGAL >2014-10-08 12:09:05,689 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-08 12:09:05,689 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-08 12:09:05,689 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-9) [4f68f4fd] Running command: UpdateVdsCommand internal: false. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN >2014-10-08 12:09:05,700 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-08 12:09:05,700 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-08 12:09:05,706 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [4f68f4fd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. >2014-10-08 12:09:05,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [4f68f4fd] Correlation ID: 4f68f4fd, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-10-08 12:09:05,749 INFO [org.ovirt.engine.core.bll.ApproveVdsCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Running command: ApproveVdsCommand internal: false. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDSAction group CREATE_HOST with role type ADMIN >2014-10-08 12:09:05,749 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Before Installation host be4deeea-5faf-449a-91e6-4735a3005553, dell-r210ii-13.rhev.lab.eng.brq.redhat.com >2014-10-08 12:09:05,762 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: e772e60 >2014-10-08 12:09:05,766 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] FINISH, SetVdsStatusVDSCommand, log id: e772e60 >2014-10-08 12:09:05,853 INFO [org.ovirt.engine.core.bll.InstallerMessages] (ajp-/127.0.0.1:8702-9) [755e70e3] Installation 10.34.62.205: Connected to host 10.34.62.205 with SSH key fingerprint: 97:ee:9e:f5:88:0a:5b:09:bc:13:3d:c0:ba:54:4f:dc >2014-10-08 12:09:05,859 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [755e70e3] Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.62.205 with SSH key fingerprint: 97:ee:9e:f5:88:0a:5b:09:bc:13:3d:c0:ba:54:4f:dc. >2014-10-08 12:09:05,930 INFO [org.ovirt.engine.core.bll.VdsDeploy] (ajp-/127.0.0.1:8702-9) [755e70e3] Installation of 10.34.62.205. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-08 12:09:05,939 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (ajp-/127.0.0.1:8702-9) SSH execute root@10.34.62.205 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-08 12:09:06,495 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Initializing >2014-10-08 12:09:06,502 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Initializing. >2014-10-08 12:09:06,513 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment setup >2014-10-08 12:09:06,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Environment setup. >2014-10-08 12:09:06,520 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment packages setup >2014-10-08 12:09:06,525 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Environment packages setup. >2014-10-08 12:09:06,525 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Programs detection >2014-10-08 12:09:06,531 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Programs detection. >2014-10-08 12:09:06,531 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment customization >2014-10-08 12:09:06,537 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Environment customization. >2014-10-08 12:09:06,546 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Kdump unsupported >2014-10-08 12:09:06,551 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Kdump unsupported. >2014-10-08 12:09:06,556 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Host is hypervisor >2014-10-08 12:09:06,562 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Host is hypervisor. >2014-10-08 12:09:06,575 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Logs at host located at: '/tmp/ovirt-host-deploy-20141008100908-3p21ko.log' >2014-10-08 12:09:06,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20141008100908-3p21ko.log'. >2014-10-08 12:09:06,614 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.62.205 reports unique id 4C4C4544-0034-5310-8052-B3C04F4A354A >2014-10-08 12:09:06,617 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0034-5310-8052-B3C04F4A354A to Host 10.34.62.205 >2014-10-08 12:09:06,662 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Disabling Kdump integration >2014-10-08 12:09:06,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Disabling Kdump integration. >2014-10-08 12:09:06,680 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Setup validation >2014-10-08 12:09:06,685 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Setup validation. >2014-10-08 12:09:06,735 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Hardware supports virtualization >2014-10-08 12:09:06,740 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Hardware supports virtualization. >2014-10-08 12:09:06,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Transaction setup >2014-10-08 12:09:06,745 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Transaction setup. >2014-10-08 12:09:06,745 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Misc configuration >2014-10-08 12:09:06,750 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-10-08 12:09:06,750 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Package installation >2014-10-08 12:09:06,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Package installation. >2014-10-08 12:09:08,607 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-83) Initializing Host: dell-r210ii-13.rhev.lab.eng.brq.redhat.com >2014-10-08 12:09:17,405 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Misc configuration >2014-10-08 12:09:17,413 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-10-08 12:09:17,545 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Enrolling certificate >2014-10-08 12:09:17,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Enrolling certificate. >2014-10-08 12:09:18,680 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Transaction commit >2014-10-08 12:09:18,687 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Transaction commit. >2014-10-08 12:09:19,221 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Closing up >2014-10-08 12:09:19,227 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stage: Closing up. >2014-10-08 12:09:21,776 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stopping libvirtd >2014-10-08 12:09:21,783 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Stopping libvirtd. >2014-10-08 12:09:22,070 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Starting vdsm >2014-10-08 12:09:22,082 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Starting vdsm. >2014-10-08 12:09:31,480 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141008120931-10.34.62.205-755e70e3.log' >2014-10-08 12:09:31,488 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 755e70e3, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141008120931-10.34.62.205-755e70e3.log'. >2014-10-08 12:09:31,650 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:09:33,655 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:12:33,736 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:12:33,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:12:34,238 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:12:36,242 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:15:36,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:15:36,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:15:36,799 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:15:38,803 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:18:38,861 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:18:38,863 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:18:39,364 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:18:41,371 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:19:48,182 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-38) Deactivating non existing principal admin::internal >2014-10-08 12:19:49,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-10-08 12:21:41,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:21:41,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:21:41,933 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:21:43,941 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:24:44,000 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:24:44,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:24:44,502 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:24:46,505 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:27:46,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:27:46,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:27:47,062 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:27:49,068 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:30:49,124 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:30:49,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:30:49,627 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:30:49,695 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.process(SSLEngineNioHelper.java:134) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.pendingOperations(SSLClient.java:74) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:98) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:33:51,686 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:33:51,688 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:33:52,189 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:33:54,196 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:36:54,247 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:36:54,248 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:36:54,749 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:36:54,794 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.process(SSLEngineNioHelper.java:134) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.pendingOperations(SSLClient.java:74) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:98) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:39:56,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:39:56,810 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:39:57,311 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:39:57,352 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.process(SSLEngineNioHelper.java:134) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.pendingOperations(SSLClient.java:74) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:98) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:42:59,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:42:59,370 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:42:59,871 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:43:01,874 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:43:34,120 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-4) Invalid locale found in configuration: >2014-10-08 12:43:34,120 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-4) Invalid locale found in configuration: >2014-10-08 12:46:01,940 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:46:01,941 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:46:02,444 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:04,444 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:04,444 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:04,444 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-19) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:04,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:04,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:04,948 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:06,949 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:06,952 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:06,952 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-41) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:06,953 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:06,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:07,455 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:09,455 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:09,455 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:09,455 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-34) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:09,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:09,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:09,958 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:11,959 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:11,959 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:11,961 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-36) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:11,962 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:11,963 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:12,464 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:13,456 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:13,457 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:13,457 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-39) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:13,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:13,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:13,960 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:15,960 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:15,960 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:15,960 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-50) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:15,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:15,962 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:16,463 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:18,463 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:18,463 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:18,463 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-17) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:18,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:18,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:18,967 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:20,967 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:20,967 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:20,967 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-8) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:20,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:20,969 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:21,470 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:23,471 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:23,473 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:23,473 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-16) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:23,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:23,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:23,977 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:25,456 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:25,456 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:25,456 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-35) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:25,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:25,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:25,960 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:27,960 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:27,960 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:27,960 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-49) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:27,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:27,963 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:28,464 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:28,961 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:28,962 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:28,963 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-28) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:28,965 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:28,966 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:29,467 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:31,468 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:31,468 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:31,468 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-48) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:31,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:31,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:31,972 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:32,468 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:32,469 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:32,469 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-20) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:32,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:32,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:32,973 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:34,973 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:34,973 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:34,973 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-43) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:34,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:34,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:35,477 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:35,974 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:35,975 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:35,975 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-44) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:35,977 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:35,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:36,479 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:38,479 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:38,479 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:38,479 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-31) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:38,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:38,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:38,982 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:39,480 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:39,481 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:39,481 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-38) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:39,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:39,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:39,985 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:41,986 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:41,986 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:41,986 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-14) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:41,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:41,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:42,489 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:42,986 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:42,987 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:42,987 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-46) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:42,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:42,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:43,491 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:45,491 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:45,491 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:45,491 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-6) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:45,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:45,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:45,994 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:47,994 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:47,994 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:47,994 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-11) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:47,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:47,996 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:48,497 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:48,989 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:48,989 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:48,990 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-24) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:48,991 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:48,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:49,493 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:51,494 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:51,494 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:51,494 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-22) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:51,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:51,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:52,003 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:54,009 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:54,009 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:54,010 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-37) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:54,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:54,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:54,513 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:54,990 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:54,991 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:54,991 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-25) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:54,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:54,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:55,495 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:57,495 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:57,495 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:57,495 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-3) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:57,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:57,497 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:46:57,997 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:46:59,998 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:59,998 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:59,998 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-32) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:46:59,999 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:47:00,000 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Command PollVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 12:47:00,502 ERROR [org.ovirt.engine.core.bll.ApproveVdsCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] Host installation failed for host be4deeea-5faf-449a-91e6-4735a3005553, dell-r210ii-13.rhev.lab.eng.brq.redhat.com.: org.ovirt.engine.core.bll.VdsCommand$VdsInstallException: Network error during communication with the host > at org.ovirt.engine.core.bll.InstallVdsInternalCommand.configureManagementNetwork(InstallVdsInternalCommand.java:190) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsInternalCommand.installHost(InstallVdsInternalCommand.java:164) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsInternalCommand.executeCommand(InstallVdsInternalCommand.java:78) [bll.jar:] > at org.ovirt.engine.core.bll.ApproveVdsCommand.executeCommand(ApproveVdsCommand.java:58) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1168) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1307) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1932) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1331) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:344) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:430) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:411) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:369) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor322.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:74) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:84) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:97) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:93) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view6.runAction(Unknown Source) [common.jar:] > at org.ovirt.engine.api.restapi.resource.BackendResource.doAction(BackendResource.java:264) > at org.ovirt.engine.api.restapi.resource.AbstractBackendActionableResource.doAction(AbstractBackendActionableResource.java:75) > at org.ovirt.engine.api.restapi.resource.AbstractBackendActionableResource.doAction(AbstractBackendActionableResource.java:120) > at org.ovirt.engine.api.restapi.resource.BackendHostResource.approve(BackendHostResource.java:160) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_65] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:167) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:269) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:227) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.ResourceLocator.invokeOnTargetObject(ResourceLocator.java:159) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.ResourceLocator.invoke(ResourceLocator.java:92) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:542) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:524) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:126) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55) [resteasy-jaxrs.jar:] > at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50) [resteasy-jaxrs.jar:] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:69) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:39) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.LoginFilter.doFilter(LoginFilter.java:73) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.NegotiationFilter.doFilter(NegotiationFilter.java:112) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:75) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:63) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:31) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.api.common.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:110) > at org.ovirt.engine.api.common.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:101) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:231) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:512) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:490) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:926) > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-10-08 12:47:00,512 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, status=NonResponsive, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7b0ef449 >2014-10-08 12:47:00,516 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (ajp-/127.0.0.1:8702-9) [755e70e3] FINISH, SetVdsStatusVDSCommand, log id: 7b0ef449 >2014-10-08 12:47:00,556 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [755e70e3] Correlation ID: 755e70e3, Job ID: 6fbbaa16-6564-48ea-a7db-d718eacb766a, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com installation failed. Network error during communication with the host. >2014-10-08 12:47:00,566 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-9) Operation Failed: [] >2014-10-08 12:47:01,641 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:03,641 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:03,641 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:03,641 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-32) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:03,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.rmi.ConnectException: Connection timeout >2014-10-08 12:47:03,644 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-32) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:03,649 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:03,649 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-32) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.rmi.ConnectException: Connection timeout > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:06,657 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:06,994 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:06,995 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:06,995 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-28) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:06,998 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-10-08 12:47:06,998 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-28) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:07,002 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.NoRouteToHostException: No route to host > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:10,042 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:12,042 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:12,042 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:12,042 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-69) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:12,044 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.rmi.ConnectException: Connection timeout >2014-10-08 12:47:12,044 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-69) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:12,068 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.rmi.ConnectException: Connection timeout > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:15,102 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:16,044 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:16,044 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:16,045 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-49) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:16,046 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [9830ee8] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-10-08 12:47:16,046 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-49) [9830ee8] Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:16,052 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) [9830ee8] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.NoRouteToHostException: No route to host > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:19,058 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:21,058 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:21,058 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:21,058 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-30) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:21,060 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [7356de8d] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.rmi.ConnectException: Connection timeout >2014-10-08 12:47:21,060 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-30) [7356de8d] Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:21,065 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) [7356de8d] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.rmi.ConnectException: Connection timeout > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:24,073 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:25,060 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:25,060 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:25,061 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-58) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:25,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [6f213e2c] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-10-08 12:47:25,063 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-58) [6f213e2c] Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:25,069 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-58) [6f213e2c] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.NoRouteToHostException: No route to host > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:28,077 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:30,077 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:30,077 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:30,080 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-63) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:30,081 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.rmi.ConnectException: Connection timeout >2014-10-08 12:47:30,081 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-63) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:30,091 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.rmi.ConnectException: Connection timeout > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:33,098 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:34,078 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:34,078 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:34,079 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-79) Exception during connection: java.util.concurrent.ExecutionException: java.net.NoRouteToHostException: No route to host > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:34,080 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-10-08 12:47:34,080 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-79) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:34,088 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-79) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.NoRouteToHostException: No route to host > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:37,095 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:39,096 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:39,096 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:39,096 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-90) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:39,098 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.rmi.ConnectException: Connection timeout >2014-10-08 12:47:39,098 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-90) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:39,103 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.rmi.ConnectException: Connection timeout > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:42,116 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:42,116 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:42,117 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:42,117 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-80) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:42,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 12:47:42,121 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-80) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:42,127 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-80) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:45,136 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:45,137 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:45,137 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:45,138 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-54) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:45,140 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 12:47:45,140 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:45,147 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:48,155 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:50,155 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:50,155 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:50,155 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-9) Exception during connection: java.util.concurrent.ExecutionException: java.rmi.ConnectException: Connection timeout > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:50,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.rmi.ConnectException: Connection timeout >2014-10-08 12:47:50,157 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-9) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:50,163 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-9) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.rmi.ConnectException: Connection timeout > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.rmi.ConnectException: Connection timeout > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:113) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:53,168 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:54,169 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:54,170 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:54,170 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-50) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:54,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 12:47:54,173 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-50) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:54,181 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:57,191 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:47:57,192 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:57,192 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:57,192 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-14) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:47:57,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 12:47:57,196 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:47:57,208 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:00,223 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:48:00,224 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:00,225 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:00,225 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-22) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:00,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [7edfc2cc] Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 12:48:00,229 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-22) [7edfc2cc] Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:48:00,236 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-22) [7edfc2cc] Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:03,245 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:48:03,246 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:03,246 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:03,246 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (DefaultQuartzScheduler_Worker-71) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:184) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:03,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-10-08 12:48:03,249 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-71) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:48:03,255 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-71) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:48:06,263 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.62.205 >2014-10-08 12:48:08,266 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages: java.io.IOException: Broken pipe > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.7.0_65] > at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:487) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLEngineNioHelper.write(SSLEngineNioHelper.java:95) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.write(SSLClient.java:90) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.processOutgoing(ReactorClient.java:199) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.process(ReactorClient.java:170) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.SSLClient.process(SSLClient.java:115) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.processChannels(Reactor.java:86) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:62) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 12:50:21,500 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-37) [29af8f9d] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 12:50:21,579 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-37) [29af8f9d] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDS >2014-10-08 12:50:21,584 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-37) [29af8f9d] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, status=Maintenance, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1012f14b >2014-10-08 12:50:42,055 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-48) [27ae646e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 12:50:42,143 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-48) [27ae646e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDS >2014-10-08 12:50:42,147 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-48) [27ae646e] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, status=Maintenance, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1d8c9351 >2014-10-08 12:51:08,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@1890f9e2 >2014-10-08 12:51:08,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com >2014-10-08 12:51:08,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-13.rhev.lab.eng.brq.redhat.com, HostId = be4deeea-5faf-449a-91e6-4735a3005553, vds=Host[dell-r210ii-13.rhev.lab.eng.brq.redhat.com,be4deeea-5faf-449a-91e6-4735a3005553]) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 12:51:08,537 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-12) Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:51:08,548 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. >2014-10-08 12:51:08,551 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:183) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:16) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-10-08 12:51:08,559 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-48) [27ae646e] FINISH, SetVdsStatusVDSCommand, log id: 1d8c9351 >2014-10-08 12:51:08,562 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-37) [29af8f9d] FINISH, SetVdsStatusVDSCommand, log id: 1012f14b >2014-10-08 12:51:08,563 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-48) [27ae646e] Correlation ID: 27ae646e, Job ID: 66781f21-81b8-46a2-87ee-f2880fe7de3c, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-10-08 12:51:08,571 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-37) [29af8f9d] Correlation ID: 29af8f9d, Job ID: bc1704d6-8fad-40e4-b772-1bd6a571c766, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-10-08 12:58:14,165 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-7) [64116009] Lock Acquired to object EngineLock [exclusiveLocks= key: be4deeea-5faf-449a-91e6-4735a3005553 value: VDS >, sharedLocks= ] >2014-10-08 12:58:14,173 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-6) [64116009] Running command: RemoveVdsCommand internal: false. Entities affected : ID: be4deeea-5faf-449a-91e6-4735a3005553 Type: VDSAction group DELETE_HOST with role type ADMIN >2014-10-08 12:58:14,191 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-6) [64116009] START, RemoveVdsVDSCommand( HostId = be4deeea-5faf-449a-91e6-4735a3005553), log id: 2d166de2 >2014-10-08 12:58:14,191 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-7-thread-6) [64116009] vdsManager::disposing >2014-10-08 12:58:14,192 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-6) [64116009] FINISH, RemoveVdsVDSCommand, log id: 2d166de2 >2014-10-08 12:58:14,197 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-6) [64116009] Correlation ID: 64116009, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-13.rhev.lab.eng.brq.redhat.com was removed by admin. >2014-10-08 12:58:14,197 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-6) [64116009] Lock freed to object EngineLock [exclusiveLocks= key: be4deeea-5faf-449a-91e6-4735a3005553 value: VDS >, sharedLocks= ] >2014-10-08 12:58:17,963 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-8) [336e0718] Running command: LogoutUserCommand internal: false. >2014-10-08 12:58:17,973 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [336e0718] Correlation ID: 336e0718, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-08 12:58:18,016 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-10) Invalid locale found in configuration: >2014-10-08 12:58:18,017 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-10) Invalid locale found in configuration: >2014-10-08 13:19:49,869 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VMs/Templates Ovf. >2014-10-08 13:33:38,700 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 14:19:49,904 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-10-08 14:25:47,148 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-2) Invalid locale found in configuration: >2014-10-08 14:25:47,148 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-2) Invalid locale found in configuration: >2014-10-08 14:25:55,070 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-8) Invalid locale found in configuration: >2014-10-08 14:25:55,071 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-8) Invalid locale found in configuration: >2014-10-08 14:29:01,061 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-9) Running command: LoginAdminUserCommand internal: false. >2014-10-08 14:29:01,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 14:29:01,837 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginUserCommand internal: false. >2014-10-08 14:32:56,143 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-1) [6a54cd85] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 14:32:56,311 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 14:32:56,357 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 47854b0c >2014-10-08 14:32:56,357 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] VDS dell-r210ii-04 is spm and moved from up calling resetIrs. >2014-10-08 14:32:56,374 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, vdsId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, ignoreStopFailed = false), log id: 2a81ce52 >2014-10-08 14:32:56,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] START, SpmStopVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1), log id: 3cbedbe1 >2014-10-08 14:32:56,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] SpmStopVDSCommand::Stopping SPM on vds dell-r210ii-04, pool id 00000002-0002-0002-0002-0000000001f1 >2014-10-08 14:32:56,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] FINISH, SpmStopVDSCommand, log id: 3cbedbe1 >2014-10-08 14:32:56,561 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] FINISH, ResetIrsVDSCommand, log id: 2a81ce52 >2014-10-08 14:32:56,585 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] FINISH, SetVdsStatusVDSCommand, log id: 47854b0c >2014-10-08 14:32:56,608 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: POOL >] >2014-10-08 14:32:56,617 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-8) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 7f0606fe-4272-40af-973f-ddfb3f78ab4f : dell-r210ii-04 >2014-10-08 14:32:56,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-40) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-04. >2014-10-08 14:32:56,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-40) Removing vds [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from the domain in maintenance cache >2014-10-08 14:32:56,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-40) Removing host(s) [7f0606fe-4272-40af-973f-ddfb3f78ab4f] from hosts unseen domain report cache >2014-10-08 14:32:56,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-8) START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2), log id: 5f526efd >2014-10-08 14:32:57,068 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDS >2014-10-08 14:32:57,134 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-4) [6a54cd85] Correlation ID: 6a54cd85, Job ID: 0888a10d-850d-4869-b699-7531fce1315d, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was switched to Maintenance mode by admin. >2014-10-08 14:32:59,145 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 14:32:59,192 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-16) [694bfc3a] Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : null >2014-10-08 14:32:59,193 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-16) [694bfc3a] Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : null >2014-10-08 14:32:59,223 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [694bfc3a] Correlation ID: 694bfc3a, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-10-08 14:32:59,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-16) [694bfc3a] hostFromVds::selectedVds - dell-r210ii-03, spmStatus Free, storage pool Default >2014-10-08 14:32:59,358 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-16) [694bfc3a] starting spm on vds dell-r210ii-03, storage pool Default, prevId -1, LVER -1 >2014-10-08 14:32:59,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] START, SpmStartVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4f54e94c >2014-10-08 14:32:59,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] spmStart polling started: taskId = a3438188-4175-449c-a51d-d97b13596be1 >2014-10-08 14:33:00,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] spmStart polling ended: taskId = a3438188-4175-449c-a51d-d97b13596be1 task status = finished >2014-10-08 14:33:00,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] spmStart polling ended, spm status: SPM >2014-10-08 14:33:00,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=a3438188-4175-449c-a51d-d97b13596be1), log id: 6ae59ead >2014-10-08 14:33:00,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] FINISH, HSMClearTaskVDSCommand, log id: 6ae59ead >2014-10-08 14:33:00,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-16) [694bfc3a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7c3b026a, log id: 4f54e94c >2014-10-08 14:33:00,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-16) [694bfc3a] Initialize Irs proxy from vds: 10.34.63.222 >2014-10-08 14:33:00,747 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [694bfc3a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host dell-r210ii-03 (Address: 10.34.63.222). >2014-10-08 14:33:00,758 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 14:33:00,799 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-44) [694bfc3a] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false), log id: 247637e >2014-10-08 14:33:01,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-44) [694bfc3a] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-0000000001f1 >2014-10-08 14:33:01,109 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-30) [5b2bb2a6] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 14:33:01,121 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-18) [5b655aca] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 14:33:01,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-44) [694bfc3a] START, HSMGetAllTasksInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 16b9d8a4 >2014-10-08 14:33:01,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-44) [694bfc3a] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 16b9d8a4 >2014-10-08 14:33:01,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-7-thread-44) [694bfc3a] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 247637e >2014-10-08 14:33:01,215 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-44) [694bfc3a] Discovered no tasks on Storage Pool Default >2014-10-08 14:33:01,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-18) [5b655aca] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 7bd85fdd >2014-10-08 14:33:01,361 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-30) [5b2bb2a6] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 5fafb689 >2014-10-08 14:33:01,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-18) [5b655aca] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 7bd85fdd >2014-10-08 14:33:01,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-30) [5b2bb2a6] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 5fafb689 >2014-10-08 14:33:02,364 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-10) [5cec767e] Lock Acquired to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 14:33:02,608 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-1) [5cec767e] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 7f0606fe-4272-40af-973f-ddfb3f78ab4f Type: VDSAction group DELETE_HOST with role type ADMIN >2014-10-08 14:33:02,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, DisconnectStoragePoolVDSCommand, log id: 5f526efd >2014-10-08 14:33:02,708 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-8) [3dffd789] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 14:33:03,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-8) [3dffd789] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1454e086 >2014-10-08 14:33:03,239 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-1) [5cec767e] START, RemoveVdsVDSCommand( HostId = 7f0606fe-4272-40af-973f-ddfb3f78ab4f), log id: 2411e9c9 >2014-10-08 14:33:03,423 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-8) [3dffd789] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 1454e086 >2014-10-08 14:33:03,456 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-7-thread-1) [5cec767e] vdsManager::disposing >2014-10-08 14:33:03,456 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-1) [5cec767e] FINISH, RemoveVdsVDSCommand, log id: 2411e9c9 >2014-10-08 14:33:03,487 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-1) [5cec767e] Correlation ID: 5cec767e, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was removed by admin. >2014-10-08 14:33:03,487 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-1) [5cec767e] Lock freed to object EngineLock [exclusiveLocks= key: 7f0606fe-4272-40af-973f-ddfb3f78ab4f value: VDS >, sharedLocks= ] >2014-10-08 14:46:44,197 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 14:46:55,668 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 14:48:41,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-40) Command GetAllVmStatsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 14:48:41,069 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-40) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-10-08 14:48:43,195 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-10-08 14:48:47,934 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 14:48:43,694 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:183) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand.executeVdsBrokerCommand(GetAllVmStatsVDSCommand.java:21) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:418) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.fetchRunningVms(VdsUpdateRunTimeInfo.java:1000) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:949) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:667) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-10-08 14:48:53,185 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-40) Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 14:51:53,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-77) Command SpmStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 14:51:53,570 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 14:51:53,612 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : null >2014-10-08 14:51:53,612 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : null >2014-10-08 14:51:53,785 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Correlation ID: 53cdf1eb, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting Data Center status to Non Responsive (On host dell-r210ii-03, Error: Network error during communication with the Host.). >2014-10-08 14:51:53,906 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-39) [748af0b3] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 14:51:54,019 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-49) [2f3b1c35] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 14:51:54,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-39) [748af0b3] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 251c97d >2014-10-08 14:51:54,131 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 14:51:54,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-39) [748af0b3] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 251c97d >2014-10-08 14:51:54,267 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-49) [2f3b1c35] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 786256a3 >2014-10-08 14:51:54,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-49) [2f3b1c35] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 786256a3 >2014-10-08 14:51:59,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@e113a04 >2014-10-08 14:51:59,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) HostName = dell-r210ii-03 >2014-10-08 14:51:59,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) Command GetCapabilitiesVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 14:51:59,490 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-37) Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-10-08 14:51:59,559 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-37) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-03 is not responding. It will stay in Connecting state for a grace period of 80 seconds and after that an attempt to fence the host will be issued. >2014-10-08 14:51:59,560 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-37) Failure to refresh Vds runtime info: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:183) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:16) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:657) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:504) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor74.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-10-08 14:51:59,585 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-37) Failed to refresh VDS , vds = 04f67d65-72bc-4ddc-88b7-81d0053dff0b : dell-r210ii-03, VDS Network Error, continuing. >VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues' >2014-10-08 14:52:02,632 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 14:52:02,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b]), log id: 3bb41105 >2014-10-08 14:52:02,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GetHardwareInfoVDSCommand, log id: 3bb41105 >2014-10-08 14:52:03,382 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-94) [2e5f1d8] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 14:52:03,473 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-94) [2258d2d8] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 14:52:03,557 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-94) [2c69063e] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 14:52:03,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-94) [2c69063e] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 326c9032 >2014-10-08 14:52:04,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-94) [2c69063e] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 326c9032 >2014-10-08 14:52:04,013 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-44) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain 322e3360-066e-4e98-a0e9-dd44e82f0992 status from Active to Unknown, reason : no reporting hosts >2014-10-08 14:52:04,019 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-94) [2c69063e] Host dell-r210ii-03 storage connection was succeeded >2014-10-08 14:52:04,019 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-44) Storage Pool 00000002-0002-0002-0002-0000000001f1 - Updating Storage Domain a27ef16b-ef58-4130-8d71-e5183b8556d5 status from Active to Unknown, reason : no reporting hosts >2014-10-08 14:52:04,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-34) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 3baa4635 >2014-10-08 14:52:04,532 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-6) [3a785485] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 14:52:04,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-34) FINISH, ConnectStoragePoolVDSCommand, log id: 3baa4635 >2014-10-08 14:52:04,571 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-50) [33acac2d] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a27ef16b-ef58-4130-8d71-e5183b8556d5 Type: Storage >2014-10-08 14:52:04,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-6) [3a785485] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi), log id: 3fd2e423 >2014-10-08 14:52:04,755 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-94) [2c69063e] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 79e02219 >2014-10-08 14:52:04,776 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-50) [33acac2d] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro), log id: 45ab6e72 >2014-10-08 14:52:04,881 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-94) [2c69063e] FINISH, SetMOMPolicyParametersVDSCommand, log id: 79e02219 >2014-10-08 14:52:05,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-6) [3a785485] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=322e3360-066e-4e98-a0e9-dd44e82f0992, storageDomainName=null]], log id: 3fd2e423 >2014-10-08 14:52:05,004 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-94) [2c69063e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-03 was set to Up. >2014-10-08 14:52:05,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-50) [33acac2d] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a27ef16b-ef58-4130-8d71-e5183b8556d5, storageDomainName=null]], log id: 45ab6e72 >2014-10-08 14:52:05,092 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-94) [2c69063e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-03. >2014-10-08 14:52:05,277 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-94) [60a6dc9e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 04f67d65-72bc-4ddc-88b7-81d0053dff0b Type: VDS >2014-10-08 15:19:48,260 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-69) Deactivating non existing principal admin::internal >2014-10-08 15:19:50,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) [1b7756cc] Attempting to update VMs/Templates Ovf. >2014-10-08 15:27:49,178 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-9) [29bd9a80] Lock Acquired to object EngineLock [exclusiveLocks= key: sles11 value: VM_NAME >, sharedLocks= ] >2014-10-08 15:27:49,300 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-9) [29bd9a80] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-10-08 15:27:50,661 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [29bd9a80] Correlation ID: 29bd9a80, Job ID: 6229121b-dca1-4d06-962b-ef26491b73f4, Call Stack: null, Custom Event ID: -1, Message: VM sles11 was created by admin. >2014-10-08 15:27:50,686 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-9) [29bd9a80] Lock freed to object EngineLock [exclusiveLocks= key: sles11 value: VM_NAME >, sharedLocks= ] >2014-10-08 15:27:53,929 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-12) [45e6c4e6] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: 0000000e-000e-000e-000e-0000000001ae Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-10-08 15:27:54,384 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-12) [1a8b84d3] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VM >2014-10-08 15:27:54,658 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [1a8b84d3] Correlation ID: 1a8b84d3, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM sles11. (User: admin) >2014-10-08 15:27:54,668 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [1a8b84d3] Correlation ID: 45e6c4e6, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM sles11. (User: admin) >2014-10-08 15:27:54,985 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-2) [157c3284] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CREATE_VM with role type USER >2014-10-08 15:28:03,671 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) [63a22b8f] Lock Acquired to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM_DISK_BOOT >, sharedLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >] >2014-10-08 15:28:03,809 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) [63a22b8f] Running command: AddDiskCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group CREATE_DISK with role type USER >2014-10-08 15:28:04,448 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-1) [6770970f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 15:28:04,514 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-1) [6770970f] Lock freed to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM_DISK_BOOT >, sharedLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >] >2014-10-08 15:28:04,514 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [6770970f] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = e0bcb03f-8b25-4841-b39e-8575d112ee55, imageSizeInBytes = 21474836480, volumeFormat = COW, newImageId = 91743eb0-5857-4155-9bb3-2e3cc991d15f, newImageDescription = ), log id: 7432dec9 >2014-10-08 15:28:04,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [6770970f] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-08 15:28:04,591 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [6770970f] FINISH, CreateImageVDSCommand, return: 91743eb0-5857-4155-9bb3-2e3cc991d15f, log id: 7432dec9 >2014-10-08 15:28:04,598 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp-/127.0.0.1:8702-1) [6770970f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 34088778-0650-4aa5-8915-1dce3e00291d >2014-10-08 15:28:04,598 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-1) [6770970f] CommandMultiAsyncTasks::AttachTask: Attaching task bac91de3-cbc3-4e58-9bc9-b3904951f064 to command 34088778-0650-4aa5-8915-1dce3e00291d. >2014-10-08 15:28:04,705 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp-/127.0.0.1:8702-1) [6770970f] Adding task bac91de3-cbc3-4e58-9bc9-b3904951f064 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 15:28:04,888 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [6770970f] Correlation ID: 63a22b8f, Job ID: 7d21bfad-3625-4832-99cf-905fb59f7cd0, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of sles11_Disk1 was initiated on VM sles11 by admin. >2014-10-08 15:28:04,888 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp-/127.0.0.1:8702-1) [6770970f] BaseAsyncTask::startPollingTask: Starting to poll task bac91de3-cbc3-4e58-9bc9-b3904951f064. >2014-10-08 15:28:13,042 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-100) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-10-08 15:28:13,070 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-100) SPMAsyncTask::PollTask: Polling task bac91de3-cbc3-4e58-9bc9-b3904951f064 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 15:28:13,115 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-100) BaseAsyncTask::onTaskEndSuccess: Task bac91de3-cbc3-4e58-9bc9-b3904951f064 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 15:28:13,115 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-100) CommandAsyncTask::endActionIfNecessary: All tasks of command 34088778-0650-4aa5-8915-1dce3e00291d has ended -> executing endAction >2014-10-08 15:28:13,116 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-100) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 34088778-0650-4aa5-8915-1dce3e00291d): calling endAction . >2014-10-08 15:28:13,135 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-48) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-10-08 15:28:13,195 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-7-thread-48) [63a22b8f] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-10-08 15:28:13,283 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-48) [6770970f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-08 15:28:13,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-48) [6770970f] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = e0bcb03f-8b25-4841-b39e-8575d112ee55, imageId = 91743eb0-5857-4155-9bb3-2e3cc991d15f), log id: 5956f9c0 >2014-10-08 15:28:13,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-48) [6770970f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cdf4fd4f, log id: 5956f9c0 >2014-10-08 15:28:14,172 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-48) Correlation ID: 63a22b8f, Job ID: 7d21bfad-3625-4832-99cf-905fb59f7cd0, Call Stack: null, Custom Event ID: -1, Message: The disk sles11_Disk1 was successfully added to VM sles11. >2014-10-08 15:28:14,172 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-10-08 15:28:14,172 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-10-08 15:28:14,192 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bac91de3-cbc3-4e58-9bc9-b3904951f064 >2014-10-08 15:28:14,193 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = bac91de3-cbc3-4e58-9bc9-b3904951f064), log id: 2b526596 >2014-10-08 15:28:14,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-48) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=bac91de3-cbc3-4e58-9bc9-b3904951f064), log id: 3987bb72 >2014-10-08 15:28:14,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 3987bb72 >2014-10-08 15:28:14,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 2b526596 >2014-10-08 15:28:14,277 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-48) BaseAsyncTask::removeTaskFromDB: Removed task bac91de3-cbc3-4e58-9bc9-b3904951f064 from DataBase >2014-10-08 15:28:14,277 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 34088778-0650-4aa5-8915-1dce3e00291d >2014-10-08 15:28:20,109 ERROR [org.ovirt.engine.core.bll.GetImagesListByStoragePoolIdQuery] (ajp-/127.0.0.1:8702-12) Query GetImagesListByStoragePoolIdQuery failed. Exception message is null : java.lang.NullPointerException: java.lang.NullPointerException > at org.ovirt.engine.core.bll.IsoDomainListSyncronizer.refreshRepos(IsoDomainListSyncronizer.java:202) [bll.jar:] > at org.ovirt.engine.core.bll.IsoDomainListSyncronizer.isStorageDomainValid(IsoDomainListSyncronizer.java:792) [bll.jar:] > at org.ovirt.engine.core.bll.IsoDomainListSyncronizer.getUserRequestForStorageDomainRepoFileList(IsoDomainListSyncronizer.java:187) [bll.jar:] > at org.ovirt.engine.core.bll.GetImagesListQueryBase.getUserRequestForStorageDomainRepoFileList(GetImagesListQueryBase.java:28) [bll.jar:] > at org.ovirt.engine.core.bll.GetImagesListQueryBase.executeQueryCommand(GetImagesListQueryBase.java:19) [bll.jar:] > at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:73) [bll.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] > at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:492) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:466) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:74) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:84) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:97) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:73) [jboss-as-weld.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) [jboss-as-ee.jar:7.4.0.Final-redhat-19] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view6.runQuery(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runQuery(GenericApiGWTServiceImpl.java:56) > at sun.reflect.GeneratedMethodAccessor90.invoke(Unknown Source) [:1.7.0_65] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_65] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_65] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.SessionMgmtFilter.doFilter(SessionMgmtFilter.java:31) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.LoginFilter.doFilter(LoginFilter.java:73) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.NegotiationFilter.doFilter(NegotiationFilter.java:112) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:75) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:63) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:231) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:512) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:344) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:490) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:926) > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] > >2014-10-08 15:28:35,822 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] Lock Acquired to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 15:28:35,866 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] START, IsVmDuringInitiatingVDSCommand( vmId = 63d1ebb8-3614-4685-8ea6-a022d8725e1d), log id: ea06faa >2014-10-08 15:28:35,866 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: ea06faa >2014-10-08 15:28:36,537 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] Running command: RunVmOnceCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 15:28:36,933 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@f77a4e36), log id: 5179233e >2014-10-08 15:28:36,937 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] FINISH, UpdateVmDynamicDataVDSCommand, log id: 5179233e >2014-10-08 15:28:36,984 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] START, CreateVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, vm=VM [sles11]), log id: 79939e0 >2014-10-08 15:28:37,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] START, CreateVmFromCloudInitVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, vm=VM [sles11]), log id: 3ea2735e >2014-10-08 15:28:37,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{shared=false, iface=ide, index=3, specParams={vmPayload={file={openstack/latest/meta_data.json=ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs >CiAgInV1aWQiIDogImJkMGQyM2UxLTUzZmMtNDk1OS1iN2RhLTMzMTA2Y2RjMmE3MSIsCiAgIm1l >dGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs >CiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0= >, openstack/latest/user_data=I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg >YWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBp >cmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0 >Yy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwg >IkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK >}, volId=config-2}}, path=, device=cdrom, type=disk, readonly=true, deviceId=49192130-8968-4af1-9684-d6c45d43a084}, {specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=3df62ea1-5432-49d9-8cee-c9b3400cd7a3}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=471da96a-20f2-46b3-9e93-d53eacf9fa48}, {shared=false, index=0, volumeID=91743eb0-5857-4155-9bb3-2e3cc991d15f, propagateErrors=off, format=cow, type=disk, iface=virtio, bootOrder=2, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=e0bcb03f-8b25-4841-b39e-8575d112ee55, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=e0bcb03f-8b25-4841-b39e-8575d112ee55}, {bootOrder=1, nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=c375d887-6c16-4111-945b-a55c1976ae17}, {specParams={}, device=ich6, type=sound, deviceId=8435455e-0276-4735-b076-0486cb6e7f54}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=722be06b-5402-46e4-a4aa-e9a44219652b}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=157419f2-6efa-43a9-985c-c7fc00fc7ebc}, {specParams={}, device=virtio-serial, type=controller, deviceId=733757e6-dcf4-42ef-b5e5-450287c17735}],vmName=sles11,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 15:28:37,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] FINISH, CreateVmFromCloudInitVDSCommand, log id: 3ea2735e >2014-10-08 15:28:37,604 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 79939e0 >2014-10-08 15:28:37,604 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-11) [7f8042bd] Lock freed to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 15:28:37,646 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [7f8042bd] Correlation ID: 7f8042bd, Job ID: 75bae7e7-9004-458d-a076-0acb42f5a7fb, Call Stack: null, Custom Event ID: -1, Message: VM sles11 was started by admin (Host: dell-r210ii-03). >2014-10-08 15:28:38,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-50) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[63d1ebb8-3614-4685-8ea6-a022d8725e1d]), log id: 160f4c8 >2014-10-08 15:28:38,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-50) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=4403, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, pauseCode=NOERR, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=sles11, nice=0, status=WaitForLaunch, bootMenuEnable=false, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, copyPasteEnable=true, displayIp=10.34.63.222, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@466772d, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 160f4c8 >2014-10-08 15:28:38,903 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) Received a spice Device without an address when processing VM 63d1ebb8-3614-4685-8ea6-a022d8725e1d devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.222, displayNetwork=rhevm}, deviceType=graphics, type=graphics, tlsPort=5901} >2014-10-08 15:28:42,094 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from WaitForLaunch --> PoweringUp >2014-10-08 15:28:44,410 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [42ab057d] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONNECT_TO_VM with role type USER >2014-10-08 15:28:44,542 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [42ab057d] START, SetVmTicketVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, ticket=vvHX9XzY2OB+, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5813d036 >2014-10-08 15:28:44,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [42ab057d] FINISH, SetVmTicketVDSCommand, log id: 5813d036 >2014-10-08 15:28:44,642 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [42ab057d] Correlation ID: 42ab057d, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM sles11 >2014-10-08 15:28:48,380 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-49) [9830ee8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin is connected to VM sles11. >2014-10-08 15:29:23,044 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-96) Setting new tasks map. The map contains now 0 tasks >2014-10-08 15:29:23,044 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-96) Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-08 15:29:37,578 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from PoweringUp --> Up >2014-10-08 15:29:37,721 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) Correlation ID: 7f8042bd, Job ID: 75bae7e7-9004-458d-a076-0acb42f5a7fb, Call Stack: null, Custom Event ID: -1, Message: VM sles11 started on Host dell-r210ii-03 >2014-10-08 15:33:08,411 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from Up --> RebootInProgress >2014-10-08 15:33:08,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[63d1ebb8-3614-4685-8ea6-a022d8725e1d]), log id: 31795110 >2014-10-08 15:33:08,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=4403, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=sles11, nice=0, status=Up, bootMenuEnable=false, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, copyPasteEnable=true, displayIp=10.34.63.222, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@13b90ad0, timeOffset=0, maxVCpus=16, clientIp=10.34.130.162, display=qxl}], log id: 31795110 >2014-10-08 15:33:08,453 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) Received a spice Device without an address when processing VM 63d1ebb8-3614-4685-8ea6-a022d8725e1d devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.222, displayNetwork=rhevm}, deviceType=graphics, type=graphics, tlsPort=5901} >2014-10-08 15:34:06,961 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from RebootInProgress --> Up >2014-10-08 15:38:55,975 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin got disconnected from VM sles11. >2014-10-08 15:38:58,587 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [629817a8] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONNECT_TO_VM with role type USER >2014-10-08 15:38:58,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [629817a8] START, SetVmTicketVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, ticket=aZO6ZbvuyO+V, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7398760a >2014-10-08 15:38:58,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [629817a8] FINISH, SetVmTicketVDSCommand, log id: 7398760a >2014-10-08 15:38:58,697 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [629817a8] Correlation ID: 629817a8, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM sles11 >2014-10-08 15:39:02,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin is connected to VM sles11. >2014-10-08 15:48:10,784 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [cf26077] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-08 15:48:10,833 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:48:10,851 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-0000000001f1 value: REGISTER_VDS >, sharedLocks= ] >2014-10-08 15:48:10,854 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] START, RemoveVdsVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5), log id: 164278d3 >2014-10-08 15:48:10,854 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] FINISH, RemoveVdsVDSCommand, log id: 164278d3 >2014-10-08 15:48:10,855 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] START, AddVdsVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5), log id: 9f6517a >2014-10-08 15:48:10,855 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] AddVds - entered , starting logic to add VDS 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 >2014-10-08 15:48:10,856 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] AddVds - VDS 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 was added, will try to add it to the resource manager >2014-10-08 15:48:10,856 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [550f4fed] Entered VdsManager constructor >2014-10-08 15:48:10,867 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [550f4fed] Initialize vdsBroker (10.34.63.223,54,321) >2014-10-08 15:48:10,868 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [550f4fed] VDS 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 was added to the Resource Manager >2014-10-08 15:48:10,868 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [550f4fed] FINISH, AddVdsVDSCommand, log id: 9f6517a >2014-10-08 15:48:10,882 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [550f4fed] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 15:48:10,905 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [550f4fed] Correlation ID: cf26077, Job ID: e618b49a-ef5f-40dd-8650-d5dcee3222d3, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was added by admin. >2014-10-08 15:48:10,965 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] Lock Acquired to object EngineLock [exclusiveLocks= key: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 value: VDS >, sharedLocks= ] >2014-10-08 15:48:10,992 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:48:10,992 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] Before Installation host 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, dell-r210ii-04 >2014-10-08 15:48:10,996 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 635e886f >2014-10-08 15:48:10,999 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] FINISH, SetVdsStatusVDSCommand, log id: 635e886f >2014-10-08 15:48:11,092 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-7-thread-35) [156a6027] Installation 10.34.63.223: Connected to host 10.34.63.223 with SSH key fingerprint: ea:9a:71:4b:1b:31:97:14:21:a5:2c:de:3e:0d:90:dd >2014-10-08 15:48:11,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-35) [156a6027] Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Connected to host 10.34.63.223 with SSH key fingerprint: ea:9a:71:4b:1b:31:97:14:21:a5:2c:de:3e:0d:90:dd. >2014-10-08 15:48:11,165 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-7-thread-35) [156a6027] Installation of 10.34.63.223. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-08 15:48:11,288 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-7-thread-35) SSH execute root@10.34.63.223 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-08 15:48:12,285 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Initializing >2014-10-08 15:48:12,292 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Initializing. >2014-10-08 15:48:12,302 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Environment setup >2014-10-08 15:48:12,309 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Environment setup. >2014-10-08 15:48:12,310 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Environment packages setup >2014-10-08 15:48:12,316 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Environment packages setup. >2014-10-08 15:48:13,321 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Programs detection >2014-10-08 15:48:13,327 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Programs detection. >2014-10-08 15:48:13,336 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Environment customization >2014-10-08 15:48:13,342 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Environment customization. >2014-10-08 15:48:13,511 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Kdump unsupported >2014-10-08 15:48:13,522 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Kdump unsupported. >2014-10-08 15:48:13,537 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Logs at host located at: '/tmp/ovirt-host-deploy-20141008154811-s1sz4l.log' >2014-10-08 15:48:13,550 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Logs at host located at: '/tmp/ovirt-host-deploy-20141008154811-s1sz4l.log'. >2014-10-08 15:48:13,640 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.63.223 reports unique id 4C4C4544-0058-3410-8058-C2C04F38354A >2014-10-08 15:48:13,687 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0058-3410-8058-C2C04F38354A to Host 10.34.63.223 >2014-10-08 15:48:13,747 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Disabling Kdump integration >2014-10-08 15:48:13,756 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Disabling Kdump integration. >2014-10-08 15:48:13,771 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Setup validation >2014-10-08 15:48:13,777 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Setup validation. >2014-10-08 15:48:13,809 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Hardware supports virtualization >2014-10-08 15:48:13,817 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Hardware supports virtualization. >2014-10-08 15:48:13,870 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-94) [60a6dc9e] Initializing Host: dell-r210ii-04 >2014-10-08 15:48:13,892 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Transaction setup >2014-10-08 15:48:13,899 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Transaction setup. >2014-10-08 15:48:13,929 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Misc configuration >2014-10-08 15:48:13,936 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Misc configuration. >2014-10-08 15:48:13,936 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Package installation >2014-10-08 15:48:13,943 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Package installation. >2014-10-08 15:48:14,806 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Downloading Packages >2014-10-08 15:48:14,812 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Downloading Packages. >2014-10-08 15:48:14,834 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Download/Verify: 10:qemu-kvm-tools-rhev-1.5.3-60.el7_0.10.x86_64 >2014-10-08 15:48:14,840 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Download/Verify: 10:qemu-kvm-tools-rhev-1.5.3-60.el7_0.10.x86_64. >2014-10-08 15:48:14,840 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Check Package Signatures >2014-10-08 15:48:14,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Check Package Signatures. >2014-10-08 15:48:14,846 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Running Test Transaction >2014-10-08 15:48:14,853 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Running Test Transaction. >2014-10-08 15:48:14,854 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Status: Running Transaction >2014-10-08 15:48:14,859 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Status: Running Transaction. >2014-10-08 15:48:14,984 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum install: 1/1: 10:qemu-kvm-tools-rhev-1.5.3-60.el7_0.10.x86_64 >2014-10-08 15:48:14,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum install: 1/1: 10:qemu-kvm-tools-rhev-1.5.3-60.el7_0.10.x86_64. >2014-10-08 15:48:15,860 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Yum Verify: 1/1: qemu-kvm-tools-rhev.x86_64 10:1.5.3-60.el7_0.10 - u >2014-10-08 15:48:15,869 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Yum Verify: 1/1: qemu-kvm-tools-rhev.x86_64 10:1.5.3-60.el7_0.10 - u. >2014-10-08 15:48:16,216 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Misc configuration >2014-10-08 15:48:16,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Misc configuration. >2014-10-08 15:48:16,279 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Setting time >2014-10-08 15:48:16,283 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Setting time. >2014-10-08 15:48:18,487 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Enrolling certificate >2014-10-08 15:48:18,494 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Enrolling certificate. >2014-10-08 15:48:19,888 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Transaction commit >2014-10-08 15:48:19,947 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Transaction commit. >2014-10-08 15:48:20,026 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Closing up >2014-10-08 15:48:20,030 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Closing up. >2014-10-08 15:48:21,419 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stopping libvirtd >2014-10-08 15:48:21,428 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stopping libvirtd. >2014-10-08 15:48:21,440 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Starting vdsm >2014-10-08 15:48:21,447 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Starting vdsm. >2014-10-08 15:48:23,358 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Pre-termination >2014-10-08 15:48:23,365 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Pre-termination. >2014-10-08 15:48:23,388 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141008154823-10.34.63.223-156a6027.log' >2014-10-08 15:48:23,393 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141008154823-10.34.63.223-156a6027.log'. >2014-10-08 15:48:23,586 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.223: Stage: Termination >2014-10-08 15:48:23,592 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 156a6027, Call Stack: null, Custom Event ID: -1, Message: Installing Host dell-r210ii-04. Stage: Termination. >2014-10-08 15:48:23,714 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 15:48:23,715 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 15:48:23,737 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 15:48:23,738 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (org.ovirt.thread.pool-7-thread-26) Exception during connection: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused > at java.util.concurrent.FutureTask.report(FutureTask.java:122) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.get(FutureTask.java:188) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:122) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:109) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:67) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:60) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:917) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$3.call(JsonRpcVdsServer.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:405) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer$FutureCallable.call(JsonRpcVdsServer.java:394) [vdsbroker.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65] > at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65] >Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_65] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:111) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient$2.call(ReactorClient.java:97) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable.call(Retryable.java:26) [vdsm-jsonrpc-java-client.jar:] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65] > at org.ovirt.vdsm.jsonrpc.client.utils.ReactorScheduler.performPendingOperations(ReactorScheduler.java:28) [vdsm-jsonrpc-java-client.jar:] > at org.ovirt.vdsm.jsonrpc.client.reactors.Reactor.run(Reactor.java:58) [vdsm-jsonrpc-java-client.jar:] > >2014-10-08 15:48:23,762 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 15:48:23,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-35) [156a6027] Command PollVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: Connection issues during send request >2014-10-08 15:48:24,291 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 15:48:24,389 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-35) [156a6027] Engine managed to communicate with VDSM agent on host dell-r210ii-04 >2014-10-08 15:48:24,717 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-7-thread-35) [21b41c2f] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN >2014-10-08 15:48:24,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (org.ovirt.thread.pool-7-thread-35) [21b41c2f] START, SetupNetworksVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-0000000001f1, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=true, required=true, migration=true}, providedBy=null, label=null, qosId=null}], > bonds=[], > interfaces=[em1 {id=9ac2ff8f-dc9b-403c-aeb6-bc118d7eeecb, vdsId=9aae4e31-3100-4932-84f8-1b6cf11ec8a5, macAddress=d0:67:e5:ee:65:09, networkName=rhevm, baseInterface=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.34.63.223, subnet=255.255.252.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, > em2 {id=133e37d0-6b82-4610-94aa-c7792a04d1ce, vdsId=9aae4e31-3100-4932-84f8-1b6cf11ec8a5, macAddress=d0:67:e5:ee:65:0a, networkName=null, baseInterface=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}], > removedNetworks=[], > removedBonds=[]), log id: 704a1940 >2014-10-08 15:48:24,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (org.ovirt.thread.pool-7-thread-35) [21b41c2f] FINISH, SetupNetworksVDSCommand, log id: 704a1940 >2014-10-08 15:48:24,730 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 15:48:40,485 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.223 >2014-10-08 15:48:40,738 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN >2014-10-08 15:48:40,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] START, SetSafeNetworkConfigVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5), log id: 5df62fbd >2014-10-08 15:48:40,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] FINISH, SetSafeNetworkConfigVDSCommand, log id: 5df62fbd >2014-10-08 15:48:40,785 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-35) [4366d864] Correlation ID: 4366d864, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host dell-r210ii-04 >2014-10-08 15:48:40,788 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 56a75a44 >2014-10-08 15:48:40,792 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] FINISH, SetVdsStatusVDSCommand, log id: 56a75a44 >2014-10-08 15:48:40,792 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] After Installation host dell-r210ii-04, VDS >2014-10-08 15:48:40,812 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-35) [4366d864] Correlation ID: 156a6027, Job ID: e618b49a-ef5f-40dd-8650-d5dcee3222d3, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 installed >2014-10-08 15:48:40,817 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-35) [4366d864] Lock freed to object EngineLock [exclusiveLocks= key: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 value: VDS >, sharedLocks= ] >2014-10-08 15:48:40,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vds=Host[dell-r210ii-04,9aae4e31-3100-4932-84f8-1b6cf11ec8a5]), log id: 2e851182 >2014-10-08 15:48:40,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GetHardwareInfoVDSCommand, log id: 2e851182 >2014-10-08 15:48:41,081 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-42) [794d5526] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:48:41,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-42) [794d5526] START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vds=Host[dell-r210ii-04,9aae4e31-3100-4932-84f8-1b6cf11ec8a5]), log id: 799febb3 >2014-10-08 15:48:41,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-42) [794d5526] FINISH, GetHardwareInfoVDSCommand, log id: 799febb3 >2014-10-08 15:48:41,135 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-42) [e41e58d] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 15:48:41,142 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-42) [403f6326] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 15:48:41,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-42) [403f6326] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 353e7ee2 >2014-10-08 15:48:42,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-42) [403f6326] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 353e7ee2 >2014-10-08 15:48:42,021 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-42) [403f6326] Host dell-r210ii-04 storage connection was succeeded >2014-10-08 15:48:42,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-15) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 642abc40 >2014-10-08 15:48:42,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-15) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=304, mMessage=Cannot find master domain: u'spUUID=00000002-0002-0002-0002-0000000001f1, msdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992']] >2014-10-08 15:48:42,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-15) HostName = dell-r210ii-04 >2014-10-08 15:48:42,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-15) Command ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1) execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: u'spUUID=00000002-0002-0002-0002-0000000001f1, msdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992' >2014-10-08 15:48:42,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-15) FINISH, ConnectStoragePoolVDSCommand, log id: 642abc40 >2014-10-08 15:48:42,263 ERROR [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (org.ovirt.thread.pool-7-thread-15) Could not connect host dell-r210ii-04 to pool Default with the message: null >2014-10-08 15:48:42,361 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-42) [3e70a58e] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:48:42,363 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-42) [3e70a58e] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, status=NonOperational, nonOperationalReason=STORAGE_DOMAIN_UNREACHABLE, stopSpmFailureLogged=false), log id: 6d064ff8 >2014-10-08 15:48:42,377 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-42) [3e70a58e] FINISH, SetVdsStatusVDSCommand, log id: 6d064ff8 >2014-10-08 15:48:42,400 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [3e70a58e] Correlation ID: 3e70a58e, Job ID: ceddbc36-9bf4-484c-a430-3a5eea68f773, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Default. Setting Host state to Non-Operational. >2014-10-08 15:48:42,419 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [3e70a58e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 15:48:42,442 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [3e70a58e] Correlation ID: e41e58d, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host dell-r210ii-04 to Storage Pool Default >2014-10-08 15:48:42,468 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-42) [2794942b] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:48:42,477 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-42) [38408d33] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:48:42,479 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-42) [38408d33] Host 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 : dell-r210ii-04 is already in NonOperational status for reason STORAGE_DOMAIN_UNREACHABLE. SetNonOperationalVds command is skipped. >2014-10-08 15:51:46,384 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-14) [7c9d1b8f] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 15:51:46,401 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-14) [7c9d1b8f] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 6966b45d >2014-10-08 15:51:46,406 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-14) [7c9d1b8f] FINISH, SetVdsStatusVDSCommand, log id: 6966b45d >2014-10-08 15:51:46,620 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-14) [7c9d1b8f] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:51:46,627 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-14) [7c9d1b8f] Correlation ID: 7c9d1b8f, Job ID: a19fdcf0-921d-4272-9344-189d1d274c5a, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was switched to Maintenance mode by admin. >2014-10-08 15:51:48,707 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) [1b7756cc] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 : dell-r210ii-04 >2014-10-08 15:51:48,735 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-32) Clearing cache of pool: 00000002-0002-0002-0002-0000000001f1 for problematic entities of VDS: dell-r210ii-04. >2014-10-08 15:51:48,736 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-32) Removing vds [9aae4e31-3100-4932-84f8-1b6cf11ec8a5] from the domain in maintenance cache >2014-10-08 15:51:48,736 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-32) Removing host(s) [9aae4e31-3100-4932-84f8-1b6cf11ec8a5] from hosts unseen domain report cache >2014-10-08 15:51:48,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-20) [1b7756cc] START, DisconnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, vds_spm_id = 2), log id: 9b9b721 >2014-10-08 15:51:48,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-20) [1b7756cc] FINISH, DisconnectStoragePoolVDSCommand, log id: 9b9b721 >2014-10-08 15:51:48,756 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-20) [45d87fee] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 15:51:48,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-20) [45d87fee] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1ad309cc >2014-10-08 15:51:49,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-20) [45d87fee] FINISH, DisconnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 1ad309cc >2014-10-08 15:51:57,996 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-11) [58134c05] Lock Acquired to object EngineLock [exclusiveLocks= key: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 value: VDS >, sharedLocks= ] >2014-10-08 15:51:58,069 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [58134c05] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-08 15:51:58,070 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [58134c05] Before acquiring lock in order to prevent monitoring for host dell-r210ii-04 from data-center Default >2014-10-08 15:51:58,083 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [58134c05] Lock acquired, from now a monitoring of host will be skipped for host dell-r210ii-04 from data-center Default >2014-10-08 15:51:58,103 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [58134c05] START, SetVdsStatusVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 431b0c1a >2014-10-08 15:51:58,108 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [58134c05] FINISH, SetVdsStatusVDSCommand, log id: 431b0c1a >2014-10-08 15:51:58,249 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) Activate finished. Lock released. Monitoring can run now for host dell-r210ii-04 from data-center Default >2014-10-08 15:51:58,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) Correlation ID: 58134c05, Job ID: 921defbc-6aab-4d5f-995f-7f033fbf90a5, Call Stack: null, Custom Event ID: -1, Message: Host dell-r210ii-04 was activated by admin. >2014-10-08 15:51:58,258 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) Lock freed to object EngineLock [exclusiveLocks= key: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 value: VDS >, sharedLocks= ] >2014-10-08 15:51:58,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetHardwareInfoVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vds=Host[dell-r210ii-04,9aae4e31-3100-4932-84f8-1b6cf11ec8a5]), log id: 48b3b4d1 >2014-10-08 15:51:58,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetHardwareInfoVDSCommand, log id: 48b3b4d1 >2014-10-08 15:51:58,581 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-51) [5a79bcd0] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:51:58,602 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-51) [25334313] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 15:51:58,651 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-51) [4d908492] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-0000000001f1 Type: StoragePool >2014-10-08 15:51:58,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-51) [4d908492] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21f8fb9b >2014-10-08 15:51:59,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-51) [4d908492] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 21f8fb9b >2014-10-08 15:51:59,416 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-51) [4d908492] Host dell-r210ii-04 storage connection was succeeded >2014-10-08 15:51:59,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-47) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 2fb1a929 >2014-10-08 15:51:59,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-47) FINISH, ConnectStoragePoolVDSCommand, log id: 2fb1a929 >2014-10-08 15:51:59,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-51) [4d908492] START, SetMOMPolicyParametersVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5), log id: 692886f6 >2014-10-08 15:51:59,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-51) [4d908492] FINISH, SetMOMPolicyParametersVDSCommand, log id: 692886f6 >2014-10-08 15:51:59,784 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-51) [4d908492] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host dell-r210ii-04 was set to Up. >2014-10-08 15:51:59,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-51) [4d908492] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host dell-r210ii-04. >2014-10-08 15:51:59,814 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-51) [4509388a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 Type: VDS >2014-10-08 15:53:27,851 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-95) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from Up --> RebootInProgress >2014-10-08 15:53:31,027 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-47) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from RebootInProgress --> Up >2014-10-08 15:53:37,235 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-82) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin got disconnected from VM sles11. >2014-10-08 15:54:03,704 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-1) [51cc029a] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group CONNECT_TO_VM with role type USER >2014-10-08 15:54:03,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [51cc029a] START, SetVmTicketVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, ticket=uNDjohgZqMuG, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1261c450 >2014-10-08 15:54:03,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [51cc029a] FINISH, SetVmTicketVDSCommand, log id: 1261c450 >2014-10-08 15:54:03,824 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [51cc029a] Correlation ID: 51cc029a, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM test >2014-10-08 15:54:08,199 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin is connected to VM test. >2014-10-08 15:59:12,063 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [3ed0857c] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONNECT_TO_VM with role type USER >2014-10-08 15:59:12,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [3ed0857c] START, SetVmTicketVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, ticket=+fqWui+XkhLp, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 4a97d3ab >2014-10-08 15:59:12,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [3ed0857c] FINISH, SetVmTicketVDSCommand, log id: 4a97d3ab >2014-10-08 15:59:12,200 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [3ed0857c] Correlation ID: 3ed0857c, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM sles11 >2014-10-08 15:59:15,787 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin is connected to VM sles11. >2014-10-08 15:59:18,909 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin got disconnected from VM sles11. >2014-10-08 16:19:51,435 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-10-08 16:19:53,649 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-62) [18bdeaf4] Lock Acquired to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 16:19:53,667 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-62) [18bdeaf4] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 16:19:53,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [18bdeaf4] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 3f73217e >2014-10-08 16:19:53,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [18bdeaf4] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 16:19:53,804 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [18bdeaf4] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Tue Oct 07 17:19:54 CEST 2014"} > >2014-10-08 16:19:53,957 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [18bdeaf4] FINISH, SetVolumeDescriptionVDSCommand, log id: 3f73217e >2014-10-08 16:19:54,119 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] Running command: UploadStreamCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 16:19:54,172 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] START, UploadStreamVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 77fc3c77 >2014-10-08 16:19:54,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] -- executeVdsBrokerCommand: >2014-10-08 16:19:54,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > size=10,240 > >2014-10-08 16:19:56,278 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] FINISH, UploadStreamVDSCommand, log id: 77fc3c77 >2014-10-08 16:19:56,280 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-62) [42a4d30] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 7c67f0dc-e7ed-4994-86d8-76194378af50 >2014-10-08 16:19:56,280 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) [42a4d30] CommandMultiAsyncTasks::AttachTask: Attaching task 87efe11f-c17d-490a-bce7-8a6781e4e4e7 to command 7c67f0dc-e7ed-4994-86d8-76194378af50. >2014-10-08 16:19:56,302 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) [42a4d30] Adding task 87efe11f-c17d-490a-bce7-8a6781e4e4e7 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 16:19:56,323 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] Lock freed to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 16:19:56,328 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 2768e2aa >2014-10-08 16:19:56,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 16:19:56,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Wed Oct 08 16:19:53 CEST 2014","Size":10240} > >2014-10-08 16:19:56,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] FINISH, SetVolumeDescriptionVDSCommand, log id: 2768e2aa >2014-10-08 16:19:56,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 3a1a6ca8 >2014-10-08 16:19:56,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 16:19:56,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Tue Oct 07 17:19:54 CEST 2014"} > >2014-10-08 16:19:56,660 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [42a4d30] FINISH, SetVolumeDescriptionVDSCommand, log id: 3a1a6ca8 >2014-10-08 16:19:56,685 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] Running command: UploadStreamCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 16:19:56,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] START, UploadStreamVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 1222558c >2014-10-08 16:19:56,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] -- executeVdsBrokerCommand: >2014-10-08 16:19:56,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > size=10,240 > >2014-10-08 16:19:58,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] FINISH, UploadStreamVDSCommand, log id: 1222558c >2014-10-08 16:19:58,708 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) [72decf57] CommandMultiAsyncTasks::AttachTask: Attaching task c6b25672-cc18-4933-be72-0f83836a9f9e to command 7c67f0dc-e7ed-4994-86d8-76194378af50. >2014-10-08 16:19:58,717 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) [72decf57] Adding task c6b25672-cc18-4933-be72-0f83836a9f9e (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 16:19:58,739 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) [72decf57] Trying to release a shared lock for key: 00000002-0002-0002-0002-0000000001f1OVF_UPDATE , but lock does not exist >2014-10-08 16:19:58,739 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) [72decf57] Trying to release exclusive lock which does not exist, lock key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614DISK >2014-10-08 16:19:58,739 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) [72decf57] Trying to release exclusive lock which does not exist, lock key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3DISK >2014-10-08 16:19:58,739 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) [72decf57] Trying to release exclusive lock which does not exist, lock key: 322e3360-066e-4e98-a0e9-dd44e82f0992STORAGE >2014-10-08 16:19:58,739 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] Lock freed to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 16:19:58,740 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 641a0c67 >2014-10-08 16:19:58,740 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 16:19:58,741 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Wed Oct 08 16:19:53 CEST 2014","Size":10240} > >2014-10-08 16:19:58,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-62) [72decf57] FINISH, SetVolumeDescriptionVDSCommand, log id: 641a0c67 >2014-10-08 16:19:58,898 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) [72decf57] BaseAsyncTask::startPollingTask: Starting to poll task 87efe11f-c17d-490a-bce7-8a6781e4e4e7. >2014-10-08 16:19:58,898 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) [72decf57] BaseAsyncTask::startPollingTask: Starting to poll task c6b25672-cc18-4933-be72-0f83836a9f9e. >2014-10-08 16:20:03,275 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-69) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-10-08 16:20:03,281 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) SPMAsyncTask::PollTask: Polling task 87efe11f-c17d-490a-bce7-8a6781e4e4e7 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 16:20:03,281 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) BaseAsyncTask::onTaskEndSuccess: Task 87efe11f-c17d-490a-bce7-8a6781e4e4e7 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 16:20:03,282 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-69) Task with DB Task ID ef4c5d73-b44e-42a7-ba2e-4b8326a9cf85 and VDSM Task ID c6b25672-cc18-4933-be72-0f83836a9f9e is in state Polling. End action for command 7c67f0dc-e7ed-4994-86d8-76194378af50 will proceed when all the entitys tasks are completed. >2014-10-08 16:20:03,282 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) SPMAsyncTask::PollTask: Polling task c6b25672-cc18-4933-be72-0f83836a9f9e (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 16:20:03,282 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-69) BaseAsyncTask::onTaskEndSuccess: Task c6b25672-cc18-4933-be72-0f83836a9f9e (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 16:20:03,282 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-69) CommandAsyncTask::endActionIfNecessary: All tasks of command 7c67f0dc-e7ed-4994-86d8-76194378af50 has ended -> executing endAction >2014-10-08 16:20:03,282 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-69) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 7c67f0dc-e7ed-4994-86d8-76194378af50): calling endAction . >2014-10-08 16:20:03,292 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-43) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-10-08 16:20:03,470 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-10-08 16:20:03,471 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] Trying to release a shared lock for key: 00000002-0002-0002-0002-0000000001f1OVF_UPDATE , but lock does not exist >2014-10-08 16:20:03,471 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] Trying to release exclusive lock which does not exist, lock key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614DISK >2014-10-08 16:20:03,471 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] Trying to release exclusive lock which does not exist, lock key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3DISK >2014-10-08 16:20:03,471 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] Trying to release exclusive lock which does not exist, lock key: 322e3360-066e-4e98-a0e9-dd44e82f0992STORAGE >2014-10-08 16:20:03,472 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] Lock freed to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 16:20:03,472 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-10-08 16:20:03,472 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-10-08 16:20:03,472 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] SPMAsyncTask::ClearAsyncTask: Attempting to clear task c6b25672-cc18-4933-be72-0f83836a9f9e >2014-10-08 16:20:03,472 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = c6b25672-cc18-4933-be72-0f83836a9f9e), log id: 658c5bed >2014-10-08 16:20:03,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=c6b25672-cc18-4933-be72-0f83836a9f9e), log id: 61e758b0 >2014-10-08 16:20:03,515 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] FINISH, HSMClearTaskVDSCommand, log id: 61e758b0 >2014-10-08 16:20:03,515 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] FINISH, SPMClearTaskVDSCommand, log id: 658c5bed >2014-10-08 16:20:03,519 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] BaseAsyncTask::removeTaskFromDB: Removed task c6b25672-cc18-4933-be72-0f83836a9f9e from DataBase >2014-10-08 16:20:03,519 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 87efe11f-c17d-490a-bce7-8a6781e4e4e7 >2014-10-08 16:20:03,520 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 87efe11f-c17d-490a-bce7-8a6781e4e4e7), log id: 380ba5f8 >2014-10-08 16:20:03,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=87efe11f-c17d-490a-bce7-8a6781e4e4e7), log id: 4bd5987 >2014-10-08 16:20:03,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] FINISH, HSMClearTaskVDSCommand, log id: 4bd5987 >2014-10-08 16:20:03,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] FINISH, SPMClearTaskVDSCommand, log id: 380ba5f8 >2014-10-08 16:20:03,567 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] BaseAsyncTask::removeTaskFromDB: Removed task 87efe11f-c17d-490a-bce7-8a6781e4e4e7 from DataBase >2014-10-08 16:20:03,567 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-43) [18bdeaf4] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 7c67f0dc-e7ed-4994-86d8-76194378af50 >2014-10-08 16:21:23,080 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) Setting new tasks map. The map contains now 0 tasks >2014-10-08 16:21:23,080 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-08 16:26:19,740 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-8) [15f8f31f] Lock Acquired to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 16:26:19,902 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-7-thread-47) [15f8f31f] Running command: MigrateVmCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group MIGRATE_VM with role type USER >2014-10-08 16:26:20,266 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-7-thread-47) [15f8f31f] START, MigrateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, srcHost=10.34.63.222, dstVdsId=9aae4e31-3100-4932-84f8-1b6cf11ec8a5, dstHost=10.34.63.223:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 65e4f896 >2014-10-08 16:26:20,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-7-thread-47) [15f8f31f] START, MigrateBrokerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, srcHost=10.34.63.222, dstVdsId=9aae4e31-3100-4932-84f8-1b6cf11ec8a5, dstHost=10.34.63.223:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 26c9f14f >2014-10-08 16:26:20,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-7-thread-47) [15f8f31f] FINISH, MigrateBrokerVDSCommand, log id: 26c9f14f >2014-10-08 16:26:20,515 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-7-thread-47) [15f8f31f] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 65e4f896 >2014-10-08 16:26:20,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-47) [15f8f31f] Correlation ID: 15f8f31f, Job ID: ca843803-5289-496d-b018-88842386d025, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: sles11, Source: dell-r210ii-03, Destination: dell-r210ii-04, User: admin). >2014-10-08 16:26:20,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) START, FullListVdsCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vds=Host[dell-r210ii-03,04f67d65-72bc-4ddc-88b7-81d0053dff0b], vmIds=[63d1ebb8-3614-4685-8ea6-a022d8725e1d]), log id: 1066dcb9 >2014-10-08 16:26:20,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-15) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=4403, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=sles11, nice=0, status=Migration Source, bootMenuEnable=false, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, copyPasteEnable=true, displayIp=10.34.63.222, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@7db605d9, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 1066dcb9 >2014-10-08 16:26:20,593 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) Received a spice Device without an address when processing VM 63d1ebb8-3614-4685-8ea6-a022d8725e1d devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.222, displayNetwork=rhevm}, deviceType=graphics, type=graphics, tlsPort=5901} >2014-10-08 16:26:23,688 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from MigratingFrom --> Up >2014-10-08 16:26:23,688 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) Adding VM 63d1ebb8-3614-4685-8ea6-a022d8725e1d to re-run list >2014-10-08 16:26:23,711 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) Rerun vm 63d1ebb8-3614-4685-8ea6-a022d8725e1d. Called from vds dell-r210ii-03 >2014-10-08 16:26:23,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) START, MigrateStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d), log id: 3ddac0c2 >2014-10-08 16:26:23,784 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) Failed in MigrateStatusVDS method >2014-10-08 16:26:23,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-08 16:26:23,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) HostName = dell-r210ii-03 >2014-10-08 16:26:23,785 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) Command MigrateStatusVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-08 16:26:23,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-7-thread-13) FINISH, MigrateStatusVDSCommand, log id: 3ddac0c2 >2014-10-08 16:26:23,791 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) Correlation ID: 15f8f31f, Job ID: ca843803-5289-496d-b018-88842386d025, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration. Trying to migrate to another Host (VM: sles11, Source: dell-r210ii-03, Destination: <UNKNOWN>). >2014-10-08 16:26:23,947 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-7-thread-13) CanDoAction of action MigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,VAR__ACTION__MIGRATE,VAR__TYPE__VM,VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_NO_HOSTS >2014-10-08 16:26:23,947 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-7-thread-13) Lock freed to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 16:26:23,957 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-13) Correlation ID: 15f8f31f, Job ID: ca843803-5289-496d-b018-88842386d025, Call Stack: null, Custom Event ID: -1, Message: Migration failed, No available host found (VM: sles11, Source: dell-r210ii-03). >2014-10-08 16:32:20,042 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-7-thread-32) [6a4efd95] Running command: StopVmCommand internal: false. Entities affected : ID: 057790fa-b736-49e7-a7c1-4c832c1c3511 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 16:32:20,105 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-32) [6a4efd95] START, DestroyVmVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 4ee6ec41 >2014-10-08 16:32:20,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-32) [6a4efd95] START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=057790fa-b736-49e7-a7c1-4c832c1c3511, force=false, secondsToWait=0, gracefully=false, reason=), log id: 57255ee1 >2014-10-08 16:32:20,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-32) [6a4efd95] FINISH, DestroyVDSCommand, log id: 57255ee1 >2014-10-08 16:32:20,972 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-32) [6a4efd95] FINISH, DestroyVmVDSCommand, return: Down, log id: 4ee6ec41 >2014-10-08 16:32:20,982 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-7-thread-26) [18eb2545] Running command: ProcessDownVmCommand internal: true. >2014-10-08 16:32:21,021 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-32) [6a4efd95] Correlation ID: 6a4efd95, Job ID: 20a38e47-e9f7-434c-8201-d82f5ea95ba2, Call Stack: null, Custom Event ID: -1, Message: VM test powered off by admin (Host: dell-r210ii-03) (Reason: Not Specified). >2014-10-08 16:32:58,002 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-9) [2dbe13a9] Lock Acquired to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 16:32:58,031 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [2dbe13a9] START, IsVmDuringInitiatingVDSCommand( vmId = 057790fa-b736-49e7-a7c1-4c832c1c3511), log id: 2d0b69f3 >2014-10-08 16:32:58,031 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [2dbe13a9] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2d0b69f3 >2014-10-08 16:32:58,034 WARN [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-9) [2dbe13a9] CanDoAction of action RunVmOnce failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_DISKS_LOCKED,$diskAliases test_Disk1 >2014-10-08 16:32:58,034 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-9) [2dbe13a9] Lock freed to object EngineLock [exclusiveLocks= key: 057790fa-b736-49e7-a7c1-4c832c1c3511 value: VM >, sharedLocks= ] >2014-10-08 16:33:13,665 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-11) [389dbab2] Lock Acquired to object EngineLock [exclusiveLocks= key: zzz value: VM_NAME >, sharedLocks= ] >2014-10-08 16:33:13,717 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-11) [389dbab2] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000b0 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-10-08 16:33:13,799 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [389dbab2] Correlation ID: 389dbab2, Job ID: ae81ac97-5c1d-4308-af1b-71fa911de9c1, Call Stack: null, Custom Event ID: -1, Message: VM zzz was created by admin. >2014-10-08 16:33:13,804 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-11) [389dbab2] Lock freed to object EngineLock [exclusiveLocks= key: zzz value: VM_NAME >, sharedLocks= ] >2014-10-08 16:33:14,352 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [5fe95f60] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: 0000000e-000e-000e-000e-0000000001ae Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER >2014-10-08 16:33:14,414 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-10) [21e1ef2d] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 Type: VM >2014-10-08 16:33:14,448 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [21e1ef2d] Correlation ID: 21e1ef2d, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM zzz. (User: admin) >2014-10-08 16:33:14,456 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [21e1ef2d] Correlation ID: 5fe95f60, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM zzz. (User: admin) >2014-10-08 16:33:14,507 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-12) [1b745f8a] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 Type: VMAction group CREATE_VM with role type USER >2014-10-08 16:33:18,882 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-8) [475577e9] Lock Acquired to object EngineLock [exclusiveLocks= key: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 value: VM_DISK_BOOT >, sharedLocks= key: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 value: VM >] >2014-10-08 16:33:18,908 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-8) [475577e9] Running command: AddDiskCommand internal: false. Entities affected : ID: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: StorageAction group CREATE_DISK with role type USER >2014-10-08 16:33:18,952 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-8) [47e5285b] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 16:33:19,003 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-8) [47e5285b] Lock freed to object EngineLock [exclusiveLocks= key: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 value: VM_DISK_BOOT >, sharedLocks= key: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 value: VM >] >2014-10-08 16:33:19,004 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [47e5285b] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 657874f8-7de6-46b2-b81a-e0b4cf38aded, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 959740b7-f0eb-44f2-8e39-5e9ea5e610a8, newImageDescription = ), log id: 7f5428cf >2014-10-08 16:33:19,009 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [47e5285b] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-08 16:33:19,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-8) [47e5285b] FINISH, CreateImageVDSCommand, return: 959740b7-f0eb-44f2-8e39-5e9ea5e610a8, log id: 7f5428cf >2014-10-08 16:33:19,077 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp-/127.0.0.1:8702-8) [47e5285b] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command c780ec65-d8b0-4a63-afe1-392f8b376e1f >2014-10-08 16:33:19,077 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-8) [47e5285b] CommandMultiAsyncTasks::AttachTask: Attaching task 92675d88-ef91-48af-a320-3efa21e068f7 to command c780ec65-d8b0-4a63-afe1-392f8b376e1f. >2014-10-08 16:33:19,097 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp-/127.0.0.1:8702-8) [47e5285b] Adding task 92675d88-ef91-48af-a320-3efa21e068f7 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 16:33:19,166 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [47e5285b] Correlation ID: 475577e9, Job ID: d05182ba-8758-4e7a-88ba-5ecc35019541, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of zzz_Disk1 was initiated on VM zzz by admin. >2014-10-08 16:33:19,166 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp-/127.0.0.1:8702-8) [47e5285b] BaseAsyncTask::startPollingTask: Starting to poll task 92675d88-ef91-48af-a320-3efa21e068f7. >2014-10-08 16:33:23,311 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-93) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-10-08 16:33:23,317 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-93) SPMAsyncTask::PollTask: Polling task 92675d88-ef91-48af-a320-3efa21e068f7 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 16:33:23,326 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-93) BaseAsyncTask::onTaskEndSuccess: Task 92675d88-ef91-48af-a320-3efa21e068f7 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 16:33:23,326 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-93) CommandAsyncTask::endActionIfNecessary: All tasks of command c780ec65-d8b0-4a63-afe1-392f8b376e1f has ended -> executing endAction >2014-10-08 16:33:23,326 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-93) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: c780ec65-d8b0-4a63-afe1-392f8b376e1f): calling endAction . >2014-10-08 16:33:23,327 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-22) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-10-08 16:33:23,352 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-7-thread-22) [475577e9] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-10-08 16:33:23,375 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-22) [47e5285b] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-08 16:33:23,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-22) [47e5285b] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 657874f8-7de6-46b2-b81a-e0b4cf38aded, imageId = 959740b7-f0eb-44f2-8e39-5e9ea5e610a8), log id: 298e5839 >2014-10-08 16:33:23,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-22) [47e5285b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f52b366d, log id: 298e5839 >2014-10-08 16:33:23,498 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-22) Correlation ID: 475577e9, Job ID: d05182ba-8758-4e7a-88ba-5ecc35019541, Call Stack: null, Custom Event ID: -1, Message: The disk zzz_Disk1 was successfully added to VM zzz. >2014-10-08 16:33:23,498 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-22) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-10-08 16:33:23,498 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-22) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-10-08 16:33:23,502 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-22) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 92675d88-ef91-48af-a320-3efa21e068f7 >2014-10-08 16:33:23,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-22) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 92675d88-ef91-48af-a320-3efa21e068f7), log id: 4642e43e >2014-10-08 16:33:23,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-22) START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=92675d88-ef91-48af-a320-3efa21e068f7), log id: 5196c67b >2014-10-08 16:33:23,550 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-22) FINISH, HSMClearTaskVDSCommand, log id: 5196c67b >2014-10-08 16:33:23,550 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-22) FINISH, SPMClearTaskVDSCommand, log id: 4642e43e >2014-10-08 16:33:23,571 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-22) BaseAsyncTask::removeTaskFromDB: Removed task 92675d88-ef91-48af-a320-3efa21e068f7 from DataBase >2014-10-08 16:33:23,571 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-22) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity c780ec65-d8b0-4a63-afe1-392f8b376e1f >2014-10-08 16:33:38,442 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [67786b61] Lock Acquired to object EngineLock [exclusiveLocks= key: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 value: VM >, sharedLocks= ] >2014-10-08 16:33:38,691 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [67786b61] START, IsVmDuringInitiatingVDSCommand( vmId = 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3), log id: 47b40bba >2014-10-08 16:33:38,691 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [67786b61] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 47b40bba >2014-10-08 16:33:38,932 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] Running command: RunVmCommand internal: false. Entities affected : ID: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-08 16:33:39,066 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-7-thread-3) [67786b61] Started HA reservation scoring method >2014-10-08 16:33:39,247 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] START, UpdateVmDynamicDataVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@577f0896), log id: 336164ad >2014-10-08 16:33:39,250 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] FINISH, UpdateVmDynamicDataVDSCommand, log id: 336164ad >2014-10-08 16:33:39,321 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] START, CreateVmVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3, vm=VM [zzz]), log id: 2d6471d9 >2014-10-08 16:33:39,367 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] START, CreateVmFromCloudInitVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3, vm=VM [zzz]), log id: 77259648 >2014-10-08 16:33:39,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=rhevm,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{shared=false, iface=ide, index=3, specParams={vmPayload={file={openstack/latest/meta_data.json=ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs >CiAgInV1aWQiIDogIjFjOTA3NWM1LTBhODgtNDY3Ny1iMjVkLWU3MDgyNGQ4ZTExMCIsCiAgIm1l >dGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs >CiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0= >, openstack/latest/user_data=I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg >YWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBp >cmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0 >Yy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwg >IkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK >}, volId=config-2}}, path=, device=cdrom, type=disk, readonly=true, deviceId=23f41e20-5957-4875-879a-a36732ae3e8e}, {specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=c5de2a4c-8e75-4e5a-850c-6879b3c5b922}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=11c04b7a-fcf2-4e3b-a663-abda60776678}, {shared=false, index=0, volumeID=959740b7-f0eb-44f2-8e39-5e9ea5e610a8, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=1, domainID=322e3360-066e-4e98-a0e9-dd44e82f0992, imageID=657874f8-7de6-46b2-b81a-e0b4cf38aded, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-0000000001f1, readonly=false, deviceId=657874f8-7de6-46b2-b81a-e0b4cf38aded}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:76:fa:02, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=6b2f7028-2d21-4443-843c-f249dd7e2997}, {specParams={}, device=ich6, type=sound, deviceId=0a2b79d5-7ec0-4332-ba96-a0cb42debe18}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=a5e88e4c-ec53-4866-84bb-c1cf40e16ade}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=bbb3e7e6-0f2c-470a-96ee-ec4e072b27f5}, {specParams={}, device=virtio-serial, type=controller, deviceId=9c12b39a-fbe2-459a-9e79-b5821b467290}],vmName=zzz,cpuType=SandyBridge,fileTransferEnable=true >2014-10-08 16:33:39,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] FINISH, CreateVmFromCloudInitVDSCommand, log id: 77259648 >2014-10-08 16:33:39,458 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2d6471d9 >2014-10-08 16:33:39,458 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-7-thread-3) [67786b61] Lock freed to object EngineLock [exclusiveLocks= key: 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 value: VM >, sharedLocks= ] >2014-10-08 16:33:39,462 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-3) [67786b61] Correlation ID: 67786b61, Job ID: 7895d03b-74e5-4846-87f1-6efa3a601846, Call Stack: null, Custom Event ID: -1, Message: VM zzz was started by admin (Host: dell-r210ii-04). >2014-10-08 16:33:41,557 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) VM zzz 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 moved from WaitForLaunch --> PoweringUp >2014-10-08 16:33:41,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) START, FullListVdsCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vds=Host[dell-r210ii-04,9aae4e31-3100-4932-84f8-1b6cf11ec8a5], vmIds=[9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3]), log id: a8c350f >2014-10-08 16:33:41,569 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, pid=14988, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=5900, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, pauseCode=NOERR, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=zzz, nice=0, status=Up, bootMenuEnable=false, vmId=9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3, copyPasteEnable=true, displayIp=10.34.63.223, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@7aef7131, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: a8c350f >2014-10-08 16:33:41,571 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) Received a spice Device without an address when processing VM 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 devices, skipping device: {device=spice, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, copyPasteEnable=true, keyMap=en-us, displayIp=10.34.63.223, displayNetwork=rhevm}, deviceType=graphics, type=graphics, tlsPort=5900} >2014-10-08 16:34:42,244 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) VM zzz 9d05d30a-a11d-4cc6-ab2d-47b08b07c4e3 moved from PoweringUp --> Up >2014-10-08 16:34:42,259 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) Correlation ID: 67786b61, Job ID: 7895d03b-74e5-4846-87f1-6efa3a601846, Call Stack: null, Custom Event ID: -1, Message: VM zzz started on Host dell-r210ii-04 >2014-10-08 16:34:53,087 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) Setting new tasks map. The map contains now 0 tasks >2014-10-08 16:34:53,087 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-08 16:35:12,238 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginUserCommand internal: false. >2014-10-08 16:35:12,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-08 16:37:52,286 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-08 16:46:10,797 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-4) [7db1ddd1] Lock Acquired to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 16:46:11,058 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-7-thread-7) [7db1ddd1] Running command: MigrateVmCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group MIGRATE_VM with role type USER >2014-10-08 16:46:11,203 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-7-thread-7) [7db1ddd1] START, MigrateVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, srcHost=10.34.63.222, dstVdsId=9aae4e31-3100-4932-84f8-1b6cf11ec8a5, dstHost=10.34.63.223:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 67b6ab34 >2014-10-08 16:46:11,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-7-thread-7) [7db1ddd1] START, MigrateBrokerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, srcHost=10.34.63.222, dstVdsId=9aae4e31-3100-4932-84f8-1b6cf11ec8a5, dstHost=10.34.63.223:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1753fe45 >2014-10-08 16:46:11,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-7-thread-7) [7db1ddd1] FINISH, MigrateBrokerVDSCommand, log id: 1753fe45 >2014-10-08 16:46:11,306 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-7-thread-7) [7db1ddd1] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 67b6ab34 >2014-10-08 16:46:11,313 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-7) [7db1ddd1] Correlation ID: 7db1ddd1, Job ID: 4ff034a0-ea69-4198-8d73-b748ce5917bd, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: sles11, Source: dell-r210ii-03, Destination: dell-r210ii-04, User: admin). >2014-10-08 16:46:11,917 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:14,945 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) [337326ad] RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:17,971 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-35) [30606a26] RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:21,025 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-61) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:24,097 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:27,128 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-37) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:30,156 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:33,198 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-94) [60a6dc9e] RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:36,237 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:39,299 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-80) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-04 ignoring it in the refresh until migration is done >2014-10-08 16:46:42,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-34) START, FullListVdsCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vds=Host[dell-r210ii-04,9aae4e31-3100-4932-84f8-1b6cf11ec8a5], vmIds=[63d1ebb8-3614-4685-8ea6-a022d8725e1d]), log id: 310a0e90 >2014-10-08 16:46:42,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-34) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=sles11, nice=0, status=Up, bootMenuEnable=false, pid=17748, copyPasteEnable=true, displayIp=10.34.63.223, displayPort=-1, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=rhevm, devices=[Ljava.lang.Object;@b422917, timeOffset=-30, maxVCpus=16, clientIp=, display=qxl}], log id: 310a0e90 >2014-10-08 16:46:42,345 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-34) Received a spice Device without an address when processing VM 63d1ebb8-3614-4685-8ea6-a022d8725e1d devices, skipping device: {device=spice, specParams={displayNetwork=rhevm, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=10.34.63.223, copyPasteEnable=true}, deviceType=graphics, tlsPort=5901, type=graphics} >2014-10-08 16:46:42,422 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-34) Correlation ID: 7db1ddd1, Job ID: 4ff034a0-ea69-4198-8d73-b748ce5917bd, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: sles11, Source: dell-r210ii-03, Destination: dell-r210ii-04, Duration: 31 seconds). >2014-10-08 16:46:42,427 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-34) Lock freed to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 16:46:44,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-21) START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=), log id: 5ea4a3b3 >2014-10-08 16:46:44,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, DestroyVDSCommand, log id: 5ea4a3b3 >2014-10-08 16:46:44,428 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-21) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d status = Down on vds dell-r210ii-03 ignoring it in the refresh until migration is done >2014-10-08 17:00:41,550 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-1) [373fc491] Lock Acquired to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 17:00:41,687 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-7-thread-45) [373fc491] Running command: MigrateVmCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group MIGRATE_VM with role type USER >2014-10-08 17:00:43,548 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-7-thread-45) [373fc491] START, MigrateVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, srcHost=10.34.63.223, dstVdsId=04f67d65-72bc-4ddc-88b7-81d0053dff0b, dstHost=10.34.63.222:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 52aa797c >2014-10-08 17:00:43,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-7-thread-45) [373fc491] START, MigrateBrokerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, srcHost=10.34.63.223, dstVdsId=04f67d65-72bc-4ddc-88b7-81d0053dff0b, dstHost=10.34.63.222:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 34300148 >2014-10-08 17:00:43,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-7-thread-45) [373fc491] FINISH, MigrateBrokerVDSCommand, log id: 34300148 >2014-10-08 17:00:43,561 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-7-thread-45) [373fc491] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 52aa797c >2014-10-08 17:00:43,569 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-45) [373fc491] Correlation ID: 373fc491, Job ID: 2d7c8a65-2bd8-4227-a33a-c377d19025e3, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: sles11, Source: dell-r210ii-04, Destination: dell-r210ii-03, User: admin). >2014-10-08 17:00:43,748 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d is migrating to vds dell-r210ii-03 ignoring it in the refresh until migration is done >2014-10-08 17:00:46,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-54) [6f0544fd] START, DestroyVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=), log id: 3524a45 >2014-10-08 17:00:46,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-54) [6f0544fd] FINISH, DestroyVDSCommand, log id: 3524a45 >2014-10-08 17:00:46,862 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Lock freed to object EngineLock [exclusiveLocks= key: 63d1ebb8-3614-4685-8ea6-a022d8725e1d value: VM >, sharedLocks= ] >2014-10-08 17:00:46,865 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) [6f0544fd] RefreshVmList vm id 63d1ebb8-3614-4685-8ea6-a022d8725e1d status = Down on vds dell-r210ii-03 ignoring it in the refresh until migration is done >2014-10-08 17:01:24,087 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) VM sles11 63d1ebb8-3614-4685-8ea6-a022d8725e1d moved from MigratingFrom --> Up >2014-10-08 17:01:24,087 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) Adding VM 63d1ebb8-3614-4685-8ea6-a022d8725e1d to re-run list >2014-10-08 17:01:24,127 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) Rerun vm 63d1ebb8-3614-4685-8ea6-a022d8725e1d. Called from vds dell-r210ii-04 >2014-10-08 17:19:48,373 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-24) Deactivating non existing principal admin::internal >2014-10-08 17:19:58,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-10-08 17:20:01,864 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-59) [9e37103] Lock Acquired to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 17:20:01,867 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-59) [9e37103] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 17:20:02,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [9e37103] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 77f3cbf6 >2014-10-08 17:20:02,774 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [9e37103] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 17:20:02,774 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [9e37103] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Wed Oct 08 16:19:53 CEST 2014"} > >2014-10-08 17:20:02,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [9e37103] FINISH, SetVolumeDescriptionVDSCommand, log id: 77f3cbf6 >2014-10-08 17:20:03,411 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] Running command: UploadStreamCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 17:20:03,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] START, UploadStreamVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 707c2818 >2014-10-08 17:20:03,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] -- executeVdsBrokerCommand: >2014-10-08 17:20:03,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > size=20,480 > >2014-10-08 17:20:05,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] FINISH, UploadStreamVDSCommand, log id: 707c2818 >2014-10-08 17:20:05,817 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-59) [224d636c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 156f6fe3-7d4b-4796-921d-45d36c0dfb70 >2014-10-08 17:20:05,817 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-59) [224d636c] CommandMultiAsyncTasks::AttachTask: Attaching task 68c4ca6b-bd87-44ee-bc45-6b818537b319 to command 156f6fe3-7d4b-4796-921d-45d36c0dfb70. >2014-10-08 17:20:05,877 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-59) [224d636c] Adding task 68c4ca6b-bd87-44ee-bc45-6b818537b319 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 17:20:05,910 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] Lock freed to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 17:20:05,915 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614, imageId = 0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740), log id: 34446c35 >2014-10-08 17:20:05,916 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 17:20:05,916 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 > volUUID=0eb88fe7-1f13-4e3e-b5fb-3b1e5d20e740 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Wed Oct 08 17:20:01 CEST 2014","Size":20480} > >2014-10-08 17:20:06,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] FINISH, SetVolumeDescriptionVDSCommand, log id: 34446c35 >2014-10-08 17:20:06,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 6b3f2cca >2014-10-08 17:20:06,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 17:20:06,079 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Wed Oct 08 16:19:53 CEST 2014"} > >2014-10-08 17:20:06,231 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [224d636c] FINISH, SetVolumeDescriptionVDSCommand, log id: 6b3f2cca >2014-10-08 17:20:06,293 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] Running command: UploadStreamCommand internal: true. Entities affected : ID: 322e3360-066e-4e98-a0e9-dd44e82f0992 Type: Storage >2014-10-08 17:20:06,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] START, UploadStreamVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 570e9696 >2014-10-08 17:20:06,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] -- executeVdsBrokerCommand: >2014-10-08 17:20:06,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > size=20,480 > >2014-10-08 17:20:08,576 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] FINISH, UploadStreamVDSCommand, log id: 570e9696 >2014-10-08 17:20:08,589 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-59) [4b41709] CommandMultiAsyncTasks::AttachTask: Attaching task 2edf4411-1210-4103-a419-73b38c16f829 to command 156f6fe3-7d4b-4796-921d-45d36c0dfb70. >2014-10-08 17:20:08,599 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-59) [4b41709] Adding task 2edf4411-1210-4103-a419-73b38c16f829 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-08 17:20:08,605 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [4b41709] Trying to release a shared lock for key: 00000002-0002-0002-0002-0000000001f1OVF_UPDATE , but lock does not exist >2014-10-08 17:20:08,606 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [4b41709] Trying to release exclusive lock which does not exist, lock key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614DISK >2014-10-08 17:20:08,606 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [4b41709] Trying to release exclusive lock which does not exist, lock key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3DISK >2014-10-08 17:20:08,606 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [4b41709] Trying to release exclusive lock which does not exist, lock key: 322e3360-066e-4e98-a0e9-dd44e82f0992STORAGE >2014-10-08 17:20:08,606 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] Lock freed to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 17:20:08,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = 322e3360-066e-4e98-a0e9-dd44e82f0992, imageGroupId = 281b641f-ab6a-49f5-a9ab-32164c2a47c3, imageId = 31dca8b6-1eb2-4431-8dc6-49ead49c57b8), log id: 365b2f05 >2014-10-08 17:20:08,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-08 17:20:08,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=322e3360-066e-4e98-a0e9-dd44e82f0992 > imageGroupGUID=281b641f-ab6a-49f5-a9ab-32164c2a47c3 > volUUID=31dca8b6-1eb2-4431-8dc6-49ead49c57b8 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"322e3360-066e-4e98-a0e9-dd44e82f0992"}],"Last Updated":"Wed Oct 08 17:20:01 CEST 2014","Size":20480} > >2014-10-08 17:20:08,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-59) [4b41709] FINISH, SetVolumeDescriptionVDSCommand, log id: 365b2f05 >2014-10-08 17:20:08,771 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-59) [4b41709] BaseAsyncTask::startPollingTask: Starting to poll task 68c4ca6b-bd87-44ee-bc45-6b818537b319. >2014-10-08 17:20:08,771 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-59) [4b41709] BaseAsyncTask::startPollingTask: Starting to poll task 2edf4411-1210-4103-a419-73b38c16f829. >2014-10-08 17:20:10,148 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-10-08 17:20:10,155 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) [6f0544fd] SPMAsyncTask::PollTask: Polling task 68c4ca6b-bd87-44ee-bc45-6b818537b319 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 17:20:10,155 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) [6f0544fd] BaseAsyncTask::onTaskEndSuccess: Task 68c4ca6b-bd87-44ee-bc45-6b818537b319 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 17:20:10,156 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-54) [6f0544fd] Task with DB Task ID dc5eac69-6880-4ea9-8610-5f116f1935ff and VDSM Task ID 2edf4411-1210-4103-a419-73b38c16f829 is in state Polling. End action for command 156f6fe3-7d4b-4796-921d-45d36c0dfb70 will proceed when all the entitys tasks are completed. >2014-10-08 17:20:10,156 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) [6f0544fd] SPMAsyncTask::PollTask: Polling task 2edf4411-1210-4103-a419-73b38c16f829 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-08 17:20:10,156 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) [6f0544fd] BaseAsyncTask::onTaskEndSuccess: Task 2edf4411-1210-4103-a419-73b38c16f829 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-08 17:20:10,160 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-54) [6f0544fd] CommandAsyncTask::endActionIfNecessary: All tasks of command 156f6fe3-7d4b-4796-921d-45d36c0dfb70 has ended -> executing endAction >2014-10-08 17:20:10,160 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-54) [6f0544fd] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 156f6fe3-7d4b-4796-921d-45d36c0dfb70): calling endAction . >2014-10-08 17:20:10,160 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-17) [6f0544fd] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-10-08 17:20:10,320 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-10-08 17:20:10,321 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-17) [9e37103] Trying to release a shared lock for key: 00000002-0002-0002-0002-0000000001f1OVF_UPDATE , but lock does not exist >2014-10-08 17:20:10,321 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-17) [9e37103] Trying to release exclusive lock which does not exist, lock key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614DISK >2014-10-08 17:20:10,321 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-17) [9e37103] Trying to release exclusive lock which does not exist, lock key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3DISK >2014-10-08 17:20:10,321 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-7-thread-17) [9e37103] Trying to release exclusive lock which does not exist, lock key: 322e3360-066e-4e98-a0e9-dd44e82f0992STORAGE >2014-10-08 17:20:10,321 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] Lock freed to object EngineLock [exclusiveLocks= key: 9634c5d4-55a2-4ded-a9cf-ed9a76b8a614 value: DISK >key: 281b641f-ab6a-49f5-a9ab-32164c2a47c3 value: DISK >key: 322e3360-066e-4e98-a0e9-dd44e82f0992 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-08 17:20:10,321 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-10-08 17:20:10,321 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-10-08 17:20:10,321 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 68c4ca6b-bd87-44ee-bc45-6b818537b319 >2014-10-08 17:20:10,322 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 68c4ca6b-bd87-44ee-bc45-6b818537b319), log id: 55d9f8c3 >2014-10-08 17:20:10,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=68c4ca6b-bd87-44ee-bc45-6b818537b319), log id: 595af63d >2014-10-08 17:20:10,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] FINISH, HSMClearTaskVDSCommand, log id: 595af63d >2014-10-08 17:20:10,371 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] FINISH, SPMClearTaskVDSCommand, log id: 55d9f8c3 >2014-10-08 17:20:10,375 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] BaseAsyncTask::removeTaskFromDB: Removed task 68c4ca6b-bd87-44ee-bc45-6b818537b319 from DataBase >2014-10-08 17:20:10,375 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2edf4411-1210-4103-a419-73b38c16f829 >2014-10-08 17:20:10,376 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 2edf4411-1210-4103-a419-73b38c16f829), log id: 43784050 >2014-10-08 17:20:10,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=2edf4411-1210-4103-a419-73b38c16f829), log id: bc666cb >2014-10-08 17:20:10,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] FINISH, HSMClearTaskVDSCommand, log id: bc666cb >2014-10-08 17:20:10,421 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-17) [9e37103] FINISH, SPMClearTaskVDSCommand, log id: 43784050 >2014-10-08 17:20:10,467 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] BaseAsyncTask::removeTaskFromDB: Removed task 2edf4411-1210-4103-a419-73b38c16f829 from DataBase >2014-10-08 17:20:10,467 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-17) [9e37103] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 156f6fe3-7d4b-4796-921d-45d36c0dfb70 >2014-10-08 17:21:29,307 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-53) [712dcc3c] Setting new tasks map. The map contains now 0 tasks >2014-10-08 17:21:29,307 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-53) [712dcc3c] Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-08 18:20:08,772 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-10-08 19:20:09,644 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-10-08 20:20:10,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-10-08 21:20:10,285 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-10-08 22:20:11,006 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [4ad5eafc] Attempting to update VMs/Templates Ovf. >2014-10-08 23:20:11,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-10-09 00:20:11,582 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-10-09 00:30:11,385 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginUserCommand internal: false. >2014-10-09 00:30:11,628 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-09 00:30:45,673 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [1334c4fd] Running command: LogoutUserCommand internal: false. >2014-10-09 00:30:45,679 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-4) [3f1bea0c] Running command: LogoutUserCommand internal: false. >2014-10-09 00:30:45,800 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-11) [18942e9d] Running command: LogoutUserCommand internal: false. >2014-10-09 00:30:45,800 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-5) [18942e9d] Running command: LogoutUserCommand internal: false. >2014-10-09 00:30:45,823 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [19ca4f1e] Running command: LogoutUserCommand internal: false. >2014-10-09 00:30:45,831 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-7) [3a720345] Running command: LogoutUserCommand internal: false. >2014-10-09 00:30:45,915 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [19ca4f1e] Correlation ID: 19ca4f1e, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 00:30:45,947 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [1334c4fd] Correlation ID: 1334c4fd, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 00:30:45,949 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [18942e9d] Correlation ID: 18942e9d, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 00:30:46,012 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [3f1bea0c] Correlation ID: 3f1bea0c, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 00:30:46,205 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [18942e9d] Correlation ID: 18942e9d, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 00:30:46,245 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3a720345] Correlation ID: 3a720345, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 00:30:46,273 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-10) Invalid locale found in configuration: >2014-10-09 00:30:46,274 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-10) Invalid locale found in configuration: >2014-10-09 01:19:48,608 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-14) Deactivating non existing principal admin::internal >2014-10-09 01:20:12,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-10-09 02:20:12,287 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-10-09 03:20:12,479 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [7356de8d] Attempting to update VMs/Templates Ovf. >2014-10-09 03:35:35,018 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-21) Start deleteAgedOutCommandEntities >2014-10-09 03:35:35,019 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-32) Start deleteAgedOutAuditLogs >2014-10-09 03:35:35,112 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-32) Finished deleteAgedOutAuditLogs >2014-10-09 03:35:35,225 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-21) Finished deleteAgedOutCommandEntities >2014-10-09 04:20:12,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [196151bd] Attempting to update VMs/Templates Ovf. >2014-10-09 05:20:12,639 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-10-09 06:20:12,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) [712dcc3c] Attempting to update VMs/Templates Ovf. >2014-10-09 07:20:12,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-10-09 08:20:12,847 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-10-09 09:20:12,937 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-10-09 10:20:13,536 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-10-09 10:22:43,467 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginAdminUserCommand internal: false. >2014-10-09 10:22:43,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-09 10:22:43,806 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginUserCommand internal: false. >2014-10-09 10:23:17,867 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-4) [4e0b4502] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONNECT_TO_VM with role type USER >2014-10-09 10:23:18,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [4e0b4502] START, SetVmTicketVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, ticket=zlXquTi66b8G, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5e592900 >2014-10-09 10:23:18,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [4e0b4502] FINISH, SetVmTicketVDSCommand, log id: 5e592900 >2014-10-09 10:23:18,511 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [4e0b4502] Correlation ID: 4e0b4502, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM sles11 >2014-10-09 10:23:23,316 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin is connected to VM sles11. >2014-10-09 10:32:03,514 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-46) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin got disconnected from VM sles11. >2014-10-09 10:33:46,014 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [53cefcfb] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export value: STORAGE_CONNECTION >, sharedLocks= ] >2014-10-09 10:33:46,278 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [53cefcfb] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:33:46,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [53cefcfb] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 22b400e4 >2014-10-09 10:33:46,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [53cefcfb] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 22b400e4 >2014-10-09 10:33:46,784 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [53cefcfb] Lock freed to object EngineLock [exclusiveLocks= key: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export value: STORAGE_CONNECTION >, sharedLocks= ] >2014-10-09 10:33:46,834 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp-/127.0.0.1:8702-2) START, GetExistingStorageDomainListQuery(refresh: true, filtered: false), log id: 33979046 >2014-10-09 10:33:47,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-2) START, HSMGetStorageDomainsListVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=NFS, storageDomainType=ImportExport, path=10.34.63.202:/mnt/export/nfs/lv1/jbelka/export), log id: 49a38e56 >2014-10-09 10:33:47,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, HSMGetStorageDomainsListVDSCommand, return: [ca414eb9-98ab-422f-8c4e-c2c513231058], log id: 49a38e56 >2014-10-09 10:33:59,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-2) START, HSMGetStorageDomainInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 24440390 >2014-10-09 10:33:59,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, HSMGetStorageDomainInfoVDSCommand, return: <StorageDomainStatic[str-01-jbelka-export, ca414eb9-98ab-422f-8c4e-c2c513231058], 00000002-0002-0002-0002-000000000214>, log id: 24440390 >2014-10-09 10:33:59,593 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp-/127.0.0.1:8702-2) FINISH, GetExistingStorageDomainListQuery, log id: 33979046 >2014-10-09 10:34:00,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-4) [39ced182] START, HSMGetStorageDomainsListVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=NFS, storageDomainType=ImportExport, path=), log id: 69399171 >2014-10-09 10:34:00,576 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-4) [39ced182] FINISH, HSMGetStorageDomainsListVDSCommand, return: [ca414eb9-98ab-422f-8c4e-c2c513231058], log id: 69399171 >2014-10-09 10:34:00,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-4) [39ced182] START, HSMGetStorageDomainInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 44bf3e0b >2014-10-09 10:34:00,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-4) [39ced182] FINISH, HSMGetStorageDomainInfoVDSCommand, return: <StorageDomainStatic[str-01-jbelka-export, ca414eb9-98ab-422f-8c4e-c2c513231058], 00000002-0002-0002-0002-000000000214>, log id: 44bf3e0b >2014-10-09 10:34:00,640 INFO [org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand] (ajp-/127.0.0.1:8702-4) [39ced182] Running command: AddExistingFileStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:34:00,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-4) [39ced182] START, GetStorageDomainStatsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 5dff1165 >2014-10-09 10:34:00,778 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-4) [39ced182] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, ca414eb9-98ab-422f-8c4e-c2c513231058], log id: 5dff1165 >2014-10-09 10:34:00,992 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [39ced182] Correlation ID: 39ced182, Job ID: abbdc0c9-7bf7-4274-82d9-e23757f70a5c, Call Stack: null, Custom Event ID: -1, Message: Storage Domain str-01-jbelka-export was added by admin >2014-10-09 10:34:01,245 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-10) [74074352] Lock Acquired to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:34:01,315 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-10) [74074352] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: ca414eb9-98ab-422f-8c4e-c2c513231058 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:34:01,576 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-30) [4d766d85] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:34:01,664 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-24) [22a66017] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:34:01,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-30) [4d766d85] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 182e75c7 >2014-10-09 10:34:01,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-30) [4d766d85] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 182e75c7 >2014-10-09 10:34:01,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-24) [22a66017] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4113759f >2014-10-09 10:34:01,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-24) [22a66017] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 4113759f >2014-10-09 10:34:01,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-10) [74074352] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 21738d12 >2014-10-09 10:34:05,105 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-10) [74074352] Command AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=ca414eb9-98ab-422f-8c4e-c2c513231058, pool=00000002-0002-0002-0002-000000000214' >2014-10-09 10:34:05,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-10) [74074352] FINISH, AttachStorageDomainVDSCommand, log id: 21738d12 >2014-10-09 10:34:05,124 ERROR [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-10) [74074352] Command org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=ca414eb9-98ab-422f-8c4e-c2c513231058, pool=00000002-0002-0002-0002-000000000214' (Failed with error StorageDomainAlreadyAttached and code 380) >2014-10-09 10:34:05,867 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-10) [74074352] Command [id=3d2d3791-bd4d-404f-8dba-802e2a5a8c61]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageId = ca414eb9-98ab-422f-8c4e-c2c513231058. >2014-10-09 10:34:05,920 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [74074352] Correlation ID: 74074352, Job ID: 6c1792af-71ae-40a9-a549-ba059b37b512, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domain str-01-jbelka-export to Data Center Default. (User: admin) >2014-10-09 10:34:06,050 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-10) [74074352] Lock freed to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:35:37,564 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-2) [57d77da] Lock Acquired to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:35:37,732 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: ca414eb9-98ab-422f-8c4e-c2c513231058 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:35:37,934 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-4) [475dc01f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:35:37,959 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-13) [16c4f725] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:35:37,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-13) [16c4f725] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 16a4ec52 >2014-10-09 10:35:38,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-4) [475dc01f] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 404d991d >2014-10-09 10:35:38,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-13) [16c4f725] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 16a4ec52 >2014-10-09 10:35:38,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-4) [475dc01f] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 404d991d >2014-10-09 10:35:38,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 5047a4d9 >2014-10-09 10:35:41,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, AttachStorageDomainVDSCommand, log id: 5047a4d9 >2014-10-09 10:35:43,077 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, sdUUID = ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 1ecf4af >2014-10-09 10:35:43,111 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImagesListVDSCommand, return: [72a7a6c9-2b91-4824-bd0a-62e19cfad558, 862fb823-ad51-4b5f-9224-ecd9c193c5a4, 631781c0-b748-4700-b64d-037c625068ba, e13125ff-7b57-4116-9d96-4fb7278d467d, 5110d7ae-3bf5-4ea9-ac7a-46ffcd052bda, eb009c10-407a-4d1b-a524-6f8cd85e801e, 9a16da79-48b4-4c5b-8924-deb799b14e85, 6d88b5a1-fafd-4210-8127-216b72792a91, 83bf524e-1a2a-4298-9f06-21334dfd53e6, b6aed5f3-5445-458a-910b-1ec13588ff35, 8ac5910a-9b90-47c5-bfbe-f6d268c32045, 8063d930-0ad1-40cd-b84c-c12963674985, 4f05c6bc-ccca-416d-a780-d22ab5452b7c, 39fa54cd-b398-4d00-b745-1ba59814a2e8, 14f8de7c-6c67-496a-8998-6ddbeb8db64d, af5fb35b-7d6d-4078-9dd6-cb23f1747b48, c75e3d97-290f-4ed8-a6fa-4ab97d0557f6, f5e64b06-eb84-4fae-a2ce-1406a4993cb2, b1458ed0-be35-47f8-aac6-f6f9a2560565, 5638bd36-562e-4395-8f02-af6ef1d11111, 2e1ccf37-137a-4f19-bc66-d8687119e4a2], log id: 1ecf4af >2014-10-09 10:35:45,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 72a7a6c9-2b91-4824-bd0a-62e19cfad558), log id: 7752de0d >2014-10-09 10:35:45,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [4d8fed1c-2bf5-459a-af9a-0dc18586688e, 27197bad-d5b5-49d2-ab2a-fe91c73d766e, 3690a59b-f813-4b11-a515-ed4dc1a6d23b], log id: 7752de0d >2014-10-09 10:35:45,310 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:46,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 862fb823-ad51-4b5f-9224-ecd9c193c5a4), log id: 7a2ad96a >2014-10-09 10:35:46,275 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [b2177eb2-5343-4acd-9eaf-afa5ebec09bd], log id: 7a2ad96a >2014-10-09 10:35:46,275 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 862fb823-ad51-4b5f-9224-ecd9c193c5a4, imageId = b2177eb2-5343-4acd-9eaf-afa5ebec09bd), log id: 1327fccf >2014-10-09 10:35:46,332 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fb970b28, log id: 1327fccf >2014-10-09 10:35:46,338 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 631781c0-b748-4700-b64d-037c625068ba), log id: 22e9d572 >2014-10-09 10:35:46,374 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [5f89ae09-fae6-406f-9346-10796a2c1d9e, d023859b-36ae-4078-8cdb-40cb63a80f53], log id: 22e9d572 >2014-10-09 10:35:46,375 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:47,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = e13125ff-7b57-4116-9d96-4fb7278d467d), log id: 4c90cde6 >2014-10-09 10:35:47,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [70aefd2e-8809-4931-a691-7ddfa4f7c1a8, 532d1324-f812-4338-9387-344a8a3718ef, a8a53be6-07ac-4e98-b75d-a1566b2c2d16], log id: 4c90cde6 >2014-10-09 10:35:47,204 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:49,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 5110d7ae-3bf5-4ea9-ac7a-46ffcd052bda), log id: 576d7105 >2014-10-09 10:35:49,681 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [e79086a1-8b7a-4515-bacf-8d872ca36f38, 744428a4-f4e7-4467-ba69-4e534431681e], log id: 576d7105 >2014-10-09 10:35:49,681 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:52,415 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = eb009c10-407a-4d1b-a524-6f8cd85e801e), log id: 7a50250d >2014-10-09 10:35:52,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [b07e0beb-3cee-4ecd-9d5c-ee2deabdbdb4, 320b1021-85b1-4fcb-96f8-4db740a348aa, d59e77c9-593d-4496-b77d-c63f8c7a8ed7], log id: 7a50250d >2014-10-09 10:35:52,789 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:52,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 9a16da79-48b4-4c5b-8924-deb799b14e85), log id: 4278d01d >2014-10-09 10:35:52,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [c8bd4341-d4d1-411d-8e66-c476ebf6f286, 5084a5ef-7107-4501-aeb1-cf0f646f1692, cacc88e7-33cc-4d9d-a62e-6a3afb5ca83f], log id: 4278d01d >2014-10-09 10:35:52,803 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 6d88b5a1-fafd-4210-8127-216b72792a91), log id: 6ad74575 >2014-10-09 10:35:53,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [547aadbc-9133-415c-964e-49ff08150835, c2e4bf8f-d933-4347-994b-a53db107296a, 030e5c08-d241-4fb3-9654-eb3770bb219a], log id: 6ad74575 >2014-10-09 10:35:53,600 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 83bf524e-1a2a-4298-9f06-21334dfd53e6), log id: 4d76b54e >2014-10-09 10:35:53,615 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [73613eed-c8e0-46dc-b446-f638d48066ef], log id: 4d76b54e >2014-10-09 10:35:53,615 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 83bf524e-1a2a-4298-9f06-21334dfd53e6, imageId = 73613eed-c8e0-46dc-b446-f638d48066ef), log id: 2c793b9d >2014-10-09 10:35:53,652 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@b456cd87, log id: 2c793b9d >2014-10-09 10:35:53,656 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = b6aed5f3-5445-458a-910b-1ec13588ff35), log id: 16e52b65 >2014-10-09 10:35:53,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [21f39f63-4464-41f3-be09-288271b90218, dc7d7236-70ea-4687-b026-9c8d7b6d5e3a, 2c9bfa94-26a0-4f59-a2a5-53ca2dfc8f9f], log id: 16e52b65 >2014-10-09 10:35:53,667 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,672 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 8ac5910a-9b90-47c5-bfbe-f6d268c32045), log id: 14cb8c27 >2014-10-09 10:35:53,682 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [212a5369-95b3-40db-bc5d-0f114c7a3976, eb499557-89ff-43d0-ab0d-666242043f95], log id: 14cb8c27 >2014-10-09 10:35:53,682 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,687 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 8063d930-0ad1-40cd-b84c-c12963674985), log id: 25d65836 >2014-10-09 10:35:53,698 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [3339b7de-b58a-4408-9e8e-93638ffb94f6, 8226f0c5-0c12-4f91-9d75-4b431c300593, 6c12a8c3-8d5d-44b0-a2b2-e27913d42810], log id: 25d65836 >2014-10-09 10:35:53,698 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,702 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 4f05c6bc-ccca-416d-a780-d22ab5452b7c), log id: 181fd034 >2014-10-09 10:35:53,712 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [358c09ba-1369-4f9d-b280-fde9ca1e8c16], log id: 181fd034 >2014-10-09 10:35:53,712 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 4f05c6bc-ccca-416d-a780-d22ab5452b7c, imageId = 358c09ba-1369-4f9d-b280-fde9ca1e8c16), log id: 509e124b >2014-10-09 10:35:53,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@c000f20a, log id: 509e124b >2014-10-09 10:35:53,749 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 39fa54cd-b398-4d00-b745-1ba59814a2e8), log id: 4a7b0dcc >2014-10-09 10:35:53,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [58975196-779a-42c9-9769-4b00dbdd1b2c, 41e0e4f4-c35a-483d-8941-9c73b8af5a3b, 552d2051-b548-471d-96c1-555492ec3cf3], log id: 4a7b0dcc >2014-10-09 10:35:53,761 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 14f8de7c-6c67-496a-8998-6ddbeb8db64d), log id: 2cf96777 >2014-10-09 10:35:53,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [5de1dbbf-0240-404b-b25d-0367e1f0aa83, e6fcfb72-9806-4c1d-9a01-82676616f039, 2389be64-f801-4a76-9d5f-5ecf0dbbd0a1], log id: 2cf96777 >2014-10-09 10:35:53,777 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,784 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = af5fb35b-7d6d-4078-9dd6-cb23f1747b48), log id: 2fe77a0b >2014-10-09 10:35:53,818 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [0c61e6c4-0ad6-48da-a1ad-4d295270c109], log id: 2fe77a0b >2014-10-09 10:35:53,818 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = af5fb35b-7d6d-4078-9dd6-cb23f1747b48, imageId = 0c61e6c4-0ad6-48da-a1ad-4d295270c109), log id: 5fd80bf >2014-10-09 10:35:53,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@d330c74a, log id: 5fd80bf >2014-10-09 10:35:53,842 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = c75e3d97-290f-4ed8-a6fa-4ab97d0557f6), log id: 77790180 >2014-10-09 10:35:53,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [73153f2c-61e3-4ea1-858b-9f68eb4cbb7c], log id: 77790180 >2014-10-09 10:35:53,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = c75e3d97-290f-4ed8-a6fa-4ab97d0557f6, imageId = 73153f2c-61e3-4ea1-858b-9f68eb4cbb7c), log id: 2951b7c7 >2014-10-09 10:35:53,873 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@72d87bd7, log id: 2951b7c7 >2014-10-09 10:35:53,877 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = f5e64b06-eb84-4fae-a2ce-1406a4993cb2), log id: 7a0d201f >2014-10-09 10:35:53,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [720f303b-20f9-4125-bff8-10472a195bf8], log id: 7a0d201f >2014-10-09 10:35:53,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = f5e64b06-eb84-4fae-a2ce-1406a4993cb2, imageId = 720f303b-20f9-4125-bff8-10472a195bf8), log id: 73b811d2 >2014-10-09 10:35:53,937 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9979f7f1, log id: 73b811d2 >2014-10-09 10:35:53,942 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = b1458ed0-be35-47f8-aac6-f6f9a2560565), log id: 233d3661 >2014-10-09 10:35:53,953 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [97d80628-4e9d-4427-af8a-b6bfd043d995], log id: 233d3661 >2014-10-09 10:35:53,953 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = b1458ed0-be35-47f8-aac6-f6f9a2560565, imageId = 97d80628-4e9d-4427-af8a-b6bfd043d995), log id: 7bd2c5a >2014-10-09 10:35:53,973 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fe125450, log id: 7bd2c5a >2014-10-09 10:35:53,977 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 5638bd36-562e-4395-8f02-af6ef1d11111), log id: 75d161c >2014-10-09 10:35:53,989 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [], log id: 75d161c >2014-10-09 10:35:53,989 ERROR [org.ovirt.engine.core.bll.GetUnregisteredDisksQuery] (org.ovirt.thread.pool-7-thread-21) [57d77da] Could not get populated disk, reason: null >2014-10-09 10:35:53,994 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 2e1ccf37-137a-4f19-bc66-d8687119e4a2), log id: 1bd1dfa9 >2014-10-09 10:35:54,005 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetVolumesListVDSCommand, return: [39a9f7a4-a6a2-4347-be98-b322ca3cefa7], log id: 1bd1dfa9 >2014-10-09 10:35:54,005 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 2e1ccf37-137a-4f19-bc66-d8687119e4a2, imageId = 39a9f7a4-a6a2-4347-be98-b322ca3cefa7), log id: 6fb2de83 >2014-10-09 10:35:54,029 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-21) [57d77da] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@dcf8e706, log id: 6fb2de83 >2014-10-09 10:35:54,038 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-7-thread-21) There are no OVF_STORE disks on storage domain id ca414eb9-98ab-422f-8c4e-c2c513231058 >2014-10-09 10:35:54,063 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-21) [69a0afdd] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:35:54,063 WARN [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-21) [69a0afdd] CanDoAction of action ActivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ACTIVATE,ACTION_TYPE_FAILED_OBJECT_LOCKED >2014-10-09 10:35:54,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-21) [69a0afdd] Correlation ID: 57d77da, Job ID: 1e1b0e75-b3b7-4a4b-819f-4d779aeb11f6, Call Stack: null, Custom Event ID: -1, Message: Storage Domain str-01-jbelka-export was attached to Data Center Default by admin >2014-10-09 10:35:54,159 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-7-thread-21) [69a0afdd] Lock freed to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:36:00,910 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-31) Adding domain ca414eb9-98ab-422f-8c4e-c2c513231058 to the domains in maintenance cache >2014-10-09 10:36:15,374 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [14284dc7] Lock Acquired to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:36:49,445 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: ca414eb9-98ab-422f-8c4e-c2c513231058 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:36:49,595 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] Lock freed to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 10:36:49,676 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/9/14 10:36 AM >2014-10-09 10:36:50,458 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-26) [3d0f79d6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:36:50,511 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-38) [60791aa0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:36:50,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-38) [60791aa0] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3183b749 >2014-10-09 10:36:50,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-38) [60791aa0] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 3183b749 >2014-10-09 10:36:50,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-26) [3d0f79d6] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7b872bc7 >2014-10-09 10:36:50,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-26) [3d0f79d6] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 7b872bc7 >2014-10-09 10:36:50,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058), log id: 2a719e66 >2014-10-09 10:36:51,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 2a719e66 >2014-10-09 10:36:51,138 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] ActivateStorage Domain. After Connect all hosts to pool. Time:10/9/14 10:36 AM >2014-10-09 10:36:52,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-22) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: f7b450d >2014-10-09 10:36:52,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-22) FINISH, ConnectStoragePoolVDSCommand, log id: f7b450d >2014-10-09 10:36:52,957 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-22) Refreshed vds dell-r210ii-03 in pool Default >2014-10-09 10:36:54,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-13) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 41dbf8d5 >2014-10-09 10:36:55,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-13) FINISH, ConnectStoragePoolVDSCommand, log id: 41dbf8d5 >2014-10-09 10:36:55,207 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-13) Refreshed vds dell-r210ii-04 in pool Default >2014-10-09 10:36:55,207 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-15) [14284dc7] ActivateStorage Domain. After change storage pool status in vds. Time:10/9/14 10:36 AM >2014-10-09 10:36:55,351 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-15) [14284dc7] Correlation ID: 14284dc7, Job ID: 29a26962-fd99-40dd-a732-c001ae674226, Call Stack: null, Custom Event ID: -1, Message: Storage Domain str-01-jbelka-export (Data Center Default) was activated by admin >2014-10-09 10:36:57,220 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-29) domain ca414eb9-98ab-422f-8c4e-c2c513231058:str-01-jbelka-export in problem. vds: dell-r210ii-04 >2014-10-09 10:36:57,536 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-29) Removing domain ca414eb9-98ab-422f-8c4e-c2c513231058 from the domains in maintenance cache >2014-10-09 10:37:18,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-8) Domain ca414eb9-98ab-422f-8c4e-c2c513231058:str-01-jbelka-export recovered from problem. vds: dell-r210ii-04 >2014-10-09 10:37:18,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-8) Domain ca414eb9-98ab-422f-8c4e-c2c513231058:str-01-jbelka-export has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2014-10-09 10:42:59,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, vmIdList = null), log id: 4cff4841 >2014-10-09 10:43:00,070 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetVmsInfoVDSCommand, log id: 4cff4841 >2014-10-09 10:46:38,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetDeviceListVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageType=ISCSI), log id: 141831f1 >2014-10-09 10:46:39,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=1jbelka01, physicalVolumeId=FAPoQJ-3Gza-4AbI-vnZL-QSCd-bMrZ-gAHHLz, volumeGroupId=dfUAy1-Hx2l-9dSR-zEYW-z6P1-hhuz-H3yVIi, serial=SRH-str01VIRTUAL-DISK, lunMapping=1, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1jbelka03, physicalVolumeId=I7psqd-CjI2-sGZW-dBaR-JnDp-0ofC-ZrjFS6, volumeGroupId=, serial=SRH-str01VIRTUAL-DISK, lunMapping=3, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=30, vendorName=RH-str01, pathsDictionary={sdd=true}, lunType=ISCSI, status=Free, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=1jbelka02, physicalVolumeId=UhQHVk-Gaqr-Ib0B-LeMf-jwrw-pE83-6yPYtQ, volumeGroupId=9zfBdt-TKUp-YI7f-jaPw-rbAz-zcmI-cTImro, serial=SRH-str01VIRTUAL-DISK, lunMapping=2, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=18, vendorName=RH-str01, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 141831f1 >2014-10-09 10:46:50,785 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [535b8035] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:46:50,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] START, CreateVGVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=e133f938-1bce-4777-b3da-e9f951a377f8, deviceList=[1jbelka03], force=false), log id: 60064a0f >2014-10-09 10:46:51,477 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] FINISH, CreateVGVDSCommand, return: yKxjGv-hU7o-Ge1Q-Ar2O-Q7hi-8wQl-BiOFzH, log id: 60064a0f >2014-10-09 10:46:51,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] START, CreateStorageDomainVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomain=StorageDomainStatic[iscsi-3, e133f938-1bce-4777-b3da-e9f951a377f8], args=yKxjGv-hU7o-Ge1Q-Ar2O-Q7hi-8wQl-BiOFzH), log id: 6bdd19e2 >2014-10-09 10:46:56,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] FINISH, CreateStorageDomainVDSCommand, log id: 6bdd19e2 >2014-10-09 10:46:56,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] START, GetStorageDomainStatsVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=e133f938-1bce-4777-b3da-e9f951a377f8), log id: 657503af >2014-10-09 10:46:56,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, e133f938-1bce-4777-b3da-e9f951a377f8], log id: 657503af >2014-10-09 10:46:57,005 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=yKxjGv-hU7o-Ge1Q-Ar2O-Q7hi-8wQl-BiOFzH), log id: 2e9ccc61 >2014-10-09 10:46:57,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-11) [535b8035] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka03, physicalVolumeId=PEvBVX-KZqc-DzZn-lHGg-RDNq-di1l-yNREnU, volumeGroupId=yKxjGv-hU7o-Ge1Q-Ar2O-Q7hi-8wQl-BiOFzH, serial=SRH-str01VIRTUAL-DISK, lunMapping=3, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=30, vendorName=RH-str01, pathsDictionary={sdd=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=e133f938-1bce-4777-b3da-e9f951a377f8, storageDomainName=null]], log id: 2e9ccc61 >2014-10-09 10:46:57,248 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [535b8035] Correlation ID: 535b8035, Job ID: 644cb282-0247-41b3-8940-0b12c4cd7c7c, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-3 was added by admin >2014-10-09 10:46:57,481 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-3) [7642123] Lock Acquired to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= ] >2014-10-09 10:46:57,573 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-3) [7642123] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:46:57,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-29) [7642123] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5110fcc6 >2014-10-09 10:46:57,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-2) [7642123] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: ddefd6 >2014-10-09 10:46:57,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-29) [7642123] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 5110fcc6 >2014-10-09 10:46:57,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-2) [7642123] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: ddefd6 >2014-10-09 10:46:57,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-3) [7642123] START, HSMGetStorageDomainInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storageDomainId=e133f938-1bce-4777-b3da-e9f951a377f8), log id: a593708 >2014-10-09 10:46:58,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-3) [7642123] FINISH, HSMGetStorageDomainInfoVDSCommand, return: <StorageDomainStatic[iscsi-3, e133f938-1bce-4777-b3da-e9f951a377f8], null>, log id: a593708 >2014-10-09 10:46:58,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-3) [7642123] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8), log id: 3f7d9c09 >2014-10-09 10:47:23,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-3) [7642123] FINISH, AttachStorageDomainVDSCommand, log id: 3f7d9c09 >2014-10-09 10:47:23,521 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp-/127.0.0.1:8702-3) [7642123] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, sdUUID = e133f938-1bce-4777-b3da-e9f951a377f8), log id: 23949212 >2014-10-09 10:47:23,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp-/127.0.0.1:8702-3) [7642123] FINISH, GetImagesListVDSCommand, return: [], log id: 23949212 >2014-10-09 10:47:23,745 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-3) There are no OVF_STORE disks on storage domain id e133f938-1bce-4777-b3da-e9f951a377f8 >2014-10-09 10:47:23,750 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [5dd7210e] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= ] >2014-10-09 10:47:23,750 WARN [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [5dd7210e] CanDoAction of action ActivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ACTIVATE,ACTION_TYPE_FAILED_OBJECT_LOCKED >2014-10-09 10:47:23,759 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [5dd7210e] Correlation ID: 7642123, Job ID: 6c528879-754f-4c81-8687-1dc298bc3840, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-3 was attached to Data Center Default by admin >2014-10-09 10:47:23,765 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-3) [5dd7210e] Lock freed to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= ] >2014-10-09 10:47:26,579 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-19) Adding domain e133f938-1bce-4777-b3da-e9f951a377f8 to the domains in maintenance cache >2014-10-09 10:47:33,970 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [32a50f15] Lock Acquired to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= ] >2014-10-09 10:47:34,083 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-25) [32a50f15] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 10:47:34,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-25) [32a50f15] Lock freed to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= ] >2014-10-09 10:47:34,098 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-25) [32a50f15] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/9/14 10:47 AM >2014-10-09 10:47:34,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-6) [32a50f15] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7eb5b726 >2014-10-09 10:47:34,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-36) [32a50f15] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, storageType = ISCSI, connectionList = [{ id: f33d41ec-afe7-43f9-994a-06cf6afbcfc9, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bb1b627 >2014-10-09 10:47:34,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-6) [32a50f15] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 7eb5b726 >2014-10-09 10:47:34,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-36) [32a50f15] FINISH, ConnectStorageServerVDSCommand, return: {f33d41ec-afe7-43f9-994a-06cf6afbcfc9=0}, log id: 7bb1b627 >2014-10-09 10:47:34,490 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 10:47:34,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] START, GetVGInfoVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, VGID=yKxjGv-hU7o-Ge1Q-Ar2O-Q7hi-8wQl-BiOFzH), log id: 7e278bd >2014-10-09 10:47:34,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=1jbelka03, physicalVolumeId=PEvBVX-KZqc-DzZn-lHGg-RDNq-di1l-yNREnU, volumeGroupId=yKxjGv-hU7o-Ge1Q-Ar2O-Q7hi-8wQl-BiOFzH, serial=SRH-str01VIRTUAL-DISK, lunMapping=3, vendorId=RH-str01, productId=VIRTUAL-DISK, _lunConnections=[{ id: null, connection: 10.34.63.202, iqn: iqn.2013-12.brq.str-01:jbelka, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=30, vendorName=RH-str01, pathsDictionary={sdd=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=e133f938-1bce-4777-b3da-e9f951a377f8, storageDomainName=null]], log id: 7e278bd >2014-10-09 10:47:34,772 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8), log id: 4160c8c >2014-10-09 10:47:35,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 4160c8c >2014-10-09 10:47:35,564 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] ActivateStorage Domain. After Connect all hosts to pool. Time:10/9/14 10:47 AM >2014-10-09 10:47:35,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-17) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 3b225379 >2014-10-09 10:47:35,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-44) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 1ec58ae7 >2014-10-09 10:47:35,827 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-17) FINISH, ConnectStoragePoolVDSCommand, log id: 3b225379 >2014-10-09 10:47:35,828 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-17) Refreshed vds dell-r210ii-04 in pool Default >2014-10-09 10:47:36,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-44) FINISH, ConnectStoragePoolVDSCommand, log id: 1ec58ae7 >2014-10-09 10:47:36,377 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-44) Refreshed vds dell-r210ii-03 in pool Default >2014-10-09 10:47:36,377 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-25) [6f90066c] ActivateStorage Domain. After change storage pool status in vds. Time:10/9/14 10:47 AM >2014-10-09 10:47:36,383 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) [6f90066c] Correlation ID: 32a50f15, Job ID: c93e6d0f-a79a-4cf1-9191-065e83fa4c78, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi-3 (Data Center Default) was activated by admin >2014-10-09 10:47:42,764 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-29) Removing domain e133f938-1bce-4777-b3da-e9f951a377f8 from the domains in maintenance cache >2014-10-09 11:02:40,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, vmIdList = null), log id: 6e37e1f3 >2014-10-09 11:02:40,286 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetVmsInfoVDSCommand, log id: 6e37e1f3 >2014-10-09 11:03:02,539 INFO [org.ovirt.engine.core.bll.ImportVmCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] Lock Acquired to object EngineLock [exclusiveLocks= key: jb-w2k12r2 value: VM_NAME >, sharedLocks= key: b702e4b8-742e-48e7-8deb-9d8871a52d1f value: REMOTE_VM >] >2014-10-09 11:03:02,547 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, vmIdList = null), log id: 5ab15b8b >2014-10-09 11:03:02,611 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] FINISH, GetVmsInfoVDSCommand, log id: 5ab15b8b >2014-10-09 11:03:06,142 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, sdUUID = e133f938-1bce-4777-b3da-e9f951a377f8), log id: 7456f5d4 >2014-10-09 11:03:06,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] FINISH, GetImagesListVDSCommand, return: [], log id: 7456f5d4 >2014-10-09 11:03:06,287 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] START, DoesImageExistVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 5110d7ae-3bf5-4ea9-ac7a-46ffcd052bda, imageId = 744428a4-f4e7-4467-ba69-4e534431681e), log id: 4e8d2ca3 >2014-10-09 11:03:06,321 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] FINISH, DoesImageExistVDSCommand, return: true, log id: 4e8d2ca3 >2014-10-09 11:03:06,322 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] START, DoesImageExistVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 5110d7ae-3bf5-4ea9-ac7a-46ffcd052bda, imageId = e79086a1-8b7a-4515-bacf-8d872ca36f38), log id: 166da99f >2014-10-09 11:03:06,340 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] FINISH, DoesImageExistVDSCommand, return: true, log id: 166da99f >2014-10-09 11:03:06,427 WARN [org.ovirt.engine.core.bll.ImportVmCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] CanDoAction of action ImportVm failed. Reasons:VAR__ACTION__IMPORT,VAR__TYPE__VM,ACTION_TYPE_FAILED_ILLEGAL_VM_DISPLAY_TYPE_IS_NOT_SUPPORTED_BY_OS >2014-10-09 11:03:06,428 INFO [org.ovirt.engine.core.bll.ImportVmCommand] (ajp-/127.0.0.1:8702-11) [44c47d21] Lock freed to object EngineLock [exclusiveLocks= key: jb-w2k12r2 value: VM_NAME >, sharedLocks= key: b702e4b8-742e-48e7-8deb-9d8871a52d1f value: REMOTE_VM >] >2014-10-09 11:03:32,211 INFO [org.ovirt.engine.core.bll.ImportVmCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] Lock Acquired to object EngineLock [exclusiveLocks= key: jb-w2k12r2_Copy value: VM_NAME >, sharedLocks= key: b702e4b8-742e-48e7-8deb-9d8871a52d1f value: REMOTE_VM >] >2014-10-09 11:03:32,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, vmIdList = null), log id: 77870915 >2014-10-09 11:03:32,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] FINISH, GetVmsInfoVDSCommand, log id: 77870915 >2014-10-09 11:03:35,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] START, DoesImageExistVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 5110d7ae-3bf5-4ea9-ac7a-46ffcd052bda, imageId = 744428a4-f4e7-4467-ba69-4e534431681e), log id: e56fd0b >2014-10-09 11:03:35,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] FINISH, DoesImageExistVDSCommand, return: true, log id: e56fd0b >2014-10-09 11:03:35,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] START, DoesImageExistVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, imageGroupId = 5110d7ae-3bf5-4ea9-ac7a-46ffcd052bda, imageId = e79086a1-8b7a-4515-bacf-8d872ca36f38), log id: 6e4d9505 >2014-10-09 11:03:35,364 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DoesImageExistVDSCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] FINISH, DoesImageExistVDSCommand, return: true, log id: 6e4d9505 >2014-10-09 11:03:35,577 WARN [org.ovirt.engine.core.bll.ImportVmCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] CanDoAction of action ImportVm failed. Reasons:VAR__ACTION__IMPORT,VAR__TYPE__VM,ACTION_TYPE_FAILED_ILLEGAL_VM_DISPLAY_TYPE_IS_NOT_SUPPORTED_BY_OS >2014-10-09 11:03:35,577 INFO [org.ovirt.engine.core.bll.ImportVmCommand] (ajp-/127.0.0.1:8702-9) [5e9c82e4] Lock freed to object EngineLock [exclusiveLocks= key: jb-w2k12r2_Copy value: VM_NAME >, sharedLocks= key: b702e4b8-742e-48e7-8deb-9d8871a52d1f value: REMOTE_VM >] >2014-10-09 11:19:48,704 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-18) Deactivating non existing principal admin::internal >2014-10-09 11:20:13,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-10-09 11:20:13,749 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-17) [269cc1cc] Lock Acquired to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-09 11:20:13,751 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-17) [269cc1cc] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:13,767 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (DefaultQuartzScheduler_Worker-17) [7dbf009d] Running command: CreateOvfStoresForStorageDomainCommand internal: true. >2014-10-09 11:20:13,768 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-17) [6c183ea] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:14,191 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-17) [1a5676b8] Running command: AddDiskCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: StorageAction group CREATE_DISK with role type USER >2014-10-09 11:20:14,516 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-17) [71284bce] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:14,560 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-17) [71284bce] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = e1611d7f-38fb-4337-9837-2286927aafbd, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 33a2ea30-7e68-4c24-9920-c478772cbc2b, newImageDescription = OVF_STORE), log id: 6010d7bb >2014-10-09 11:20:14,582 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-17) [71284bce] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-09 11:20:14,649 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-17) [71284bce] FINISH, CreateImageVDSCommand, return: 33a2ea30-7e68-4c24-9920-c478772cbc2b, log id: 6010d7bb >2014-10-09 11:20:14,663 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-17) [71284bce] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command bc9a1c72-2954-402e-9418-74b2bce72ef2 >2014-10-09 11:20:14,663 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-17) [71284bce] CommandMultiAsyncTasks::AttachTask: Attaching task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 to command bc9a1c72-2954-402e-9418-74b2bce72ef2. >2014-10-09 11:20:14,737 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) [71284bce] Adding task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-09 11:20:14,804 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) [71284bce] Correlation ID: 1a5676b8, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-10-09 11:20:14,809 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (DefaultQuartzScheduler_Worker-17) [5861de72] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:15,013 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (DefaultQuartzScheduler_Worker-17) [64595911] Running command: AddDiskCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: StorageAction group CREATE_DISK with role type USER >2014-10-09 11:20:15,211 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (DefaultQuartzScheduler_Worker-17) [60b64e8f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:15,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-17) [60b64e8f] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = 84f97e8d-bb28-43e4-a98d-468968326678, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 63374fb6-94be-4d40-be5a-5c91b451be72, newImageDescription = OVF_STORE), log id: 2bdda6a6 >2014-10-09 11:20:15,253 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-17) [60b64e8f] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-09 11:20:15,339 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (DefaultQuartzScheduler_Worker-17) [60b64e8f] FINISH, CreateImageVDSCommand, return: 63374fb6-94be-4d40-be5a-5c91b451be72, log id: 2bdda6a6 >2014-10-09 11:20:15,341 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-17) [60b64e8f] CommandMultiAsyncTasks::AttachTask: Attaching task cb584f9d-c974-46fd-b5af-1186459c0e9a to command bc9a1c72-2954-402e-9418-74b2bce72ef2. >2014-10-09 11:20:15,458 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) [60b64e8f] Adding task cb584f9d-c974-46fd-b5af-1186459c0e9a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-09 11:20:15,485 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) [60b64e8f] Correlation ID: 64595911, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by <UNKNOWN>. >2014-10-09 11:20:15,534 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-17) [60b64e8f] BaseAsyncTask::startPollingTask: Starting to poll task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1. >2014-10-09 11:20:15,535 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-17) [60b64e8f] BaseAsyncTask::startPollingTask: Starting to poll task cb584f9d-c974-46fd-b5af-1186459c0e9a. >2014-10-09 11:20:15,535 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-17) [60b64e8f] Lock freed to object EngineLock [exclusiveLocks= key: e133f938-1bce-4777-b3da-e9f951a377f8 value: STORAGE >, sharedLocks= key: 00000002-0002-0002-0002-0000000001f1 value: OVF_UPDATE >] >2014-10-09 11:20:19,188 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-47) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-10-09 11:20:19,194 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) SPMAsyncTask::PollTask: Polling task cb584f9d-c974-46fd-b5af-1186459c0e9a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-09 11:20:19,194 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) BaseAsyncTask::onTaskEndSuccess: Task cb584f9d-c974-46fd-b5af-1186459c0e9a (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-09 11:20:19,195 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-47) Task with DB Task ID 74a5f61e-107b-4ae0-aa55-c44f59f93947 and VDSM Task ID 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 is in state Polling. End action for command bc9a1c72-2954-402e-9418-74b2bce72ef2 will proceed when all the entitys tasks are completed. >2014-10-09 11:20:19,207 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) SPMAsyncTask::PollTask: Polling task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-09 11:20:19,207 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) BaseAsyncTask::onTaskEndSuccess: Task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 (Parent Command CreateOvfStoresForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-09 11:20:19,207 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) CommandAsyncTask::endActionIfNecessary: All tasks of command bc9a1c72-2954-402e-9418-74b2bce72ef2 has ended -> executing endAction >2014-10-09 11:20:19,207 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: bc9a1c72-2954-402e-9418-74b2bce72ef2): calling endAction . >2014-10-09 11:20:19,207 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-34) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateOvfStoresForStorageDomain, executionIndex: 0 >2014-10-09 11:20:19,250 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-34) [7dbf009d] Ending command successfully: org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand >2014-10-09 11:20:19,266 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-34) [71284bce] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-09 11:20:19,282 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-34) [71284bce] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = e1611d7f-38fb-4337-9837-2286927aafbd, imageId = 33a2ea30-7e68-4c24-9920-c478772cbc2b), log id: 2dd67e14 >2014-10-09 11:20:19,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-34) [71284bce] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9cf100b8, log id: 2dd67e14 >2014-10-09 11:20:19,346 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-7-thread-34) [60b64e8f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-09 11:20:19,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-34) [60b64e8f] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = 84f97e8d-bb28-43e4-a98d-468968326678, imageId = 63374fb6-94be-4d40-be5a-5c91b451be72), log id: 688f511b >2014-10-09 11:20:19,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-7-thread-34) [60b64e8f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7e9e8865, log id: 688f511b >2014-10-09 11:20:20,185 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-34) [7dbf009d] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:20,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [7dbf009d] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = 84f97e8d-bb28-43e4-a98d-468968326678, imageId = 63374fb6-94be-4d40-be5a-5c91b451be72), log id: 2bad6434 >2014-10-09 11:20:20,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [7dbf009d] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-09 11:20:20,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [7dbf009d] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=e133f938-1bce-4777-b3da-e9f951a377f8 > imageGroupGUID=84f97e8d-bb28-43e4-a98d-468968326678 > volUUID=63374fb6-94be-4d40-be5a-5c91b451be72 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"e133f938-1bce-4777-b3da-e9f951a377f8"}],"Last Updated":null} > >2014-10-09 11:20:20,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [7dbf009d] FINISH, SetVolumeDescriptionVDSCommand, log id: 2bad6434 >2014-10-09 11:20:20,513 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS_EXECUTION >] >2014-10-09 11:20:20,550 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] Running command: UploadStreamCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:20,581 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] START, UploadStreamVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 2adb1f57 >2014-10-09 11:20:20,582 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] -- executeVdsBrokerCommand: >2014-10-09 11:20:20,582 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=e133f938-1bce-4777-b3da-e9f951a377f8 > imageGUID=84f97e8d-bb28-43e4-a98d-468968326678 > volUUID=63374fb6-94be-4d40-be5a-5c91b451be72 > size=10,240 > >2014-10-09 11:20:22,829 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] FINISH, UploadStreamVDSCommand, log id: 2adb1f57 >2014-10-09 11:20:22,831 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-34) [76ce403b] CommandMultiAsyncTasks::AttachTask: Attaching task 6ddcf1a3-3012-47e3-bb7c-e46c77854410 to command bc9a1c72-2954-402e-9418-74b2bce72ef2. >2014-10-09 11:20:22,843 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-34) [76ce403b] Adding task 6ddcf1a3-3012-47e3-bb7c-e46c77854410 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-09 11:20:22,848 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS_EXECUTION >] >2014-10-09 11:20:22,878 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = 84f97e8d-bb28-43e4-a98d-468968326678, imageId = 63374fb6-94be-4d40-be5a-5c91b451be72), log id: 6d6f8489 >2014-10-09 11:20:22,878 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-09 11:20:22,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=e133f938-1bce-4777-b3da-e9f951a377f8 > imageGroupGUID=84f97e8d-bb28-43e4-a98d-468968326678 > volUUID=63374fb6-94be-4d40-be5a-5c91b451be72 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"e133f938-1bce-4777-b3da-e9f951a377f8"}],"Last Updated":"Thu Oct 09 11:20:20 CEST 2014","Size":10240} > >2014-10-09 11:20:23,029 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] FINISH, SetVolumeDescriptionVDSCommand, log id: 6d6f8489 >2014-10-09 11:20:23,036 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = e1611d7f-38fb-4337-9837-2286927aafbd, imageId = 33a2ea30-7e68-4c24-9920-c478772cbc2b), log id: 1f907ca0 >2014-10-09 11:20:23,036 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-09 11:20:23,036 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=e133f938-1bce-4777-b3da-e9f951a377f8 > imageGroupGUID=e1611d7f-38fb-4337-9837-2286927aafbd > volUUID=33a2ea30-7e68-4c24-9920-c478772cbc2b > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"e133f938-1bce-4777-b3da-e9f951a377f8"}],"Last Updated":null} > >2014-10-09 11:20:23,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [76ce403b] FINISH, SetVolumeDescriptionVDSCommand, log id: 1f907ca0 >2014-10-09 11:20:23,226 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS_EXECUTION >] >2014-10-09 11:20:23,232 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] Running command: UploadStreamCommand internal: true. Entities affected : ID: e133f938-1bce-4777-b3da-e9f951a377f8 Type: Storage >2014-10-09 11:20:23,272 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] START, UploadStreamVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b), log id: 4dd532d0 >2014-10-09 11:20:23,272 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] -- executeVdsBrokerCommand: >2014-10-09 11:20:23,272 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] -- parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=e133f938-1bce-4777-b3da-e9f951a377f8 > imageGUID=e1611d7f-38fb-4337-9837-2286927aafbd > volUUID=33a2ea30-7e68-4c24-9920-c478772cbc2b > size=10,240 > >2014-10-09 11:20:25,241 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] FINISH, UploadStreamVDSCommand, log id: 4dd532d0 >2014-10-09 11:20:25,242 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] CommandMultiAsyncTasks::AttachTask: Attaching task 997f2944-fcde-4306-834d-0cf4d3339ba6 to command bc9a1c72-2954-402e-9418-74b2bce72ef2. >2014-10-09 11:20:25,254 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] Adding task 997f2944-fcde-4306-834d-0cf4d3339ba6 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-09 11:20:25,273 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 04f67d65-72bc-4ddc-88b7-81d0053dff0b value: VDS_EXECUTION >] >2014-10-09 11:20:25,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = e133f938-1bce-4777-b3da-e9f951a377f8, imageGroupId = e1611d7f-38fb-4337-9837-2286927aafbd, imageId = 33a2ea30-7e68-4c24-9920-c478772cbc2b), log id: 69f6db6d >2014-10-09 11:20:25,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-10-09 11:20:25,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] -- setVolumeDescription parameters: > spUUID=00000002-0002-0002-0002-0000000001f1 > sdUUID=e133f938-1bce-4777-b3da-e9f951a377f8 > imageGroupGUID=e1611d7f-38fb-4337-9837-2286927aafbd > volUUID=33a2ea30-7e68-4c24-9920-c478772cbc2b > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"e133f938-1bce-4777-b3da-e9f951a377f8"}],"Last Updated":"Thu Oct 09 11:20:20 CEST 2014","Size":10240} > >2014-10-09 11:20:25,425 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] FINISH, SetVolumeDescriptionVDSCommand, log id: 69f6db6d >2014-10-09 11:20:25,434 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] BaseAsyncTask::startPollingTask: Starting to poll task 6ddcf1a3-3012-47e3-bb7c-e46c77854410. >2014-10-09 11:20:25,434 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] BaseAsyncTask::startPollingTask: Starting to poll task 997f2944-fcde-4306-834d-0cf4d3339ba6. >2014-10-09 11:20:25,434 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain completed, handling the result. >2014-10-09 11:20:25,434 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateOvfStoresForStorageDomain succeeded, clearing tasks. >2014-10-09 11:20:25,434 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 >2014-10-09 11:20:25,435 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1), log id: 243a896c >2014-10-09 11:20:25,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1), log id: 7f142408 >2014-10-09 11:20:25,503 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] FINISH, HSMClearTaskVDSCommand, log id: 7f142408 >2014-10-09 11:20:25,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] FINISH, SPMClearTaskVDSCommand, log id: 243a896c >2014-10-09 11:20:25,525 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] BaseAsyncTask::removeTaskFromDB: Removed task 4dcdcf4c-c65e-4ba6-8ef0-ca6005343ec1 from DataBase >2014-10-09 11:20:25,525 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] SPMAsyncTask::ClearAsyncTask: Attempting to clear task cb584f9d-c974-46fd-b5af-1186459c0e9a >2014-10-09 11:20:25,525 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = cb584f9d-c974-46fd-b5af-1186459c0e9a), log id: 3a0d5943 >2014-10-09 11:20:25,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=cb584f9d-c974-46fd-b5af-1186459c0e9a), log id: 425f5b7b >2014-10-09 11:20:25,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] FINISH, HSMClearTaskVDSCommand, log id: 425f5b7b >2014-10-09 11:20:25,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] FINISH, SPMClearTaskVDSCommand, log id: 3a0d5943 >2014-10-09 11:20:25,599 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] BaseAsyncTask::removeTaskFromDB: Removed task cb584f9d-c974-46fd-b5af-1186459c0e9a from DataBase >2014-10-09 11:20:25,600 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-7-thread-34) [77a60bb5] [within thread]: Some of the tasks related to command id bc9a1c72-2954-402e-9418-74b2bce72ef2 were not cleared yet (Task id 6ddcf1a3-3012-47e3-bb7c-e46c77854410 is in state Polling). >2014-10-09 11:20:29,214 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-2) [733d0959] Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-10-09 11:20:29,221 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [733d0959] SPMAsyncTask::PollTask: Polling task 6ddcf1a3-3012-47e3-bb7c-e46c77854410 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-09 11:20:29,221 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [733d0959] BaseAsyncTask::onTaskEndSuccess: Task 6ddcf1a3-3012-47e3-bb7c-e46c77854410 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-09 11:20:29,221 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-2) [733d0959] Task with DB Task ID 44927471-eae4-4b48-9c91-48bdb8e2c811 and VDSM Task ID 997f2944-fcde-4306-834d-0cf4d3339ba6 is in state Polling. End action for command bc9a1c72-2954-402e-9418-74b2bce72ef2 will proceed when all the entitys tasks are completed. >2014-10-09 11:20:29,221 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [733d0959] SPMAsyncTask::PollTask: Polling task 997f2944-fcde-4306-834d-0cf4d3339ba6 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-09 11:20:29,221 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [733d0959] BaseAsyncTask::onTaskEndSuccess: Task 997f2944-fcde-4306-834d-0cf4d3339ba6 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-09 11:20:29,222 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-2) [733d0959] CommandAsyncTask::endActionIfNecessary: All tasks of command bc9a1c72-2954-402e-9418-74b2bce72ef2 has ended -> executing endAction >2014-10-09 11:20:29,222 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-2) [733d0959] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: bc9a1c72-2954-402e-9418-74b2bce72ef2): calling endAction . >2014-10-09 11:20:29,222 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [733d0959] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-10-09 11:20:29,279 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-10-09 11:20:29,279 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-10-09 11:20:29,279 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-10-09 11:20:29,279 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6ddcf1a3-3012-47e3-bb7c-e46c77854410 >2014-10-09 11:20:29,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 6ddcf1a3-3012-47e3-bb7c-e46c77854410), log id: 3acedec6 >2014-10-09 11:20:29,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=6ddcf1a3-3012-47e3-bb7c-e46c77854410), log id: 6383b753 >2014-10-09 11:20:29,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] FINISH, HSMClearTaskVDSCommand, log id: 6383b753 >2014-10-09 11:20:29,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] FINISH, SPMClearTaskVDSCommand, log id: 3acedec6 >2014-10-09 11:20:29,333 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] BaseAsyncTask::removeTaskFromDB: Removed task 6ddcf1a3-3012-47e3-bb7c-e46c77854410 from DataBase >2014-10-09 11:20:29,333 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 997f2944-fcde-4306-834d-0cf4d3339ba6 >2014-10-09 11:20:29,333 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, taskId = 997f2944-fcde-4306-834d-0cf4d3339ba6), log id: 2dd5c64d >2014-10-09 11:20:29,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] START, HSMClearTaskVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, taskId=997f2944-fcde-4306-834d-0cf4d3339ba6), log id: 2dce00bd >2014-10-09 11:20:29,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] FINISH, HSMClearTaskVDSCommand, log id: 2dce00bd >2014-10-09 11:20:29,384 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] FINISH, SPMClearTaskVDSCommand, log id: 2dd5c64d >2014-10-09 11:20:29,390 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] BaseAsyncTask::removeTaskFromDB: Removed task 997f2944-fcde-4306-834d-0cf4d3339ba6 from DataBase >2014-10-09 11:20:29,390 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-7-thread-5) [7dbf009d] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity bc9a1c72-2954-402e-9418-74b2bce72ef2 >2014-10-09 11:21:32,554 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) [60b64e8f] Setting new tasks map. The map contains now 0 tasks >2014-10-09 11:21:32,554 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) [60b64e8f] Cleared all tasks of pool 00000002-0002-0002-0002-0000000001f1. >2014-10-09 11:39:04,270 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [23315707] Lock Acquired to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 11:39:04,566 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-20) [23315707] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: ca414eb9-98ab-422f-8c4e-c2c513231058 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:39:06,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-20) [23315707] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 5830940c >2014-10-09 11:39:06,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-20) [23315707] FINISH, DeactivateStorageDomainVDSCommand, log id: 5830940c >2014-10-09 11:39:06,198 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-20) [23315707] Lock freed to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 11:39:06,793 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-37) After deactivate treatment vds: dell-r210ii-04,pool Default >2014-10-09 11:39:06,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-37) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 32e20ed8 >2014-10-09 11:39:06,962 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-7-thread-3) After deactivate treatment vds: dell-r210ii-03,pool Default >2014-10-09 11:39:07,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-3) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 9ef3735 >2014-10-09 11:39:07,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-37) FINISH, ConnectStoragePoolVDSCommand, log id: 32e20ed8 >2014-10-09 11:39:07,297 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-7-thread-37) [2be2ff7d] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:39:07,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-37) [2be2ff7d] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1297d232 >2014-10-09 11:39:07,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-37) [2be2ff7d] FINISH, DisconnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 1297d232 >2014-10-09 11:39:07,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-3) FINISH, ConnectStoragePoolVDSCommand, log id: 9ef3735 >2014-10-09 11:39:07,661 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-7-thread-20) [3f05080a] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:39:07,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-20) [3f05080a] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7b6ebccc >2014-10-09 11:39:07,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-20) [3f05080a] FINISH, DisconnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 7b6ebccc >2014-10-09 11:39:07,860 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-7-thread-20) [3f05080a] Domain ca414eb9-98ab-422f-8c4e-c2c513231058 will remain in PreparingForMaintenance status until deactivated on all hosts >2014-10-09 11:39:07,893 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-20) [3f05080a] Correlation ID: 23315707, Job ID: 120300cd-6564-47ad-ab6d-c98f0f4a334f, Call Stack: null, Custom Event ID: -1, Message: Storage Domain str-01-jbelka-export (Data Center Default) was deactivated by admin >2014-10-09 11:39:08,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-42) Adding domain ca414eb9-98ab-422f-8c4e-c2c513231058 to the domains in maintenance cache >2014-10-09 11:39:23,767 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-34) Moving domain ca414eb9-98ab-422f-8c4e-c2c513231058 to maintenance >2014-10-09 11:41:34,242 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] Running command: StopVmCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-09 11:41:34,247 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] START, DestroyVmVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=), log id: 5d0dcc3a >2014-10-09 11:41:34,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=), log id: 9b076fb >2014-10-09 11:41:34,344 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] Unexpected return value: StatusForXmlRpc [mCode=-32603, mMessage=Cannot remove Fs that does not exists in: /var/run/vdsm/payload] >2014-10-09 11:41:34,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] Failed in DestroyVDS method >2014-10-09 11:41:34,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] Command org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=-32603, mMessage=Cannot remove Fs that does not exists in: /var/run/vdsm/payload]] >2014-10-09 11:41:34,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] HostName = dell-r210ii-04 >2014-10-09 11:41:34,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] Command DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Cannot remove Fs that does not exists in: /var/run/vdsm/payload, code = -32603 >2014-10-09 11:41:34,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] FINISH, DestroyVDSCommand, log id: 9b076fb >2014-10-09 11:41:34,351 ERROR [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] VDS::destroy Failed destroying vm 63d1ebb8-3614-4685-8ea6-a022d8725e1d in vds = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 : dell-r210ii-04, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Cannot remove Fs that does not exists in: /var/run/vdsm/payload, code = -32603 >2014-10-09 11:41:34,351 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] FINISH, DestroyVmVDSCommand, log id: 5d0dcc3a >2014-10-09 11:41:34,351 ERROR [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-7-thread-44) [3859de0] Command org.ovirt.engine.core.bll.StopVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Cannot remove Fs that does not exists in: /var/run/vdsm/payload, code = -32603 (Failed with error unexpected and code 16) >2014-10-09 11:41:34,384 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-44) [3859de0] Correlation ID: 3859de0, Job ID: ee878af4-c361-423a-bda7-24e86b85e9ac, Call Stack: null, Custom Event ID: -1, Message: Failed to power off VM sles11 (Host: dell-r210ii-04, User: admin). >2014-10-09 11:41:46,088 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Running command: StopVmCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-10-09 11:41:46,092 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] START, DestroyVmVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=), log id: 348e69be >2014-10-09 11:41:46,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] START, DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=), log id: 54ac466 >2014-10-09 11:41:46,644 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Unexpected return value: StatusForXmlRpc [mCode=-32603, mMessage=Cannot remove Fs that does not exists in: /var/run/vdsm/payload] >2014-10-09 11:41:46,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Failed in DestroyVDS method >2014-10-09 11:41:46,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Command org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=-32603, mMessage=Cannot remove Fs that does not exists in: /var/run/vdsm/payload]] >2014-10-09 11:41:46,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] HostName = dell-r210ii-04 >2014-10-09 11:41:46,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Command DestroyVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, force=false, secondsToWait=0, gracefully=false, reason=) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Cannot remove Fs that does not exists in: /var/run/vdsm/payload, code = -32603 >2014-10-09 11:41:46,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] FINISH, DestroyVDSCommand, log id: 54ac466 >2014-10-09 11:41:46,645 ERROR [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] VDS::destroy Failed destroying vm 63d1ebb8-3614-4685-8ea6-a022d8725e1d in vds = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5 : dell-r210ii-04, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Cannot remove Fs that does not exists in: /var/run/vdsm/payload, code = -32603 >2014-10-09 11:41:46,645 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] FINISH, DestroyVmVDSCommand, log id: 348e69be >2014-10-09 11:41:46,645 ERROR [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Command org.ovirt.engine.core.bll.StopVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Cannot remove Fs that does not exists in: /var/run/vdsm/payload, code = -32603 (Failed with error unexpected and code 16) >2014-10-09 11:41:46,940 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-42) [3bbc605d] Correlation ID: 3bbc605d, Job ID: 47376202-4abc-407f-8cd6-7208c1f62f30, Call Stack: null, Custom Event ID: -1, Message: Failed to power off VM sles11 (Host: dell-r210ii-04, User: admin). >2014-10-09 11:48:52,730 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp-/127.0.0.1:8702-9) [59c3e690] Lock Acquired to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 11:48:52,773 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: ca414eb9-98ab-422f-8c4e-c2c513231058 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:48:52,773 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Start detach storage domain >2014-10-09 11:48:52,779 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Detach storage domain: before connect >2014-10-09 11:48:52,842 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-38) [3cccab37] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:48:52,853 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-35) [3370fc5b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:48:52,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-35) [3370fc5b] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 644e4879 >2014-10-09 11:48:52,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-35) [3370fc5b] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 644e4879 >2014-10-09 11:48:52,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-38) [3cccab37] START, ConnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7c4487c0 >2014-10-09 11:48:53,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-38) [3cccab37] FINISH, ConnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 7c4487c0 >2014-10-09 11:48:53,045 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Detach storage domain: after connect >2014-10-09 11:48:53,047 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-0000000001f1, ignoreFailoverLimit = false, storageDomainId = ca414eb9-98ab-422f-8c4e-c2c513231058, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 71b072c9 >2014-10-09 11:48:53,308 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] FINISH, DetachStorageDomainVDSCommand, log id: 71b072c9 >2014-10-09 11:48:53,308 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Detach storage domain: after detach in vds >2014-10-09 11:48:53,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-6) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vdsId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 5fc38180 >2014-10-09 11:48:53,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-3) START, ConnectStoragePoolVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, vdsId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000002-0002-0002-0002-0000000001f1, masterVersion = 1), log id: 36920fc9 >2014-10-09 11:48:53,862 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-6) FINISH, ConnectStoragePoolVDSCommand, log id: 5fc38180 >2014-10-09 11:48:53,866 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-7-thread-6) [5a3bafa6] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:48:53,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-6) [5a3bafa6] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 389e7291 >2014-10-09 11:48:53,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-3) FINISH, ConnectStoragePoolVDSCommand, log id: 36920fc9 >2014-10-09 11:48:53,955 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-7-thread-3) [121e81f3] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-09 11:48:53,966 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-6) [5a3bafa6] FINISH, DisconnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 389e7291 >2014-10-09 11:48:53,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-3) [121e81f3] START, DisconnectStorageServerVDSCommand(HostName = dell-r210ii-03, HostId = 04f67d65-72bc-4ddc-88b7-81d0053dff0b, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 0ee01c89-10fb-4b71-b5ef-9a54352cbbf0, connection: 10.34.63.202:/mnt/export/nfs/lv1/jbelka/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4bad875a >2014-10-09 11:48:54,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-3) [121e81f3] FINISH, DisconnectStorageServerVDSCommand, return: {0ee01c89-10fb-4b71-b5ef-9a54352cbbf0=0}, log id: 4bad875a >2014-10-09 11:48:54,157 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Detach storage domain: after disconnect storage >2014-10-09 11:48:54,356 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] End detach storage domain >2014-10-09 11:48:54,376 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Correlation ID: 59c3e690, Job ID: e4607e22-76cb-4317-9373-8717a17176f1, Call Stack: null, Custom Event ID: -1, Message: Storage Domain str-01-jbelka-export was detached from Data Center Default by admin >2014-10-09 11:48:54,401 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-7-thread-44) [59c3e690] Lock freed to object EngineLock [exclusiveLocks= key: ca414eb9-98ab-422f-8c4e-c2c513231058 value: STORAGE >, sharedLocks= ] >2014-10-09 11:49:05,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-7-thread-24) Removing domain ca414eb9-98ab-422f-8c4e-c2c513231058 from the domains in maintenance cache >2014-10-09 12:20:15,536 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-10-09 13:16:49,853 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to /10.34.63.222 >2014-10-09 13:20:15,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6418e974] Attempting to update VMs/Templates Ovf. >2014-10-09 14:20:15,751 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-10-09 14:56:47,105 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-3) [7c994f04] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 63d1ebb8-3614-4685-8ea6-a022d8725e1d Type: VMAction group CONNECT_TO_VM with role type USER >2014-10-09 14:56:47,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [7c994f04] START, SetVmTicketVDSCommand(HostName = dell-r210ii-04, HostId = 9aae4e31-3100-4932-84f8-1b6cf11ec8a5, vmId=63d1ebb8-3614-4685-8ea6-a022d8725e1d, ticket=p3HBSF8MQ9UH, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1348e3c7 >2014-10-09 14:56:47,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [7c994f04] FINISH, SetVmTicketVDSCommand, log id: 1348e3c7 >2014-10-09 14:56:47,170 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [7c994f04] Correlation ID: 7c994f04, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM sles11 >2014-10-09 14:56:51,278 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [6418e974] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin is connected to VM sles11. >2014-10-09 15:02:59,242 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin got disconnected from VM sles11. >2014-10-09 15:20:15,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) [5f7551ce] Attempting to update VMs/Templates Ovf. >2014-10-09 16:20:15,952 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-10-09 17:20:16,024 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-10-09 18:20:16,114 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-10-09 19:20:16,179 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-10-09 20:20:16,276 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) [5f7551ce] Attempting to update VMs/Templates Ovf. >2014-10-09 20:23:52,685 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginUserCommand internal: false. >2014-10-09 20:23:52,982 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-09 20:24:00,270 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-12) [30824daf] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,271 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [55bbd485] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,272 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-10) [6a2279de] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,273 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-6) [ea91ed6] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,276 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [1603d734] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,278 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-11) [4c68525f] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,284 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [30824daf] Correlation ID: 30824daf, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,286 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [55bbd485] Correlation ID: 55bbd485, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,286 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [4c68525f] Correlation ID: 4c68525f, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [1603d734] Correlation ID: 1603d734, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [6a2279de] Correlation ID: 6a2279de, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,289 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [ea91ed6] Correlation ID: ea91ed6, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,320 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-8) [66def69f] Running command: LogoutUserCommand internal: false. >2014-10-09 20:24:00,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [66def69f] Correlation ID: 66def69f, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-09 20:24:00,334 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-9) Invalid locale found in configuration: >2014-10-09 20:24:00,334 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-9) Invalid locale found in configuration: >2014-10-09 21:19:48,897 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-40) Deactivating non existing principal admin::internal >2014-10-09 21:20:16,302 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) [9830ee8] Attempting to update VMs/Templates Ovf. >2014-10-09 22:20:16,362 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [4b41709] Attempting to update VMs/Templates Ovf. >2014-10-09 23:20:16,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [7356de8d] Attempting to update VMs/Templates Ovf. >2014-10-10 00:20:16,472 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-10-10 01:20:16,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-10-10 02:20:16,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-10-10 02:51:33,979 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-11) Invalid locale found in configuration: >2014-10-10 02:51:33,979 INFO [org.ovirt.engine.core.utils.servlet.UnsupportedLocaleHelper] (ajp-/127.0.0.1:8702-11) Invalid locale found in configuration: >2014-10-10 03:20:16,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-10-10 03:35:35,042 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Start deleteAgedOutCommandEntities >2014-10-10 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-20) [45d87fee] Start deleteAgedOutAuditLogs >2014-10-10 03:35:35,114 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-20) [45d87fee] Finished deleteAgedOutAuditLogs >2014-10-10 03:35:35,162 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Finished deleteAgedOutCommandEntities >2014-10-10 04:20:16,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-10-10 05:20:19,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-10-10 06:20:19,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) [1850603] Attempting to update VMs/Templates Ovf. >2014-10-10 07:20:20,005 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-10-10 08:20:20,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-10-10 09:20:20,056 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-10-10 10:20:20,097 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-10-10 11:20:20,123 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-10-10 12:20:20,148 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-10-10 13:20:20,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-10-10 14:20:20,209 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [733d0959] Attempting to update VMs/Templates Ovf. >2014-10-10 15:20:20,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-10-10 16:08:06,649 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginUserCommand internal: false. >2014-10-10 16:08:06,655 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 16:08:09,108 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-2) [4bd60fb2] Running command: LogoutBySessionCommand internal: false. >2014-10-10 16:08:09,111 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [375d4dea] Running command: LogoutUserCommand internal: false. >2014-10-10 16:08:09,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [375d4dea] Correlation ID: 375d4dea, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-10 16:12:37,201 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2014-10-10 16:12:37,219 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 16:12:37,314 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginUserCommand internal: false. >2014-10-10 16:12:56,720 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp-/127.0.0.1:8702-10) [19711c4a] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_POOL with role type ADMIN >2014-10-10 16:12:56,782 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [19711c4a] Correlation ID: 19711c4a, Call Stack: null, Custom Event ID: -1, Message: Data Center ppc64, Compatibility Version 3.4 and Quota Type DISABLED was added by admin >2014-10-10 16:13:09,665 WARN [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-3) [38fab069] CanDoAction of action AddVdsGroup failed. Reasons:VAR__TYPE__CLUSTER,VAR__ACTION__CREATE,MIGRATION_ON_ERROR_IS_NOT_SUPPORTED >2014-10-10 16:13:17,306 WARN [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-1) [375affee] CanDoAction of action AddVdsGroup failed. Reasons:VAR__TYPE__CLUSTER,VAR__ACTION__CREATE,MIGRATION_ON_ERROR_IS_NOT_SUPPORTED >2014-10-10 16:14:42,895 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-7) [3c19ae18] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePoolAction group CREATE_CLUSTER with role type ADMIN >2014-10-10 16:14:42,958 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3c19ae18] Correlation ID: 3c19ae18, Call Stack: null, Custom Event ID: -1, Message: Cluster ppc64 was added by admin >2014-10-10 16:15:24,971 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-1) [2bf76e40] Running command: AddVdsCommand internal: false. Entities affected : ID: bbffe8c0-a1ae-4aaa-8f4b-944346a4fe3d Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-10 16:15:25,027 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [1264a924] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:15:25,071 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [1264a924] Lock freed to object EngineLock [exclusiveLocks= key: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 value: REGISTER_VDS >, sharedLocks= ] >2014-10-10 16:15:25,084 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [1264a924] START, RemoveVdsVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e), log id: 21d3d2ad >2014-10-10 16:15:25,085 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [1264a924] FINISH, RemoveVdsVDSCommand, log id: 21d3d2ad >2014-10-10 16:15:25,086 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [1264a924] START, AddVdsVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e), log id: 30758097 >2014-10-10 16:15:25,086 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [1264a924] AddVds - entered , starting logic to add VDS 214b9ef3-b428-4d8d-b9eb-35f29765ec9e >2014-10-10 16:15:25,087 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [1264a924] AddVds - VDS 214b9ef3-b428-4d8d-b9eb-35f29765ec9e was added, will try to add it to the resource manager >2014-10-10 16:15:25,087 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [1264a924] Entered VdsManager constructor >2014-10-10 16:15:25,099 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [1264a924] Initialize vdsBroker (ibm-p8-rhevm-hv-01.lab.bos.redhat.com,54,321) >2014-10-10 16:15:25,117 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [1264a924] VDS 214b9ef3-b428-4d8d-b9eb-35f29765ec9e was added to the Resource Manager >2014-10-10 16:15:25,118 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [1264a924] FINISH, AddVdsVDSCommand, log id: 30758097 >2014-10-10 16:15:25,122 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [1264a924] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:15:25,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [1264a924] Correlation ID: 2bf76e40, Job ID: dd9a3d8a-d9d1-4d42-9f56-72abd0ef9456, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was added by admin. >2014-10-10 16:15:25,165 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Lock Acquired to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:15:25,187 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:15:25,205 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Before Installation host 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:15:25,222 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 506f3185 >2014-10-10 16:15:25,235 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] FINISH, SetVdsStatusVDSCommand, log id: 506f3185 >2014-10-10 16:15:25,889 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Connected to host ibm-p8-rhevm-hv-01.lab.bos.redhat.com with SSH key fingerprint: 1e:d7:63:f6:39:d1:be:8d:21:d6:32:9b:89:95:a7:0b >2014-10-10 16:15:25,895 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Connected to host ibm-p8-rhevm-hv-01.lab.bos.redhat.com with SSH key fingerprint: 1e:d7:63:f6:39:d1:be:8d:21:d6:32:9b:89:95:a7:0b. >2014-10-10 16:15:26,407 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Installation of ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-10 16:15:26,599 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-7-thread-47) SSH execute root@ibm-p8-rhevm-hv-01.lab.bos.redhat.com 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-10 16:15:28,105 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) Initializing Host: ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:15:29,382 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Initializing >2014-10-10 16:15:29,389 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Initializing. >2014-10-10 16:15:29,556 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Environment setup >2014-10-10 16:15:29,564 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Environment setup. >2014-10-10 16:15:29,564 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Environment packages setup >2014-10-10 16:15:29,571 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Environment packages setup. >2014-10-10 16:15:29,710 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Programs detection >2014-10-10 16:15:29,721 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Programs detection. >2014-10-10 16:15:29,729 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Environment customization >2014-10-10 16:15:29,735 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Environment customization. >2014-10-10 16:15:29,892 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Kdump unsupported >2014-10-10 16:15:29,898 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Kdump unsupported. >2014-10-10 16:15:30,656 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20141010101528-o2chza.log' >2014-10-10 16:15:30,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20141010101528-o2chza.log'. >2014-10-10 16:15:32,350 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com reports unique id 2116A5A >2014-10-10 16:15:32,524 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 2116A5A to Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:15:37,534 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Disabling Kdump integration >2014-10-10 16:15:37,543 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Disabling Kdump integration. >2014-10-10 16:15:38,914 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Setup validation >2014-10-10 16:15:38,920 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Setup validation. >2014-10-10 16:15:38,976 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Hardware supports virtualization >2014-10-10 16:15:38,983 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Hardware supports virtualization. >2014-10-10 16:15:39,043 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Transaction setup >2014-10-10 16:15:39,049 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Transaction setup. >2014-10-10 16:15:39,054 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Misc configuration >2014-10-10 16:15:39,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Misc configuration. >2014-10-10 16:15:39,060 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Package installation >2014-10-10 16:15:39,065 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Package installation. >2014-10-10 16:15:48,574 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Misc configuration >2014-10-10 16:15:48,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Misc configuration. >2014-10-10 16:15:49,260 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Enrolling certificate >2014-10-10 16:15:49,266 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Enrolling certificate. >2014-10-10 16:15:50,637 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Transaction commit >2014-10-10 16:15:50,654 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Transaction commit. >2014-10-10 16:15:50,702 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Closing up >2014-10-10 16:15:50,709 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Closing up. >2014-10-10 16:15:50,710 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Restarting nrpe service >2014-10-10 16:15:50,716 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Restarting nrpe service. >2014-10-10 16:15:52,363 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stopping libvirtd >2014-10-10 16:15:52,369 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stopping libvirtd. >2014-10-10 16:15:52,829 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Starting vdsm >2014-10-10 16:15:52,836 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Starting vdsm. >2014-10-10 16:15:56,747 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Pre-termination >2014-10-10 16:15:56,753 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Pre-termination. >2014-10-10 16:15:57,514 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141010161557-ibm-p8-rhevm-hv-01.lab.bos.redhat.com-2713c2c3.log' >2014-10-10 16:15:57,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141010161557-ibm-p8-rhevm-hv-01.lab.bos.redhat.com-2713c2c3.log'. >2014-10-10 16:15:59,357 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Termination >2014-10-10 16:15:59,363 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2713c2c3, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Termination. >2014-10-10 16:15:59,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-10 16:15:59,684 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Command PollVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-10 16:16:00,862 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Engine managed to communicate with VDSM agent on host ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:16:01,423 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] The management network rhevm is already configured on host ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:16:01,426 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 247fc50b >2014-10-10 16:16:01,430 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] FINISH, SetVdsStatusVDSCommand, log id: 247fc50b >2014-10-10 16:16:01,441 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] After Installation host ibm-p8-rhevm-hv-01.lab.bos.redhat.com, VDS >2014-10-10 16:16:01,449 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Correlation ID: 2713c2c3, Job ID: dd9a3d8a-d9d1-4d42-9f56-72abd0ef9456, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com installed >2014-10-10 16:16:01,454 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-47) [2713c2c3] Lock freed to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:16:04,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,214b9ef3-b428-4d8d-b9eb-35f29765ec9e]), log id: 7c5babc1 >2014-10-10 16:16:04,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GetHardwareInfoVDSCommand, log id: 7c5babc1 >2014-10-10 16:16:04,770 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not enforce SELinux. >2014-10-10 16:16:04,779 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-86) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:16:04,843 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-86) [27eb272d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:16:05,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-86) [27eb272d] START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,214b9ef3-b428-4d8d-b9eb-35f29765ec9e]), log id: 29380060 >2014-10-10 16:16:05,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-86) [27eb272d] FINISH, GetHardwareInfoVDSCommand, log id: 29380060 >2014-10-10 16:16:05,349 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-86) [27eb272d] Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:16:05,608 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-86) [270bb35] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:16:05,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-86) [270bb35] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e), log id: 5c670e98 >2014-10-10 16:16:05,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-86) [270bb35] FINISH, SetMOMPolicyParametersVDSCommand, log id: 5c670e98 >2014-10-10 16:16:05,954 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [270bb35] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:16:05,958 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [270bb35] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:16:05,973 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-86) [6fa98a84] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:16:05,977 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-86) [3d176d75] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:16:06,050 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-86) [5139c54f] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:16:06,052 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [5139c54f] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=NonOperational, nonOperationalReason=VERSION_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 1ca6d3ee >2014-10-10 16:16:06,056 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [5139c54f] FINISH, SetVdsStatusVDSCommand, log id: 1ca6d3ee >2014-10-10 16:16:06,088 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [5139c54f] Correlation ID: 5139c54f, Job ID: 7827e052-c40b-44e2-9d50-e7939b52d326, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com is installed with VDSM version (<UNKNOWN>) and cannot join cluster ppc64 which is compatible with VDSM versions [4.13, 4.14, 4.9, 4.11, 4.15, 4.12, 4.10]. >2014-10-10 16:16:06,095 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) [5139c54f] Host 214b9ef3-b428-4d8d-b9eb-35f29765ec9e : ibm-p8-rhevm-hv-01.lab.bos.redhat.com is already in NonOperational status for reason VERSION_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-10 16:19:48,945 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-68) Deactivating non existing principal admin::internal >2014-10-10 16:20:20,366 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [53cdf1eb] Attempting to update VMs/Templates Ovf. >2014-10-10 16:26:47,439 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-24) [23d9bfda] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:26:47,442 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-24) [23d9bfda] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: c8631ee >2014-10-10 16:26:47,446 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-24) [23d9bfda] FINISH, SetVdsStatusVDSCommand, log id: c8631ee >2014-10-10 16:26:47,561 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-24) [23d9bfda] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:26:47,568 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-24) [23d9bfda] Correlation ID: 23d9bfda, Job ID: 0bb7c62f-b6f4-477b-b89c-76b1e2362222, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was switched to Maintenance mode by admin. >2014-10-10 16:26:49,669 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:30:28,533 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-9) [78afa0e6] Lock Acquired to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:30:28,569 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:30:28,579 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:30:28,580 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:30:28,591 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2f870557 >2014-10-10 16:30:28,595 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] FINISH, SetVdsStatusVDSCommand, log id: 2f870557 >2014-10-10 16:30:28,632 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:30:28,638 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] Correlation ID: 78afa0e6, Job ID: 754c82aa-9d06-4999-a410-5909233cc666, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was activated by admin. >2014-10-10 16:30:28,643 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-40) [78afa0e6] Lock freed to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:30:29,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-33) [7993cf81] START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,214b9ef3-b428-4d8d-b9eb-35f29765ec9e]), log id: 6887c538 >2014-10-10 16:30:30,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-33) [7993cf81] FINISH, GetHardwareInfoVDSCommand, log id: 6887c538 >2014-10-10 16:30:30,061 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-33) [7993cf81] Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:30:30,084 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-33) [20c5c306] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:30:30,311 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-33) [4f3d8e0] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:30:30,374 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-33) [4f3d8e0] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e), log id: 62d1c0b8 >2014-10-10 16:30:30,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-33) [4f3d8e0] FINISH, SetMOMPolicyParametersVDSCommand, log id: 62d1c0b8 >2014-10-10 16:30:30,612 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) [4f3d8e0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:30:30,618 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) [4f3d8e0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:30:30,656 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-33) [7e3f49ad] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:33:56,439 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-22) [78ba6362] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:33:56,442 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-22) [78ba6362] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 9e34c75 >2014-10-10 16:33:56,447 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-22) [78ba6362] FINISH, SetVdsStatusVDSCommand, log id: 9e34c75 >2014-10-10 16:33:56,546 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-22) [78ba6362] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:33:56,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-22) [78ba6362] Correlation ID: 78ba6362, Job ID: ac7a525d-505b-4b20-bb9a-c178e2a64616, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was switched to Maintenance mode by admin. >2014-10-10 16:33:58,650 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:36:25,386 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-4) [4a2862c7] Lock Acquired to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:36:25,421 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:36:25,421 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:36:25,421 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:36:25,461 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: a2b77c6 >2014-10-10 16:36:25,468 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] FINISH, SetVdsStatusVDSCommand, log id: a2b77c6 >2014-10-10 16:36:25,771 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:36:25,777 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] Correlation ID: 4a2862c7, Job ID: 2aece30d-0d4d-4d46-b25a-a6b82698ac0a, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was activated by admin. >2014-10-10 16:36:25,793 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-27) [4a2862c7] Lock freed to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:36:26,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,214b9ef3-b428-4d8d-b9eb-35f29765ec9e]), log id: 52db7fb >2014-10-10 16:36:27,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GetHardwareInfoVDSCommand, log id: 52db7fb >2014-10-10 16:36:27,133 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:36:27,191 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-14) [7a3d98bc] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:36:27,352 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-14) [4f735b26] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:36:27,382 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-14) [4f735b26] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e), log id: 3059f552 >2014-10-10 16:36:27,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-14) [4f735b26] FINISH, SetMOMPolicyParametersVDSCommand, log id: 3059f552 >2014-10-10 16:36:27,625 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [4f735b26] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:36:27,630 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [4f735b26] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:36:27,648 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-14) [630c6efd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:36:36,974 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-48) [4f7af1a4] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:36:36,978 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-48) [4f7af1a4] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 9007c42 >2014-10-10 16:36:37,011 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-48) [4f7af1a4] FINISH, SetVdsStatusVDSCommand, log id: 9007c42 >2014-10-10 16:36:37,114 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-48) [4f7af1a4] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDS >2014-10-10 16:36:37,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-48) [4f7af1a4] Correlation ID: 4f7af1a4, Job ID: 3d66ba0b-8f3d-4225-a7cd-fc4740b4de6b, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was switched to Maintenance mode by admin. >2014-10-10 16:36:37,490 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:36:41,908 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-7) [5b4ad8c5] Lock Acquired to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:36:41,924 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-26) [5b4ad8c5] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e Type: VDSAction group DELETE_HOST with role type ADMIN >2014-10-10 16:36:42,076 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-26) [5b4ad8c5] START, RemoveVdsVDSCommand( HostId = 214b9ef3-b428-4d8d-b9eb-35f29765ec9e), log id: 6191d151 >2014-10-10 16:36:42,076 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-7-thread-26) [5b4ad8c5] vdsManager::disposing >2014-10-10 16:36:42,076 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-7-thread-26) [5b4ad8c5] FINISH, RemoveVdsVDSCommand, log id: 6191d151 >2014-10-10 16:36:42,079 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-26) [5b4ad8c5] Correlation ID: 5b4ad8c5, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was removed by admin. >2014-10-10 16:36:42,079 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-7-thread-26) [5b4ad8c5] Lock freed to object EngineLock [exclusiveLocks= key: 214b9ef3-b428-4d8d-b9eb-35f29765ec9e value: VDS >, sharedLocks= ] >2014-10-10 16:37:04,283 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-11) [56a5d60c] Running command: AddVdsCommand internal: false. Entities affected : ID: bbffe8c0-a1ae-4aaa-8f4b-944346a4fe3d Type: VdsGroupsAction group CREATE_HOST with role type ADMIN >2014-10-10 16:37:04,364 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:04,407 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] Lock freed to object EngineLock [exclusiveLocks= key: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 value: REGISTER_VDS >, sharedLocks= ] >2014-10-10 16:37:04,409 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] START, RemoveVdsVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 606213ca >2014-10-10 16:37:04,409 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] FINISH, RemoveVdsVDSCommand, log id: 606213ca >2014-10-10 16:37:04,411 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] START, AddVdsVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 570b7bf4 >2014-10-10 16:37:04,411 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] AddVds - entered , starting logic to add VDS 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 >2014-10-10 16:37:04,412 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] AddVds - VDS 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 was added, will try to add it to the resource manager >2014-10-10 16:37:04,412 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-11) [cf2df22] Entered VdsManager constructor >2014-10-10 16:37:04,424 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-11) [cf2df22] Initialize vdsBroker (ibm-p8-rhevm-hv-01.lab.bos.redhat.com,54,321) >2014-10-10 16:37:04,425 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-11) [cf2df22] VDS 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 was added to the Resource Manager >2014-10-10 16:37:04,425 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [cf2df22] FINISH, AddVdsVDSCommand, log id: 570b7bf4 >2014-10-10 16:37:04,431 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [cf2df22] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:37:04,442 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [cf2df22] Correlation ID: 56a5d60c, Job ID: 284d4e9a-832a-4a52-9577-10ae5733bb67, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was added by admin. >2014-10-10 16:37:04,445 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:37:04,452 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:04,452 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Before Installation host 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:37:04,455 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7b0037bf >2014-10-10 16:37:04,460 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] FINISH, SetVdsStatusVDSCommand, log id: 7b0037bf >2014-10-10 16:37:05,111 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Connected to host ibm-p8-rhevm-hv-01.lab.bos.redhat.com with SSH key fingerprint: 1e:d7:63:f6:39:d1:be:8d:21:d6:32:9b:89:95:a7:0b >2014-10-10 16:37:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Connected to host ibm-p8-rhevm-hv-01.lab.bos.redhat.com with SSH key fingerprint: 1e:d7:63:f6:39:d1:be:8d:21:d6:32:9b:89:95:a7:0b. >2014-10-10 16:37:05,644 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Installation of ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-10 16:37:05,665 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-7-thread-29) SSH execute root@ibm-p8-rhevm-hv-01.lab.bos.redhat.com 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-10 16:37:07,428 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-24) Initializing Host: ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:37:09,583 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Initializing >2014-10-10 16:37:09,590 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Initializing. >2014-10-10 16:37:09,756 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Environment setup >2014-10-10 16:37:09,764 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Environment setup. >2014-10-10 16:37:09,767 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Environment packages setup >2014-10-10 16:37:09,773 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Environment packages setup. >2014-10-10 16:37:09,915 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Programs detection >2014-10-10 16:37:09,921 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Programs detection. >2014-10-10 16:37:09,932 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Environment customization >2014-10-10 16:37:09,940 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Environment customization. >2014-10-10 16:37:10,097 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Kdump unsupported >2014-10-10 16:37:10,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Kdump unsupported. >2014-10-10 16:37:10,874 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20141010103709-ij4ca6.log' >2014-10-10 16:37:10,879 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20141010103709-ij4ca6.log'. >2014-10-10 16:37:12,870 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com reports unique id 2116A5A >2014-10-10 16:37:13,077 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 2116A5A to Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:37:18,118 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Disabling Kdump integration >2014-10-10 16:37:18,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Disabling Kdump integration. >2014-10-10 16:37:19,497 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Setup validation >2014-10-10 16:37:19,504 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Setup validation. >2014-10-10 16:37:19,545 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Hardware supports virtualization >2014-10-10 16:37:19,552 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Hardware supports virtualization. >2014-10-10 16:37:19,610 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Transaction setup >2014-10-10 16:37:19,616 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Transaction setup. >2014-10-10 16:37:19,623 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Misc configuration >2014-10-10 16:37:19,628 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Misc configuration. >2014-10-10 16:37:19,629 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Package installation >2014-10-10 16:37:19,634 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Package installation. >2014-10-10 16:37:25,736 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Misc configuration >2014-10-10 16:37:25,742 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Misc configuration. >2014-10-10 16:37:26,812 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Enrolling certificate >2014-10-10 16:37:26,822 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Enrolling certificate. >2014-10-10 16:37:28,163 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Transaction commit >2014-10-10 16:37:28,170 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Transaction commit. >2014-10-10 16:37:28,217 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Closing up >2014-10-10 16:37:28,223 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Closing up. >2014-10-10 16:37:29,516 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Restarting nrpe service >2014-10-10 16:37:29,523 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Restarting nrpe service. >2014-10-10 16:37:31,442 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stopping libvirtd >2014-10-10 16:37:31,457 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stopping libvirtd. >2014-10-10 16:37:31,793 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Starting vdsm >2014-10-10 16:37:31,800 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Starting vdsm. >2014-10-10 16:37:35,697 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Pre-termination >2014-10-10 16:37:35,703 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Pre-termination. >2014-10-10 16:37:36,467 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141010163736-ibm-p8-rhevm-hv-01.lab.bos.redhat.com-34746d4d.log' >2014-10-10 16:37:36,473 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141010163736-ibm-p8-rhevm-hv-01.lab.bos.redhat.com-34746d4d.log'. >2014-10-10 16:37:38,381 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation ibm-p8-rhevm-hv-01.lab.bos.redhat.com: Stage: Termination >2014-10-10 16:37:38,386 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 34746d4d, Call Stack: null, Custom Event ID: -1, Message: Installing Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. Stage: Termination. >2014-10-10 16:37:38,565 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-10 16:37:38,567 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Command PollVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-10 16:37:39,699 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Engine managed to communicate with VDSM agent on host ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:37:40,402 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-7-thread-29) [34746d4d] The management network rhevm is already configured on host ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:37:40,404 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4dda7304 >2014-10-10 16:37:40,408 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] FINISH, SetVdsStatusVDSCommand, log id: 4dda7304 >2014-10-10 16:37:40,408 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] After Installation host ibm-p8-rhevm-hv-01.lab.bos.redhat.com, VDS >2014-10-10 16:37:40,417 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Correlation ID: 34746d4d, Job ID: 284d4e9a-832a-4a52-9577-10ae5733bb67, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com installed >2014-10-10 16:37:40,429 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-7-thread-29) [34746d4d] Lock freed to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:37:41,064 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 225a2f75 >2014-10-10 16:37:41,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GetHardwareInfoVDSCommand, log id: 225a2f75 >2014-10-10 16:37:41,231 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not enforce SELinux. >2014-10-10 16:37:41,231 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-65) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:37:41,251 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-65) [298e760] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:41,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) [298e760] START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 79c6f19d >2014-10-10 16:37:41,988 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) [298e760] FINISH, GetHardwareInfoVDSCommand, log id: 79c6f19d >2014-10-10 16:37:41,991 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-65) [298e760] Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:37:42,211 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-65) [630ece6e] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:37:42,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-65) [630ece6e] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 1e2d51e7 >2014-10-10 16:37:42,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-65) [630ece6e] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1e2d51e7 >2014-10-10 16:37:42,458 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [630ece6e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:37:42,473 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [630ece6e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:37:42,567 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-65) [272fa10e] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:42,573 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-65) [215f8e5] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:42,642 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-65) [2d2b2612] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:42,804 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-65) [2d2b2612] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=NonOperational, nonOperationalReason=VERSION_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 113a1510 >2014-10-10 16:37:42,822 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-65) [2d2b2612] FINISH, SetVdsStatusVDSCommand, log id: 113a1510 >2014-10-10 16:37:42,843 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [2d2b2612] Correlation ID: 2d2b2612, Job ID: e1fa210f-9371-40db-8b0d-143a4a3c35e9, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com is installed with VDSM version (<UNKNOWN>) and cannot join cluster ppc64 which is compatible with VDSM versions [4.13, 4.14, 4.9, 4.11, 4.15, 4.12, 4.10]. >2014-10-10 16:37:42,849 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) [2d2b2612] Host 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 : ibm-p8-rhevm-hv-01.lab.bos.redhat.com is already in NonOperational status for reason VERSION_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-10 16:37:54,240 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-7-thread-43) [7cf0690d] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:37:54,243 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-43) [7cf0690d] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 2e674ce2 >2014-10-10 16:37:54,247 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-43) [7cf0690d] FINISH, SetVdsStatusVDSCommand, log id: 2e674ce2 >2014-10-10 16:37:54,796 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-7-thread-43) [7cf0690d] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:37:54,817 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-43) [7cf0690d] Correlation ID: 7cf0690d, Job ID: 59845e52-b46e-4474-9f39-4bb026327f77, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was switched to Maintenance mode by admin. >2014-10-10 16:37:55,338 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) [7356de8d] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:38:00,517 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-3) [5a395efc] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:38:00,545 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:38:00,545 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:38:00,545 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:38:00,556 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 5cb3dfc4 >2014-10-10 16:38:00,572 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] FINISH, SetVdsStatusVDSCommand, log id: 5cb3dfc4 >2014-10-10 16:38:00,578 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:38:00,582 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-3) [5a395efc] Correlation ID: 5a395efc, Job ID: e7c7001a-b7e0-408f-94d8-cce5dc493605, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was activated by admin. >2014-10-10 16:38:00,585 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-3) [5a395efc] Lock freed to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:38:01,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) [4ad5eafc] START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 19166994 >2014-10-10 16:38:02,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) [4ad5eafc] FINISH, GetHardwareInfoVDSCommand, log id: 19166994 >2014-10-10 16:38:02,150 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-23) [4ad5eafc] Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:38:02,171 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [481afc9d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:38:02,330 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-23) [1f622def] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:38:02,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [1f622def] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 1f0dc105 >2014-10-10 16:38:02,572 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [1f622def] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1f0dc105 >2014-10-10 16:38:02,578 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [1f622def] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:38:02,583 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [1f622def] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:38:02,591 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-23) [5a02333f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:38:02,614 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-23) [28bf3217] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:38:02,616 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-23) [28bf3217] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=NonOperational, nonOperationalReason=VERSION_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 67462253 >2014-10-10 16:38:02,619 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-23) [28bf3217] FINISH, SetVdsStatusVDSCommand, log id: 67462253 >2014-10-10 16:38:02,653 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [28bf3217] Correlation ID: 28bf3217, Job ID: 435fdf88-051f-4f8b-b7d6-fb860354d9fe, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com is installed with VDSM version (<UNKNOWN>) and cannot join cluster ppc64 which is compatible with VDSM versions [4.13, 4.14, 4.9, 4.11, 4.15, 4.12, 4.10]. >2014-10-10 16:38:02,661 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) [28bf3217] Host 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 : ibm-p8-rhevm-hv-01.lab.bos.redhat.com is already in NonOperational status for reason VERSION_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-10 16:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [196151bd] Autorecovering 1 hosts >2014-10-10 16:40:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [196151bd] Autorecovering hosts id: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, name : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:40:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:40:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:40:00,025 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:40:00,025 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:40:00,037 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7ab1432e >2014-10-10 16:40:00,041 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] FINISH, SetVdsStatusVDSCommand, log id: 7ab1432e >2014-10-10 16:40:00,246 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:40:00,268 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-36) [4d111652] Correlation ID: 4d111652, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was autorecovered. >2014-10-10 16:40:00,268 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-36) [4d111652] Lock freed to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:40:03,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 2fccceca >2014-10-10 16:40:03,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GetHardwareInfoVDSCommand, log id: 2fccceca >2014-10-10 16:40:03,842 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-66) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:40:03,862 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-66) [55f5b608] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:40:04,028 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-66) [478c414a] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:40:04,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-66) [478c414a] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 6eeedf14 >2014-10-10 16:40:04,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-66) [478c414a] FINISH, SetMOMPolicyParametersVDSCommand, log id: 6eeedf14 >2014-10-10 16:40:04,276 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [478c414a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:40:04,280 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [478c414a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:40:04,288 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-66) [54cf84b6] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:40:04,301 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-66) [a405689] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:40:04,302 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-66) [a405689] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=NonOperational, nonOperationalReason=VERSION_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 7a59763f >2014-10-10 16:40:04,305 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-66) [a405689] FINISH, SetVdsStatusVDSCommand, log id: 7a59763f >2014-10-10 16:40:04,315 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [a405689] Correlation ID: a405689, Job ID: 7a04a59a-f3dc-4d65-9c44-2c491b195273, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com is installed with VDSM version (<UNKNOWN>) and cannot join cluster ppc64 which is compatible with VDSM versions [4.13, 4.14, 4.9, 4.11, 4.15, 4.12, 4.10]. >2014-10-10 16:40:04,320 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) [a405689] Host 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 : ibm-p8-rhevm-hv-01.lab.bos.redhat.com is already in NonOperational status for reason VERSION_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-10 16:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) Autorecovering 1 hosts >2014-10-10 16:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) Autorecovering hosts id: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, name : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:45:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:45:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:45:00,023 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:45:00,024 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:45:00,043 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 43f4c462 >2014-10-10 16:45:00,047 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] FINISH, SetVdsStatusVDSCommand, log id: 43f4c462 >2014-10-10 16:45:00,055 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:45:00,057 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-68) [4939914d] Lock freed to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:45:02,694 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 29e7c413 >2014-10-10 16:45:02,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GetHardwareInfoVDSCommand, log id: 29e7c413 >2014-10-10 16:45:02,859 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-82) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:45:02,879 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-82) [21e5d33d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:45:03,041 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-82) [65e68fe9] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:45:03,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-82) [65e68fe9] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: ee0ec5f >2014-10-10 16:45:03,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-82) [65e68fe9] FINISH, SetMOMPolicyParametersVDSCommand, log id: ee0ec5f >2014-10-10 16:45:03,346 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-82) [65e68fe9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:45:03,350 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-82) [65e68fe9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:45:03,359 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-82) [14df5302] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:45:03,375 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-82) [287e8598] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:45:03,378 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-82) [287e8598] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=NonOperational, nonOperationalReason=VERSION_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 3d74c28e >2014-10-10 16:45:03,381 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-82) [287e8598] FINISH, SetVdsStatusVDSCommand, log id: 3d74c28e >2014-10-10 16:45:03,391 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-82) [287e8598] Correlation ID: 287e8598, Job ID: 8462f0ba-ab0b-4a5a-86a4-7808b45ee96d, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com is installed with VDSM version (<UNKNOWN>) and cannot join cluster ppc64 which is compatible with VDSM versions [4.13, 4.14, 4.9, 4.11, 4.15, 4.12, 4.10]. >2014-10-10 16:45:03,397 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-82) [287e8598] Host 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 : ibm-p8-rhevm-hv-01.lab.bos.redhat.com is already in NonOperational status for reason VERSION_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-10 16:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) Autorecovering 1 hosts >2014-10-10 16:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) Autorecovering hosts id: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, name : ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:50:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:50:00,026 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:50:00,035 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:50:00,036 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:50:00,040 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4a10b8d2 >2014-10-10 16:50:00,051 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] FINISH, SetVdsStatusVDSCommand, log id: 4a10b8d2 >2014-10-10 16:50:00,061 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:50:00,062 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [2c38e79b] Lock freed to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:50:01,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 57135a7 >2014-10-10 16:50:01,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GetHardwareInfoVDSCommand, log id: 57135a7 >2014-10-10 16:50:01,747 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-89) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:50:01,768 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-89) [3d7781ee] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:50:01,947 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-89) [109b8ab0] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:50:01,956 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-89) [109b8ab0] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 586c840e >2014-10-10 16:50:02,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-89) [109b8ab0] FINISH, SetMOMPolicyParametersVDSCommand, log id: 586c840e >2014-10-10 16:50:02,197 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) [109b8ab0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:50:02,202 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) [109b8ab0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:50:02,212 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-89) [42b7eb24] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:50:02,232 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-89) [4273e309] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:50:02,234 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-89) [4273e309] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=NonOperational, nonOperationalReason=VERSION_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 74dbb3be >2014-10-10 16:50:02,239 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-89) [4273e309] FINISH, SetVdsStatusVDSCommand, log id: 74dbb3be >2014-10-10 16:50:02,248 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) [4273e309] Correlation ID: 4273e309, Job ID: cff1369c-3f98-4c1e-b397-1820fc497d4e, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com is installed with VDSM version (<UNKNOWN>) and cannot join cluster ppc64 which is compatible with VDSM versions [4.13, 4.14, 4.9, 4.11, 4.15, 4.12, 4.10]. >2014-10-10 16:50:02,255 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-89) [4273e309] Host 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 : ibm-p8-rhevm-hv-01.lab.bos.redhat.com is already in NonOperational status for reason VERSION_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-10 16:54:55,309 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-7) [3ae6b4f4] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:54:55,331 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDSAction group MANIPULATE_HOST with role type ADMIN >2014-10-10 16:54:55,331 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] Before acquiring lock in order to prevent monitoring for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:54:55,331 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] Lock acquired, from now a monitoring of host will be skipped for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:54:55,344 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] START, SetVdsStatusVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 50e2a488 >2014-10-10 16:54:55,351 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] FINISH, SetVdsStatusVDSCommand, log id: 50e2a488 >2014-10-10 16:54:55,383 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] Activate finished. Lock released. Monitoring can run now for host ibm-p8-rhevm-hv-01.lab.bos.redhat.com from data-center ppc64 >2014-10-10 16:54:55,389 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] Correlation ID: 3ae6b4f4, Job ID: 1dd7b622-8b67-43ed-bfad-1378f1d370ca, Call Stack: null, Custom Event ID: -1, Message: Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was activated by admin. >2014-10-10 16:54:55,394 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-7-thread-25) [3ae6b4f4] Lock freed to object EngineLock [exclusiveLocks= key: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 value: VDS >, sharedLocks= ] >2014-10-10 16:54:57,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GetHardwareInfoVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vds=Host[ibm-p8-rhevm-hv-01.lab.bos.redhat.com,4a5632f9-e21e-4f8c-bc81-a72dab4b2a29]), log id: 3bc48659 >2014-10-10 16:54:57,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GetHardwareInfoVDSCommand, log id: 3bc48659 >2014-10-10 16:54:57,938 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-15) Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com does not report SELinux enforcement information. >2014-10-10 16:54:57,989 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-15) [7e7b7a27] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:54:58,151 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-15) [5ae14b50] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:54:58,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-15) [5ae14b50] START, SetMOMPolicyParametersVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29), log id: 1beaeea5 >2014-10-10 16:54:58,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-15) [5ae14b50] FINISH, SetMOMPolicyParametersVDSCommand, log id: 1beaeea5 >2014-10-10 16:54:58,408 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [5ae14b50] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host ibm-p8-rhevm-hv-01.lab.bos.redhat.com was set to Up. >2014-10-10 16:54:58,413 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [5ae14b50] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com. >2014-10-10 16:54:58,432 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-15) [813b8cf] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29 Type: VDS >2014-10-10 16:56:13,152 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-4) [148beaf8] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.34.63.199:/jbelka/ppc64 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-10-10 16:56:13,172 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-4) [148beaf8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:56:13,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-4) [148beaf8] START, ConnectStorageServerVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.34.63.199:/jbelka/ppc64, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 62dd8699 >2014-10-10 16:56:16,827 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-4) [148beaf8] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 62dd8699 >2014-10-10 16:56:16,846 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-4) [148beaf8] Lock freed to object EngineLock [exclusiveLocks= key: 10.34.63.199:/jbelka/ppc64 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-10-10 16:56:16,952 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:56:16,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] START, ConnectStorageServerVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1445b303-14ff-492a-bb54-aa9561d232e3, connection: 10.34.63.199:/jbelka/ppc64, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7767618b >2014-10-10 16:56:17,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] FINISH, ConnectStorageServerVDSCommand, return: {1445b303-14ff-492a-bb54-aa9561d232e3=0}, log id: 7767618b >2014-10-10 16:56:17,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] START, CreateStorageDomainVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storageDomain=StorageDomainStatic[ppc64, a6177451-eec3-4497-b811-c48410f9087f], args=10.34.63.199:/jbelka/ppc64), log id: 69f47a01 >2014-10-10 16:56:30,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] FINISH, CreateStorageDomainVDSCommand, log id: 69f47a01 >2014-10-10 16:56:30,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] START, GetStorageDomainStatsVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storageDomainId=a6177451-eec3-4497-b811-c48410f9087f), log id: 17b825ad >2014-10-10 16:56:30,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-12) [3c36f6ba] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, a6177451-eec3-4497-b811-c48410f9087f], log id: 17b825ad >2014-10-10 16:56:30,466 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [3c36f6ba] Correlation ID: 3c36f6ba, Job ID: e5c61d14-76a9-490b-9652-adddec02e264, Call Stack: null, Custom Event ID: -1, Message: Storage Domain ppc64 was added by admin >2014-10-10 16:56:30,550 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [4d15ed00] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:56:30,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [4d15ed00] START, DisconnectStorageServerVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1445b303-14ff-492a-bb54-aa9561d232e3, connection: 10.34.63.199:/jbelka/ppc64, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e39aca9 >2014-10-10 16:56:30,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [4d15ed00] FINISH, DisconnectStorageServerVDSCommand, return: {1445b303-14ff-492a-bb54-aa9561d232e3=0}, log id: 2e39aca9 >2014-10-10 16:56:30,974 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-1) [3780c3ae] Lock Acquired to object EngineLock [exclusiveLocks= key: a6177451-eec3-4497-b811-c48410f9087f value: STORAGE >, sharedLocks= ] >2014-10-10 16:56:30,983 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-1) [3780c3ae] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: a6177451-eec3-4497-b811-c48410f9087f Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:56:31,003 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-1) [5160f511] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePoolAction group CREATE_STORAGE_POOL with role type ADMIN >2014-10-10 16:56:31,211 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-1) [2f1e8224] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:56:31,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-1) [2f1e8224] START, ConnectStorageServerVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1445b303-14ff-492a-bb54-aa9561d232e3, connection: 10.34.63.199:/jbelka/ppc64, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e8454a6 >2014-10-10 16:56:34,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-1) [2f1e8224] FINISH, ConnectStorageServerVDSCommand, return: {1445b303-14ff-492a-bb54-aa9561d232e3=0}, log id: 4e8454a6 >2014-10-10 16:56:34,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [2f1e8224] START, CreateStoragePoolVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId=e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1, storagePoolName=ppc64, masterDomainId=a6177451-eec3-4497-b811-c48410f9087f, domainsIdList=[a6177451-eec3-4497-b811-c48410f9087f], masterVersion=1), log id: 6147b222 >2014-10-10 16:57:17,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [2f1e8224] FINISH, CreateStoragePoolVDSCommand, log id: 6147b222 >2014-10-10 16:57:17,730 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-1) [2f1e8224] Lock freed to object EngineLock [exclusiveLocks= key: a6177451-eec3-4497-b811-c48410f9087f value: STORAGE >, sharedLocks= ] >2014-10-10 16:57:17,731 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [1072f026] Lock Acquired to object EngineLock [exclusiveLocks= key: a6177451-eec3-4497-b811-c48410f9087f value: STORAGE >, sharedLocks= ] >2014-10-10 16:57:17,736 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [1072f026] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: a6177451-eec3-4497-b811-c48410f9087f Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:57:17,742 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [1072f026] Lock freed to object EngineLock [exclusiveLocks= key: a6177451-eec3-4497-b811-c48410f9087f value: STORAGE >, sharedLocks= ] >2014-10-10 16:57:17,742 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [1072f026] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/10/14 4:57 PM >2014-10-10 16:57:17,745 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-7-thread-37) [7545d5aa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN >2014-10-10 16:57:17,748 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-37) [7545d5aa] START, ConnectStorageServerVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1445b303-14ff-492a-bb54-aa9561d232e3, connection: 10.34.63.199:/jbelka/ppc64, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4537acb3 >2014-10-10 16:57:18,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-7-thread-37) [7545d5aa] FINISH, ConnectStorageServerVDSCommand, return: {1445b303-14ff-492a-bb54-aa9561d232e3=0}, log id: 4537acb3 >2014-10-10 16:57:18,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-1) [1072f026] START, ActivateStorageDomainVDSCommand( storagePoolId = e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1, ignoreFailoverLimit = false, storageDomainId = a6177451-eec3-4497-b811-c48410f9087f), log id: 5c865a7a >2014-10-10 16:57:18,228 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp-/127.0.0.1:8702-1) [7076960f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1 Type: StoragePool >2014-10-10 16:57:18,236 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7076960f] Correlation ID: 7076960f, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. >2014-10-10 16:57:18,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-1) [7076960f] hostFromVds::selectedVds - ibm-p8-rhevm-hv-01.lab.bos.redhat.com, spmStatus Unknown_Pool, storage pool ppc64 >2014-10-10 16:57:18,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] START, ConnectStoragePoolVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vdsId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1, masterVersion = 1), log id: 46e912c4 >2014-10-10 16:57:25,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] FINISH, ConnectStoragePoolVDSCommand, log id: 46e912c4 >2014-10-10 16:57:25,258 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-1) [7076960f] hostFromVds::Connected host to pool - selectedVds - ibm-p8-rhevm-hv-01.lab.bos.redhat.com, spmStatus Free, storage pool ppc64 >2014-10-10 16:57:25,281 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-1) [7076960f] starting spm on vds ibm-p8-rhevm-hv-01.lab.bos.redhat.com, storage pool ppc64, prevId -1, LVER -1 >2014-10-10 16:57:25,282 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] START, SpmStartVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1bc5e7b3 >2014-10-10 16:57:25,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] spmStart polling started: taskId = e1ea9845-95ae-40e6-9e2d-3e89dff0f93e >2014-10-10 16:57:59,092 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] spmStart polling ended: taskId = e1ea9845-95ae-40e6-9e2d-3e89dff0f93e task status = finished >2014-10-10 16:57:59,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] spmStart polling ended, spm status: SPM >2014-10-10 16:57:59,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] START, HSMClearTaskVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, taskId=e1ea9845-95ae-40e6-9e2d-3e89dff0f93e), log id: 23169510 >2014-10-10 16:57:59,415 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] FINISH, HSMClearTaskVDSCommand, log id: 23169510 >2014-10-10 16:57:59,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6519116f, log id: 1bc5e7b3 >2014-10-10 16:57:59,419 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp-/127.0.0.1:8702-1) [7076960f] Initialize Irs proxy from vds: ibm-p8-rhevm-hv-01.lab.bos.redhat.com >2014-10-10 16:57:59,425 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7076960f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host ibm-p8-rhevm-hv-01.lab.bos.redhat.com (Address: ibm-p8-rhevm-hv-01.lab.bos.redhat.com). >2014-10-10 16:58:00,018 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-1) [7076960f] FINISH, ActivateStorageDomainVDSCommand, log id: 5c865a7a >2014-10-10 16:58:00,018 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [7076960f] ActivateStorage Domain. After Connect all hosts to pool. Time:10/10/14 4:58 PM >2014-10-10 16:58:00,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-35) START, ConnectStoragePoolVDSCommand(HostName = ibm-p8-rhevm-hv-01.lab.bos.redhat.com, HostId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, vdsId = 4a5632f9-e21e-4f8c-bc81-a72dab4b2a29, storagePoolId = e36cf59c-c00f-4a41-85d9-6a4c0bb5b1a1, masterVersion = 1), log id: 3d652d10 >2014-10-10 16:58:02,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-7-thread-35) FINISH, ConnectStoragePoolVDSCommand, log id: 3d652d10 >2014-10-10 16:58:02,555 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [7076960f] ActivateStorage Domain. After change storage pool status in vds. Time:10/10/14 4:58 PM >2014-10-10 16:58:02,561 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7076960f] Correlation ID: 1072f026, Call Stack: null, Custom Event ID: -1, Message: Storage Domain ppc64 (Data Center ppc64) was activated by admin >2014-10-10 16:58:02,567 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7076960f] Correlation ID: 5160f511, Job ID: 1e3db34b-44b4-41d4-bf16-1da232aecbab, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center ppc64 by admin >2014-10-10 16:58:02,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7076960f] Correlation ID: 3780c3ae, Job ID: 1e3db34b-44b4-41d4-bf16-1da232aecbab, Call Stack: null, Custom Event ID: -1, Message: Storage Domain ppc64 was attached to Data Center ppc64 by admin >2014-10-10 16:58:02,580 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp-/127.0.0.1:8702-1) [7076960f] Trying to release exclusive lock which does not exist, lock key: a6177451-eec3-4497-b811-c48410f9087fSTORAGE >2014-10-10 16:58:02,581 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-1) [7076960f] Lock freed to object EngineLock [exclusiveLocks= key: a6177451-eec3-4497-b811-c48410f9087f value: STORAGE >, sharedLocks= ] >2014-10-10 17:00:03,908 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginUserCommand internal: false. >2014-10-10 17:00:03,911 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 17:00:04,375 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-4) [5c64d180] Lock Acquired to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:00:04,410 WARN [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-4) [5c64d180] CanDoAction of action AddVmFromScratch failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM,VM_MIGRATION_IS_NOT_SUPPORTED >2014-10-10 17:00:04,410 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-4) [5c64d180] Lock freed to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:00:04,493 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-4) Operation Failed: [Cannot add VM. Migration option is not supported in this CPU architecture.] >2014-10-10 17:00:05,154 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-4) [5420e1a9] Running command: LogoutBySessionCommand internal: false. >2014-10-10 17:00:05,160 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-4) [1b2c5657] Running command: LogoutUserCommand internal: false. >2014-10-10 17:00:05,163 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [1b2c5657] Correlation ID: 1b2c5657, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-10 17:04:07,745 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-7) [e5decdc] Lock Acquired to object EngineLock [exclusiveLocks= key: tttt value: VM_NAME >, sharedLocks= ] >2014-10-10 17:04:07,815 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-7) [e5decdc] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: bbffe8c0-a1ae-4aaa-8f4b-944346a4fe3d Type: VdsGroupsAction group CREATE_VM with role type USER >2014-10-10 17:04:07,963 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [e5decdc] Correlation ID: e5decdc, Job ID: e0d86e37-6738-4126-aecb-55b35e59afe5, Call Stack: null, Custom Event ID: -1, Message: VM tttt was created by admin. >2014-10-10 17:04:07,968 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-7) [e5decdc] Lock freed to object EngineLock [exclusiveLocks= key: tttt value: VM_NAME >, sharedLocks= ] >2014-10-10 17:04:08,735 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-1) [6e4629e5] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: b6957f03-4216-4b29-8751-0e6926ad4a8d Type: VMAction group CREATE_VM with role type USER >2014-10-10 17:05:14,738 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginUserCommand internal: false. >2014-10-10 17:05:14,741 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 17:05:14,803 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-2) [3543e769] Lock Acquired to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:05:14,828 WARN [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-2) [3543e769] CanDoAction of action AddVmFromScratch failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM,VM_MIGRATION_IS_NOT_SUPPORTED >2014-10-10 17:05:14,828 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-2) [3543e769] Lock freed to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:05:14,837 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-2) Operation Failed: [Cannot add VM. Migration option is not supported in this CPU architecture.] >2014-10-10 17:05:14,842 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-2) [4393f9a0] Running command: LogoutBySessionCommand internal: false. >2014-10-10 17:05:14,844 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [7a98a47a] Running command: LogoutUserCommand internal: false. >2014-10-10 17:05:14,847 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [7a98a47a] Correlation ID: 7a98a47a, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-10 17:08:49,557 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginUserCommand internal: false. >2014-10-10 17:08:49,562 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 17:08:49,653 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-12) [79ccb2ab] Lock Acquired to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:08:49,691 WARN [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-12) [79ccb2ab] CanDoAction of action AddVmFromScratch failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM,VM_MIGRATION_IS_NOT_SUPPORTED >2014-10-10 17:08:49,691 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-12) [79ccb2ab] Lock freed to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:08:49,699 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-12) Operation Failed: [Cannot add VM. Migration option is not supported in this CPU architecture.] >2014-10-10 17:08:49,704 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-12) [1ec6c742] Running command: LogoutBySessionCommand internal: false. >2014-10-10 17:08:49,749 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-12) [529a564] Running command: LogoutUserCommand internal: false. >2014-10-10 17:08:49,755 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [529a564] Correlation ID: 529a564, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-10 17:09:09,397 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginUserCommand internal: false. >2014-10-10 17:09:09,414 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 17:09:09,535 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-2) [34a69157] Running command: LogoutBySessionCommand internal: false. >2014-10-10 17:09:09,537 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [3455fb7b] Running command: LogoutUserCommand internal: false. >2014-10-10 17:09:09,541 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [3455fb7b] Correlation ID: 3455fb7b, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-10 17:09:50,253 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-10-10 17:09:50,257 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 17:09:50,657 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-7) [66729a3] Lock Acquired to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:09:50,685 WARN [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-7) [66729a3] CanDoAction of action AddVmFromScratch failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM,VM_MIGRATION_IS_NOT_SUPPORTED >2014-10-10 17:09:50,685 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-7) [66729a3] Lock freed to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:09:50,695 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-7) Operation Failed: [Cannot add VM. Migration option is not supported in this CPU architecture.] >2014-10-10 17:09:50,700 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-7) [51ad78d6] Running command: LogoutBySessionCommand internal: false. >2014-10-10 17:09:50,703 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-7) [76a5627] Running command: LogoutUserCommand internal: false. >2014-10-10 17:09:50,707 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [76a5627] Correlation ID: 76a5627, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-10-10 17:11:49,227 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginUserCommand internal: false. >2014-10-10 17:11:49,230 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-10 17:11:49,564 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [bd37b4d] Lock Acquired to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:11:49,602 WARN [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [bd37b4d] CanDoAction of action AddVmFromScratch failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__VM,VM_MIGRATION_IS_NOT_SUPPORTED >2014-10-10 17:11:49,603 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [bd37b4d] Lock freed to object EngineLock [exclusiveLocks= key: otheros-ppc64 value: VM_NAME >, sharedLocks= ] >2014-10-10 17:11:49,612 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (ajp-/127.0.0.1:8702-3) Operation Failed: [Cannot add VM. Migration option is not supported in this CPU architecture.] >2014-10-10 17:11:49,617 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (ajp-/127.0.0.1:8702-3) [24dd3eaf] Running command: LogoutBySessionCommand internal: false. >2014-10-10 17:11:49,619 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [2898ee60] Running command: LogoutUserCommand internal: false. >2014-10-10 17:11:49,623 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [2898ee60] Correlation ID: 2898ee60, Call Stack: null, Custom Event ID: -1, Message: User admin logged out.
<b>You cannot view the attachment while viewing its details because your browser does not support IFRAMEs. <a href="attachment.cgi?id=945692">View the attachment on a separate page</a>.</b>
View Attachment As Raw
Actions:
View
Attachments on
bug 1151516
: 945692