Attachment 920462 Details for Bug 1109722 – Engine logs

Engine logs

engine.log (text/x-log), 69.59 KB, created by Roman Hodain on 2014-07-24 08:20:55 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Roman Hodain

Created: 2014-07-24 08:20:55 UTC

Size: 69.59 KB

patch

obsolete

>2014-07-24 10:04:01,450 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf".
>2014-07-24 10:04:01,592 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties.
>2014-07-24 10:04:01,651 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf".
>2014-07-24 10:04:01,662 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf".
>2014-07-24 10:04:01,677 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf".
>2014-07-24 10:04:01,677 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf".
>2014-07-24 10:04:01,678 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf".
>2014-07-24 10:04:01,678 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf".
>2014-07-24 10:04:01,678 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/20-ovirt-engine-reports.conf".
>2014-07-24 10:04:01,679 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/20-rhevm-reports-license.conf".
>2014-07-24 10:04:01,679 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf".
>2014-07-24 10:04:01,728 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_AJP_ENABLED" is "true".
>2014-07-24 10:04:01,729 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_AJP_PORT" is "8702".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" "/var/lib/ovirt-engine-reports/ovirt-engine-reports.war" redhat-support-plugin-rhev.ear".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_DATABASE" is "engine".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_HOST" is "localhost".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1".
>2014-07-24 10:04:01,730 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_PASSWORD" is "***".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_PORT" is "5432".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SECURED" is "False".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_USER" is "engine".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DEBUG_ADDRESS" is "".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_ETC" is "/etc/ovirt-engine".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_FQDN" is "vm-236.gsslab.brq.redhat.com".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_GROUP" is "ovirt".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HEAP_MAX" is "1g".
>2014-07-24 10:04:01,731 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HEAP_MIN" is "1g".
>2014-07-24 10:04:01,732 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_ENABLED" is "false".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_PORT" is "None".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTP_ENABLED" is "false".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTP_PORT" is "None".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules:/var/lib/ovirt-engine-reports/modules".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"".
>2014-07-24 10:04:01,736 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_LOG_TO_CONSOLE" is "false".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PERM_MAX" is "256m".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PERM_MIN" is "256m".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***".
>2014-07-24 10:04:01,737 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false "-Djs.license.directory=/usr/share/ovirt-engine-reports/conf"".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_ENABLED" is "true".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_HTTP_PORT" is "80".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_STOP_INTERVAL" is "1".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_STOP_TIME" is "10".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_URI" is "/ovirt-engine".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_USER" is "ovirt".
>2014-07-24 10:04:01,738 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine".
>2014-07-24 10:04:01,739 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine".
>2014-07-24 10:04:01,739 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_VERBOSE_GC" is "false".
>2014-07-24 10:04:01,739 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "JBOSS_HOME" is "/usr/share/jbossas".
>2014-07-24 10:04:01,739 INFO  [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD".
>2014-07-24 10:04:24,989 INFO  [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 52) Start initializing Backend
>2014-07-24 10:04:29,289 INFO  [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 52) Running ovirt-engine 3.4.0-0.22.el6ev
>2014-07-24 10:04:29,332 INFO  [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 52) Start initializing dictionaries
>2014-07-24 10:04:29,479 INFO  [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 52) Finished initializing dictionaries
>2014-07-24 10:04:29,501 INFO  [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 52) Start initializing AuditLogCleanupManager
>2014-07-24 10:04:29,530 INFO  [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 52) Setting audit cleanup manager to run at: 35 35 3 * * ?
>2014-07-24 10:04:30,231 INFO  [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 52) Finished initializing AuditLogCleanupManager
>2014-07-24 10:04:30,238 INFO  [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 52) Start initializing TagsDirector
>2014-07-24 10:04:30,291 INFO  [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 52) Tag root added to tree
>2014-07-24 10:04:30,384 INFO  [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 52) Tag AlwaysUp added to tree
>2014-07-24 10:04:30,390 INFO  [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 52) Tag AlwaysUp added as child to parent root
>2014-07-24 10:04:30,402 INFO  [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 52) Finished initializing TagsDirector
>2014-07-24 10:04:30,406 INFO  [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 52) Start initializing IsoDomainListSyncronizer
>2014-07-24 10:04:30,426 INFO  [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 52) Finished initializing IsoDomainListSyncronizer
>2014-07-24 10:04:30,457 INFO  [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 52) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties
>2014-07-24 10:04:31,754 INFO  [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 52) Completed initializing handlers
>2014-07-24 10:04:31,756 INFO  [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 52) Start initializing ErrorTranslatorImpl
>2014-07-24 10:04:31,870 WARN  [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 52) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table.
>2014-07-24 10:04:31,872 INFO  [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 52) Finished initializing ErrorTranslatorImpl
>2014-07-24 10:04:31,872 INFO  [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 52) Start initializing ErrorTranslatorImpl
>2014-07-24 10:04:31,873 INFO  [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 52) Finished initializing ErrorTranslatorImpl
>2014-07-24 10:04:31,873 INFO  [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 52) Mark incomplete jobs as UNKNOWN
>2014-07-24 10:04:32,461 INFO  [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 52) Start initializing JobRepositoryCleanupManager
>2014-07-24 10:04:32,462 INFO  [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 52) Finished initializing JobRepositoryCleanupManager
>2014-07-24 10:04:32,464 INFO  [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 52) Start initializing AutoRecoveryManager
>2014-07-24 10:04:32,466 INFO  [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 52) Finished initializing AutoRecoveryManager
>2014-07-24 10:04:32,468 INFO  [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 52) Start initializing ExecutionMessageDirector
>2014-07-24 10:04:32,470 INFO  [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 52) Finished initializing ExecutionMessageDirector
>2014-07-24 10:04:32,996 INFO  [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 46) Start initializing UsersDomainsCacheManagerService
>2014-07-24 10:04:33,766 INFO  [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 46) Start initializing DbUserCacheManager
>2014-07-24 10:04:33,768 INFO  [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 46) Finished initializing DbUserCacheManager
>2014-07-24 10:04:33,768 INFO  [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 46) Finished initializing UsersDomainsCacheManagerService
>2014-07-24 10:04:33,832 INFO  [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 37) Initialization of AsyncTaskManager completed successfully.
>2014-07-24 10:04:33,866 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) Start initializing ResourceManager
>2014-07-24 10:04:36,993 ERROR [org.ovirt.engine.core.bll.adbroker.GetRootDSE] (DefaultQuartzScheduler_Worker-1) Failed to query rootDSE for LDAP server LDAP://lab-rhevm.gsslab.brq.redhat.com:389 due to JBAS011843: Failed instantiate InitialContextFactory com.sun.jndi.ldap.LdapCtxFactory from classloader ModuleClassLoader for Module "deployment.engine.ear.scheduler.jar:main" from Service Module Loader
>2014-07-24 10:04:37,253 ERROR [org.ovirt.engine.core.bll.adbroker.DirectorySearcher] (DefaultQuartzScheduler_Worker-1) Failed ldap search server LDAP://lab-rhevm.gsslab.brq.redhat.com:389 using user rhevadmin@GSSLAB.BRQ.REDHAT.COM due to javax.naming.NamingException: JBAS011843: Failed instantiate InitialContextFactory com.sun.jndi.ldap.LdapCtxFactory from classloader ModuleClassLoader for Module "deployment.engine.ear.scheduler.jar:main" from Service Module Loader [Root exception is javax.naming.CommunicationException: lab-rhevm.gsslab.brq.redhat.com:389 [Root exception is java.net.NoRouteToHostException: No route to host]]. We should try the next server
>2014-07-24 10:04:39,531 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) Entered VdsManager constructor
>2014-07-24 10:04:40,320 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) Initialize vdsBroker (10.34.57.155,54,321)
>2014-07-24 10:04:45,796 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) VDS cf443954-bf2f-47ee-a8a9-7d078d5b5b11 was added to the Resource Manager
>2014-07-24 10:04:46,135 INFO  [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) Finished initializing ResourceManager
>2014-07-24 10:04:46,221 INFO  [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 37) Initialization of OvfDataUpdater completed successfully.
>2014-07-24 10:04:46,373 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Start scheduling to enable vds load balancer
>2014-07-24 10:04:46,377 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Finished scheduling to enable vds load balancer
>2014-07-24 10:04:46,378 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Start HA Reservation check
>2014-07-24 10:04:46,398 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Finished HA Reservation check
>2014-07-24 10:04:46,550 INFO  [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(5a137ab4): Start initializing
>2014-07-24 10:04:47,505 INFO  [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) Init VM custom properties utilities
>2014-07-24 10:04:47,580 INFO  [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) Init device custom properties utilities
>2014-07-24 10:04:47,816 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Initializing Scheduling manager
>2014-07-24 10:04:47,844 INFO  [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(5a137ab4): Finished initializing. Available MACs in pool: 244
>2014-07-24 10:04:48,846 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) External scheduler disabled, discovery skipped
>2014-07-24 10:04:48,846 INFO  [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Initialized Scheduling manager
>2014-07-24 10:04:48,875 INFO  [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 37) Initializing DWH Heart Beat
>2014-07-24 10:04:48,877 INFO  [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 37) DWH Heart Beat initialized
>2014-07-24 10:04:55,433 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GetHardwareInfoVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]), log id: 37277954
>2014-07-24 10:04:56,131 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GetHardwareInfoVDSCommand, log id: 37277954
>2014-07-24 10:05:01,788 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-16) [22a220ca] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected :  ID: cf443954-bf2f-47ee-a8a9-7d078d5b5b11 Type: VDS
>2014-07-24 10:05:05,162 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-16) [22a220ca] START, GetHardwareInfoVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]), log id: 5a82c042
>2014-07-24 10:05:05,875 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-16) [22a220ca] FINISH, GetHardwareInfoVDSCommand, log id: 5a82c042
>2014-07-24 10:05:11,447 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: UNASSIGNED not exist in string table
>2014-07-24 10:05:11,448 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table
>2014-07-24 10:05:11,448 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table
>2014-07-24 10:05:11,448 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table
>2014-07-24 10:05:11,523 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table
>2014-07-24 10:05:11,524 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_FAILED_REMOVE_VM not exist in string table
>2014-07-24 10:05:11,524 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table
>2014-07-24 10:05:11,528 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table
>2014-07-24 10:05:11,548 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table
>2014-07-24 10:05:11,549 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: DWH_STOPPED not exist in string table
>2014-07-24 10:05:11,549 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: DWH_STARTED not exist in string table
>2014-07-24 10:05:11,549 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: DWH_ERROR not exist in string table
>2014-07-24 10:05:11,638 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal
>2014-07-24 10:05:11,640 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal
>2014-07-24 10:05:11,642 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal
>2014-07-24 10:05:11,642 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal
>2014-07-24 10:05:11,643 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal
>2014-07-24 10:05:11,643 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal
>2014-07-24 10:05:11,643 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal
>2014-07-24 10:05:11,645 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal
>2014-07-24 10:05:11,646 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal
>2014-07-24 10:05:11,648 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal
>2014-07-24 10:05:11,649 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal
>2014-07-24 10:05:11,649 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal
>2014-07-24 10:05:11,652 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal
>2014-07-24 10:05:11,652 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal
>2014-07-24 10:05:11,658 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal
>2014-07-24 10:05:11,658 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal
>2014-07-24 10:05:11,658 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal
>2014-07-24 10:05:11,658 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal
>2014-07-24 10:05:12,975 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [22a220ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.34.57.155.
>2014-07-24 10:05:22,777 INFO  [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-16) [4316f6f7] Running command: InitVdsOnUpCommand internal: true. Entities affected :  ID: 00000002-0002-0002-0002-00000000016d Type: StoragePool
>2014-07-24 10:05:23,233 INFO  [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected :  ID: 00000002-0002-0002-0002-00000000016d Type: StoragePool
>2014-07-24 10:05:25,182 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] START, ConnectStorageServerVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, storagePoolId = 00000002-0002-0002-0002-00000000016d, storageType = NFS, connectionList = [{ id: b5fb1ed8-2f53-49d8-8813-100dcdd209ac, connection: 10.34.1.101:/exports/rhevexport01, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1184f95
>2014-07-24 10:05:27,146 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] FINISH, ConnectStorageServerVDSCommand, return: {b5fb1ed8-2f53-49d8-8813-100dcdd209ac=0}, log id: 1184f95
>2014-07-24 10:05:27,769 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] START, ConnectStorageServerVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, storagePoolId = 00000002-0002-0002-0002-00000000016d, storageType = ISCSI, connectionList = [{ id: 3d47b309-afcf-444d-bdac-a68b5f53d9ec, connection: 10.34.1.101, iqn: iqn.2012-06.com.redhat:storage.rhev01, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 10a71695
>2014-07-24 10:05:30,190 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] FINISH, ConnectStorageServerVDSCommand, return: {3d47b309-afcf-444d-bdac-a68b5f53d9ec=0}, log id: 10a71695
>2014-07-24 10:05:30,195 INFO  [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] Host 10.34.57.155 storage connection was succeeded 
>2014-07-24 10:05:30,954 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-10) START, ConnectStoragePoolVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, storagePoolId = 00000002-0002-0002-0002-00000000016d, vds_spm_id = 2, masterDomainId = d70849d3-71cf-4e52-a970-fe26f4609bca, masterVersion = 5), log id: 7834cca5
>2014-07-24 10:05:34,485 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-10) FINISH, ConnectStoragePoolVDSCommand, log id: 7834cca5
>2014-07-24 10:05:37,390 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] START, SetMOMPolicyParametersVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11), log id: 3fb34a11
>2014-07-24 10:05:38,338 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-16) [5164fe73] FINISH, SetMOMPolicyParametersVDSCommand, log id: 3fb34a11
>2014-07-24 10:05:38,523 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [5164fe73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.34.57.155.
>2014-07-24 10:05:40,201 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-16) [5164fe73] Initializing Host: 10.34.57.155
>2014-07-24 10:05:40,339 INFO  [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-16) [34cb8bc6] Running command: HandleVdsVersionCommand internal: true. Entities affected :  ID: cf443954-bf2f-47ee-a8a9-7d078d5b5b11 Type: VDS
>2014-07-24 10:05:43,407 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-96) hostFromVds::selectedVds - 10.34.57.155, spmStatus Free, storage pool Default
>2014-07-24 10:05:44,191 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-96) SpmStatus on vds cf443954-bf2f-47ee-a8a9-7d078d5b5b11: Free
>2014-07-24 10:05:44,603 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-96) starting spm on vds 10.34.57.155, storage pool Default, prevId 2, LVER 42
>2014-07-24 10:05:44,925 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-96) START, SpmStartVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, storagePoolId = 00000002-0002-0002-0002-00000000016d, prevId=2, prevLVER=42, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 68a2b454
>2014-07-24 10:05:46,799 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-96) spmStart polling started: taskId = 2c9636f1-2502-4dd5-a128-489cce6349cc
>2014-07-24 10:05:50,050 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-96) spmStart polling ended: taskId = 2c9636f1-2502-4dd5-a128-489cce6349cc task status = finished
>2014-07-24 10:05:50,809 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-96) spmStart polling ended, spm status: SPM
>2014-07-24 10:05:50,813 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-96) START, HSMClearTaskVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, taskId=2c9636f1-2502-4dd5-a128-489cce6349cc), log id: 77abe67b
>2014-07-24 10:05:51,206 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, HSMClearTaskVDSCommand, log id: 77abe67b
>2014-07-24 10:05:51,209 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3e92da, log id: 68a2b454
>2014-07-24 10:05:51,269 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-96) Initialize Irs proxy from vds: 10.34.57.155
>2014-07-24 10:05:51,521 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-96) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.34.57.155 (Address: 10.34.57.155).
>2014-07-24 10:05:52,904 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-26) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000016d, ignoreFailoverLimit = false), log id: 9acd602
>2014-07-24 10:05:58,326 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-26) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-00000000016d
>2014-07-24 10:05:58,421 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-26) START, HSMGetAllTasksInfoVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11), log id: 6ffb2cb2
>2014-07-24 10:06:00,887 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-26) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 6ffb2cb2
>2014-07-24 10:06:00,887 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-26) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 9acd602
>2014-07-24 10:06:00,887 INFO  [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-26) Discovered no tasks on Storage Pool Default
>2014-07-24 10:06:01,173 INFO  [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-10) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json]
>2014-07-24 10:06:01,381 INFO  [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-10) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json]
>2014-07-24 10:07:29,854 INFO  [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false.
>2014-07-24 10:07:36,334 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in.
>2014-07-24 10:08:17,725 INFO  [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginUserCommand internal: false.
>2014-07-24 10:08:18,303 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in.
>2014-07-24 10:12:31,741 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-55) Command ListVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.util.concurrent.TimeoutException
>2014-07-24 10:12:32,269 WARN  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-55) Failed to refresh VDS , vds = cf443954-bf2f-47ee-a8a9-7d078d5b5b11 : 10.34.57.155, VDS Network Error, continuing.
>java.util.concurrent.TimeoutException
>2014-07-24 10:12:36,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:12:36,310 WARN  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-49) Failed to refresh VDS , vds = cf443954-bf2f-47ee-a8a9-7d078d5b5b11 : 10.34.57.155, VDS Network Error, continuing.
>java.net.ConnectException: Connection refused
>2014-07-24 10:12:39,541 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:12:39,566 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-52) Server failed to respond, vds_id = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds_name = 10.34.57.155, vm_count = 10, spm_status = SPM, non-responsive_timeout (seconds) = 85, error = java.net.ConnectException: Connection refused
>2014-07-24 10:12:39,830 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-52) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused
>	at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102)
>	at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56)
>	at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
>	at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:512)
>	at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:489)
>	at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:344)
>	at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:231)
>	at sun.reflect.GeneratedMethodAccessor73.invoke(Unknown Source)
>	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>	at java.lang.reflect.Method.invoke(Method.java:606)
>	at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>	at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>	at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>Caused by: java.net.ConnectException: Connection refused
>	at java.net.PlainSocketImpl.socketConnect(Native Method)
>	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>	at java.net.Socket.connect(Socket.java:579)
>	at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618)
>	at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288)
>	at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
>	at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)
>	at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
>	at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>	at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>	at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>	at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227)
>	at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151)
>	at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>	at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>	at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>	at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>	at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>	at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140)
>	at com.sun.proxy.$Proxy53.getVdsCapabilities(Unknown Source)
>	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>	at java.lang.reflect.Method.invoke(Method.java:606)
>	at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225)
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>	at java.lang.Thread.run(Thread.java:744)
>, Custom Event ID: -1, Message: Host 10.34.57.155 is non responsive.
>2014-07-24 10:12:39,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-42) Command SpmStatusVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, storagePoolId = 00000002-0002-0002-0002-00000000016d) execution failed. Exception: VDSNetworkException: java.util.concurrent.TimeoutException
>2014-07-24 10:12:39,915 INFO  [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-4-thread-9) ResourceManager::vdsNotResponding entered for Host cf443954-bf2f-47ee-a8a9-7d078d5b5b11, 10.34.57.155
>2014-07-24 10:12:40,212 INFO  [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-42) [77d530f9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected :  ID: 00000002-0002-0002-0002-00000000016d Type: StoragePool
>2014-07-24 10:12:40,504 INFO  [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-42) [77d530f9] Storage Pool 00000002-0002-0002-0002-00000000016d - Updating Storage Domain f24b24fe-3455-40c7-9e62-be1031eb2afb status from Active to Unknown, reason : null
>2014-07-24 10:12:40,539 INFO  [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-42) [77d530f9] Storage Pool 00000002-0002-0002-0002-00000000016d - Updating Storage Domain d70849d3-71cf-4e52-a970-fe26f4609bca status from Active to Unknown, reason : null
>2014-07-24 10:12:41,401 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [77d530f9] Correlation ID: 77d530f9, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting Data Center status to Non Responsive (On host 10.34.57.155, Error: Network error during communication with the Host.).
>2014-07-24 10:12:42,544 INFO  [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-4-thread-9) [5991c632] Running command: SshSoftFencingCommand internal: true. Entities affected :  ID: cf443954-bf2f-47ee-a8a9-7d078d5b5b11 Type: VDS
>2014-07-24 10:12:43,090 INFO  [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-4-thread-9) [5991c632] Opening SSH Soft Fencing session on host 10.34.57.155
>2014-07-24 10:12:44,285 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:12:48,350 INFO  [org.ovirt.engine.core.bll.SshSoftFencingCommand] (org.ovirt.thread.pool-4-thread-9) [5991c632] Executing SSH Soft Fencing command on host 10.34.57.155
>2014-07-24 10:12:48,581 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:12:52,000 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-42) [77d530f9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: NoHttpResponseException: The server 10.34.57.155 failed to respond
>2014-07-24 10:12:54,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out
>2014-07-24 10:12:58,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:12:58,568 WARN  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-87) Failed to refresh VDS , vds = cf443954-bf2f-47ee-a8a9-7d078d5b5b11 : 10.34.57.155, VDS Network Error, continuing.
>java.net.ConnectException: Connection refused
>2014-07-24 10:13:01,837 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:01,908 WARN  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-97) Failed to refresh VDS , vds = cf443954-bf2f-47ee-a8a9-7d078d5b5b11 : 10.34.57.155, VDS Network Error, continuing.
>java.net.ConnectException: Connection refused
>2014-07-24 10:13:02,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-84) Command SpmStatusVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, storagePoolId = 00000002-0002-0002-0002-00000000016d) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:02,419 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused
>2014-07-24 10:13:04,956 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:04,956 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-1) Server failed to respond, vds_id = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds_name = 10.34.57.155, vm_count = 10, spm_status = SPM, non-responsive_timeout (seconds) = 170, error = java.net.ConnectException: Connection refused
>2014-07-24 10:13:04,977 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused
>	at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102)
>	at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56)
>	at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
>	at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:512)
>	at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:489)
>	at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:344)
>	at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:231)
>	at sun.reflect.GeneratedMethodAccessor73.invoke(Unknown Source)
>	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>	at java.lang.reflect.Method.invoke(Method.java:606)
>	at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>	at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>	at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>Caused by: java.net.ConnectException: Connection refused
>	at java.net.PlainSocketImpl.socketConnect(Native Method)
>	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>	at java.net.Socket.connect(Socket.java:579)
>	at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618)
>	at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288)
>	at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
>	at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)
>	at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
>	at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>	at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>	at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>	at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227)
>	at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151)
>	at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
>	at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
>	at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
>	at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
>	at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
>	at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140)
>	at com.sun.proxy.$Proxy53.getVdsCapabilities(Unknown Source)
>	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>	at java.lang.reflect.Method.invoke(Method.java:606)
>	at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225)
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>	at java.lang.Thread.run(Thread.java:744)
>, Custom Event ID: -1, Message: Host 10.34.57.155 is non responsive.
>2014-07-24 10:13:05,000 INFO  [org.ovirt.engine.core.bll.VdsEventListener] (org.ovirt.thread.pool-4-thread-23) ResourceManager::vdsNotResponding entered for Host cf443954-bf2f-47ee-a8a9-7d078d5b5b11, 10.34.57.155
>2014-07-24 10:13:05,429 INFO  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Lock Acquired to object EngineLock [exclusiveLocks= key: cf443954-bf2f-47ee-a8a9-7d078d5b5b11 value: VDS_FENCE
>, sharedLocks= ]
>2014-07-24 10:13:05,556 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = 47446d04-dd1e-4293-ad7f-27e56497eaf4, status = Unknown, exit status = Normal), log id: 6278eb36
>2014-07-24 10:13:05,595 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 6278eb36
>2014-07-24 10:13:05,924 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-6 was set to the Unknown status.
>2014-07-24 10:13:05,932 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = 8eb0be42-f7c0-4bf4-8384-2f7a4da7aa51, status = Unknown, exit status = Normal), log id: 25fff2ed
>2014-07-24 10:13:06,170 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 25fff2ed
>2014-07-24 10:13:06,328 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-9 was set to the Unknown status.
>2014-07-24 10:13:06,329 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = 8aa1a3b6-bebc-4948-937d-762eeb6c4555, status = Unknown, exit status = Normal), log id: 52b6e5df
>2014-07-24 10:13:06,403 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 52b6e5df
>2014-07-24 10:13:06,747 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-5 was set to the Unknown status.
>2014-07-24 10:13:06,748 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = baa9da2c-c2eb-452b-b642-6b55352240e6, status = Unknown, exit status = Normal), log id: 1639afc0
>2014-07-24 10:13:07,235 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 1639afc0
>2014-07-24 10:13:07,549 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-4 was set to the Unknown status.
>2014-07-24 10:13:07,550 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = f863a415-bec7-445b-8c77-eea4f8e9e4db, status = Unknown, exit status = Normal), log id: 103b9319
>2014-07-24 10:13:07,654 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 103b9319
>2014-07-24 10:13:07,795 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-7 was set to the Unknown status.
>2014-07-24 10:13:07,796 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = 6604edc0-72eb-4af9-8391-7980bc9cf8b9, status = Unknown, exit status = Normal), log id: 17097504
>2014-07-24 10:13:07,871 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 17097504
>2014-07-24 10:13:08,075 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-2 was set to the Unknown status.
>2014-07-24 10:13:08,078 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = 803235b9-7fc6-48cb-b57d-b49b057531f3, status = Unknown, exit status = Normal), log id: 3434d677
>2014-07-24 10:13:08,278 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 3434d677
>2014-07-24 10:13:08,472 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-1 was set to the Unknown status.
>2014-07-24 10:13:08,472 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = feb40ff3-250f-4489-a813-e4bbabcdc3d0, status = Unknown, exit status = Normal), log id: 56128248
>2014-07-24 10:13:08,594 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 56128248
>2014-07-24 10:13:08,617 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:09,667 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-3 was set to the Unknown status.
>2014-07-24 10:13:09,696 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = efd3ddc2-826a-4009-89f8-32714169f21e, status = Unknown, exit status = Normal), log id: d3fa1a5
>2014-07-24 10:13:10,277 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: d3fa1a5
>2014-07-24 10:13:10,923 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-10 was set to the Unknown status.
>2014-07-24 10:13:10,929 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] START, SetVmStatusVDSCommand( vmId = 0dc16645-6167-4aad-ac00-b8c601135177, status = Unknown, exit status = Normal), log id: 263128b0
>2014-07-24 10:13:11,205 INFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] FINISH, SetVmStatusVDSCommand, log id: 263128b0
>2014-07-24 10:13:11,593 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM test-8 was set to the Unknown status.
>2014-07-24 10:13:11,593 INFO  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-23) [6662ea73] Fence failed on vds 10.34.57.155 which is spm of pool 00000002-0002-0002-0002-00000000016d - moving pool to non operational
>2014-07-24 10:13:11,605 INFO  [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (org.ovirt.thread.pool-4-thread-23) [453ad9d8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected :  ID: 00000002-0002-0002-0002-00000000016d Type: StoragePool
>2014-07-24 10:13:11,738 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [453ad9d8] Correlation ID: 453ad9d8, Call Stack: null, Custom Event ID: -1, Message: Fencing failed on Storage Pool Manager 10.34.57.155 for Data Center Default. Setting status to Non-Operational.
>2014-07-24 10:13:11,738 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-23) [453ad9d8] Failed to run Fence script on vds:10.34.57.155, VMs moved to UnKnown instead.
>2014-07-24 10:13:11,761 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [453ad9d8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host 10.34.57.155 became non responsive. It has no power management configured. Please check the host status, manually reboot it, and click "Confirm Host Has Been Rebooted"
>2014-07-24 10:13:11,764 WARN  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-23) [453ad9d8] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VAR__ACTION__RESTART,VDS_FENCE_DISABLED
>2014-07-24 10:13:11,764 INFO  [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (org.ovirt.thread.pool-4-thread-23) [453ad9d8] Lock freed to object EngineLock [exclusiveLocks= key: cf443954-bf2f-47ee-a8a9-7d078d5b5b11 value: VDS_FENCE
>, sharedLocks= ]
>2014-07-24 10:13:12,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:15,863 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:19,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:23,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:27,889 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:31,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:34,545 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:38,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:42,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:45,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [77d530f9] Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:48,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:52,305 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused
>2014-07-24 10:13:55,668 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GetCapabilitiesVDSCommand(HostName = 10.34.57.155, HostId = cf443954-bf2f-47ee-a8a9-7d078d5b5b11, vds=Host[10.34.57.155,cf443954-bf2f-47ee-a8a9-7d078d5b5b11]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused

Actions: View

Attachments on bug 1109722: 920462 | 920464