Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 884915 Details for
Bug 1086210
Guest can't boot up after the master domain change
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine log
engine.log (text/x-log), 2.19 MB, created by
Shanzhi Yu
on 2014-04-10 11:52:35 UTC
(
hide
)
Description:
engine log
Filename:
MIME Type:
Creator:
Shanzhi Yu
Created:
2014-04-10 11:52:35 UTC
Size:
2.19 MB
patch
obsolete
>2014-03-31 16:31:21,914 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-03-31 16:31:21,916 WARN [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-03-31 16:31:21,916 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-03-31 16:31:21,917 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-03-31 16:31:21,917 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-03-31 16:31:21,917 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-03-31 16:31:21,917 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-03-31 16:31:21,918 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-03-31 16:31:21,918 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-03-31 16:31:21,918 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_AJP_PORT" is "8702". >2014-03-31 16:31:21,918 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_APPS" is "engine.ear redhat-support-plugin-rhev.ear". >2014-03-31 16:31:21,918 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_HOST" is "localhost". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-03-31 16:31:21,919 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-03-31 16:31:21,923 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_PORT" is "5432". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_SECURED" is "False". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_SSL" is "false". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DB_USER" is "engine". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-03-31 16:31:21,931 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-03-31 16:31:21,932 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_FQDN" is "rhevm3.3-shyu.nay.redhat.com". >2014-03-31 16:31:21,932 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_GROUP" is "ovirt". >2014-03-31 16:31:21,932 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-03-31 16:31:21,932 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-03-31 16:31:21,932 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-03-31 16:31:21,932 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_HTTP_PORT" is "None". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PERM_MAX" is "256m". >2014-03-31 16:31:21,933 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PERM_MIN" is "256m". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-03-31 16:31:21,934 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_STOP_TIME" is "10". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_USER" is "ovirt". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-03-31 16:31:21,935 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 36) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-03-31 16:31:23,181 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 45) Start initializing Backend >2014-03-31 16:31:23,685 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 45) Running ovirt-engine 3.3.0-0.45.el6ev >2014-03-31 16:31:23,688 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 45) Start initializing dictionaries >2014-03-31 16:31:23,693 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 45) Finished initializing dictionaries >2014-03-31 16:31:23,694 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 45) Start initializing AuditLogCleanupManager >2014-03-31 16:31:23,694 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 45) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-03-31 16:31:23,722 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 45) Finished initializing AuditLogCleanupManager >2014-03-31 16:31:23,734 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 45) Start initializing TagsDirector >2014-03-31 16:31:23,756 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 45) Tag root added to tree >2014-03-31 16:31:23,794 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 45) Finished initializing TagsDirector >2014-03-31 16:31:23,799 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 45) Start initializing IsoDomainListSyncronizer >2014-03-31 16:31:23,814 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 45) Finished initializing IsoDomainListSyncronizer >2014-03-31 16:31:23,827 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 45) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-03-31 16:31:24,137 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 45) Completed initializing handlers >2014-03-31 16:31:24,139 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 45) Start initializing ErrorTranslatorImpl >2014-03-31 16:31:24,155 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 45) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-03-31 16:31:24,164 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 45) Finished initializing ErrorTranslatorImpl >2014-03-31 16:31:24,164 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 45) Start initializing ErrorTranslatorImpl >2014-03-31 16:31:24,165 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 45) Finished initializing ErrorTranslatorImpl >2014-03-31 16:31:24,165 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 45) Mark incomplete jobs as UNKNOWN >2014-03-31 16:31:24,272 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 45) Start initializing JobRepositoryCleanupManager >2014-03-31 16:31:24,273 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 45) Finished initializing JobRepositoryCleanupManager >2014-03-31 16:31:24,275 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 45) Start initializing AutoRecoveryManager >2014-03-31 16:31:24,278 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 45) Finished initializing AutoRecoveryManager >2014-03-31 16:31:24,280 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 45) Start initializing ExecutionMessageDirector >2014-03-31 16:31:24,291 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 45) Finished initializing ExecutionMessageDirector >2014-03-31 16:31:24,342 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Start initializing UsersDomainsCacheManagerService >2014-03-31 16:31:24,366 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Start initializing DbUserCacheManager >2014-03-31 16:31:24,370 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Finished initializing DbUserCacheManager >2014-03-31 16:31:24,370 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Finished initializing UsersDomainsCacheManagerService >2014-03-31 16:31:24,394 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 45) Initialization of AsyncTaskManager completed successfully. >2014-03-31 16:31:24,401 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 45) Start initializing ResourceManager >2014-03-31 16:31:24,446 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-1) Start refreshing all users data >2014-03-31 16:31:24,634 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 45) Finished initializing ResourceManager >2014-03-31 16:31:24,643 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 45) Initialization of OvfDataUpdater completed successfully. >2014-03-31 16:31:24,647 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 45) Start scheduling to enable vds load balancer >2014-03-31 16:31:24,648 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 45) Finished scheduling to enable vds load balancer >2014-03-31 16:31:24,664 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(79a88861): Start initializing >2014-03-31 16:31:24,699 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 45) Init VM custom properties utilities >2014-03-31 16:31:24,726 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(79a88861): Finished initializing >2014-03-31 16:31:24,746 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 45) Init device custom properties utilities >2014-03-31 16:31:24,752 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 45) Initializing Scheduling manager >2014-03-31 16:31:24,805 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 45) External scheduler disabled, discovery skipped >2014-03-31 16:31:24,806 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 45) Initialized Scheduling manager >2014-03-31 16:31:24,807 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 45) Initializing DWH Heart Beat >2014-03-31 16:35:24,700 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-7) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-03-31 16:35:24,721 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-7) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-03-31 16:35:31,580 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2014-03-31 16:35:31,689 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: UNASSIGNED not exist in string table >2014-03-31 16:35:31,689 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-03-31 16:35:31,689 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-03-31 16:35:31,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-03-31 16:35:31,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-03-31 16:35:31,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: DWH_STOPPED not exist in string table >2014-03-31 16:35:31,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: DWH_STARTED not exist in string table >2014-03-31 16:35:31,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: DWH_ERROR not exist in string table >2014-03-31 16:35:31,703 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-03-31 16:35:31,703 WA2014-03-31 16:37:04,289 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-03-31 16:37:04,295 WARN [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-03-31 16:37:04,295 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-03-31 16:37:04,296 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-03-31 16:37:04,296 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-03-31 16:37:04,296 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-03-31 16:37:04,296 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-03-31 16:37:04,297 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-03-31 16:37:04,297 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-03-31 16:37:04,297 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_AJP_PORT" is "8702". >2014-03-31 16:37:04,297 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_APPS" is "engine.ear redhat-support-plugin-rhev.ear". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_HOST" is "localhost". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_PORT" is "5432". >2014-03-31 16:37:04,298 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_SECURED" is "False". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_SSL" is "false". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DB_USER" is "engine". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_FQDN" is "rhevm3.3-shyu.nay.redhat.com". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_GROUP" is "ovirt". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-03-31 16:37:04,299 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-03-31 16:37:04,300 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-03-31 16:37:04,300 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-03-31 16:37:04,300 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-03-31 16:37:04,300 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-03-31 16:37:04,302 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_HTTP_PORT" is "None". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PERM_MAX" is "256m". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PERM_MIN" is "256m". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-03-31 16:37:04,303 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-03-31 16:37:04,304 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_STOP_TIME" is "10". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_USER" is "ovirt". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-03-31 16:37:04,305 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 43) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-03-31 16:37:05,845 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Start initializing Backend >2014-03-31 16:37:06,882 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Running ovirt-engine 3.3.0-0.45.el6ev >2014-03-31 16:37:06,888 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 41) Start initializing dictionaries >2014-03-31 16:37:06,897 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 41) Finished initializing dictionaries >2014-03-31 16:37:06,899 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 41) Start initializing AuditLogCleanupManager >2014-03-31 16:37:06,899 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 41) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-03-31 16:37:06,963 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 41) Finished initializing AuditLogCleanupManager >2014-03-31 16:37:06,970 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 41) Start initializing TagsDirector >2014-03-31 16:37:06,997 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 41) Tag root added to tree >2014-03-31 16:37:07,040 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 41) Finished initializing TagsDirector >2014-03-31 16:37:07,045 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 41) Start initializing IsoDomainListSyncronizer >2014-03-31 16:37:07,059 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 41) Finished initializing IsoDomainListSyncronizer >2014-03-31 16:37:07,130 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 41) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-03-31 16:37:07,491 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Completed initializing handlers >2014-03-31 16:37:07,493 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Start initializing ErrorTranslatorImpl >2014-03-31 16:37:07,517 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-03-31 16:37:07,518 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Finished initializing ErrorTranslatorImpl >2014-03-31 16:37:07,518 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Start initializing ErrorTranslatorImpl >2014-03-31 16:37:07,519 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Finished initializing ErrorTranslatorImpl >2014-03-31 16:37:07,520 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Mark incomplete jobs as UNKNOWN >2014-03-31 16:37:07,609 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 41) Start initializing JobRepositoryCleanupManager >2014-03-31 16:37:07,611 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 41) Finished initializing JobRepositoryCleanupManager >2014-03-31 16:37:07,614 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 41) Start initializing AutoRecoveryManager >2014-03-31 16:37:07,617 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 41) Finished initializing AutoRecoveryManager >2014-03-31 16:37:07,621 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 41) Start initializing ExecutionMessageDirector >2014-03-31 16:37:07,626 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 41) Finished initializing ExecutionMessageDirector >2014-03-31 16:37:07,687 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 41) Start initializing UsersDomainsCacheManagerService >2014-03-31 16:37:07,709 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 41) Start initializing DbUserCacheManager >2014-03-31 16:37:07,712 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 41) Finished initializing DbUserCacheManager >2014-03-31 16:37:07,712 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 41) Finished initializing UsersDomainsCacheManagerService >2014-03-31 16:37:07,745 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 39) Initialization of AsyncTaskManager completed successfully. >2014-03-31 16:37:07,753 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 39) Start initializing ResourceManager >2014-03-31 16:37:07,800 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-1) Start refreshing all users data >2014-03-31 16:37:08,044 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 39) Finished initializing ResourceManager >2014-03-31 16:37:08,062 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 39) Initialization of OvfDataUpdater completed successfully. >2014-03-31 16:37:08,071 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 39) Start scheduling to enable vds load balancer >2014-03-31 16:37:08,072 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 39) Finished scheduling to enable vds load balancer >2014-03-31 16:37:08,107 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 39) Init VM custom properties utilities >2014-03-31 16:37:08,111 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(27c2ea00): Start initializing >2014-03-31 16:37:08,142 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 39) Init device custom properties utilities >2014-03-31 16:37:08,151 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 39) Initializing Scheduling manager >2014-03-31 16:37:08,179 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(27c2ea00): Finished initializing >2014-03-31 16:37:08,217 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 39) External scheduler disabled, discovery skipped >2014-03-31 16:37:08,217 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 39) Initialized Scheduling manager >2014-03-31 16:37:08,218 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 39) Initializing DWH Heart Beat >2014-03-31 17:37:07,836 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-22) Start refreshing all users data >2014-03-31 17:37:08,063 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-03-31 18:37:07,843 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-46) Start refreshing all users data >2014-03-31 18:37:08,075 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-03-31 19:37:07,850 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-82) Start refreshing all users data >2014-03-31 19:37:08,079 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-03-31 20:37:07,856 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-14) Start refreshing all users data >2014-03-31 20:37:08,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-03-31 21:37:07,860 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-45) Start refreshing all users data >2014-03-31 21:37:08,084 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-03-31 22:37:07,865 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-67) Start refreshing all users data >2014-03-31 22:37:08,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-03-31 23:37:07,870 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-2) Start refreshing all users data >2014-03-31 23:37:08,089 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-04-01 00:37:07,875 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-30) Start refreshing all users data >2014-04-01 00:37:08,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-04-01 01:37:07,879 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-65) Start refreshing all users data >2014-04-01 01:37:08,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-04-01 02:37:07,883 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) Start refreshing all users data >2014-04-01 02:37:08,095 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-04-01 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-68) Start deleteAgedOutAuditLogs >2014-04-01 03:35:35,039 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-68) Finished deleteAgedOutAuditLogs >2014-04-01 03:37:07,889 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-28) Start refreshing all users data >2014-04-01 03:37:08,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-04-01 04:37:07,893 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-44) Start refreshing all users data >2014-04-01 04:37:08,184 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-04-01 05:37:07,899 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-78) Start refreshing all users data >2014-04-01 05:37:08,187 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-04-01 06:37:07,904 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-18) Start refreshing all users data >2014-04-01 06:37:08,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VMs/Templates Ovf. >2014-04-01 07:37:07,910 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-42) Start refreshing all users data >2014-04-01 07:37:08,192 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-04-01 08:37:07,916 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-80) Start refreshing all users data >2014-04-01 08:37:08,526 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-04-01 09:37:07,920 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-7) Start refreshing all users data >2014-04-01 09:37:08,594 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-04-01 10:37:07,925 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-32) Start refreshing all users data >2014-04-01 10:37:08,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-04-01 11:37:07,929 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-66) Start refreshing all users data >2014-04-01 11:37:08,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-04-01 12:37:07,933 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) Start refreshing all users data >2014-04-01 12:37:08,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-04-01 13:37:07,937 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-32) Start refreshing all users data >2014-04-01 13:37:08,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-04-01 14:37:08,044 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-68) Start refreshing all users data >2014-04-01 14:37:08,605 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-04-01 15:37:08,048 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-91) Start refreshing all users data >2014-04-01 15:37:08,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-04-01 16:37:08,052 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-27) Start refreshing all users data >2014-04-01 16:37:08,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-04-01 17:37:08,053 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-48) Start refreshing all users data >2014-04-01 17:37:08,614 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-04-01 18:37:08,055 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-77) Start refreshing all users data >2014-04-01 18:37:08,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-04-01 19:37:08,059 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-8) Start refreshing all users data >2014-04-01 19:37:08,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-04-01 20:37:08,062 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-24) Start refreshing all users data >2014-04-01 20:37:08,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2014-04-01 21:37:08,066 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-81) Start refreshing all users data >2014-04-01 21:37:08,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-04-01 22:37:08,069 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-92) Start refreshing all users data >2014-04-01 22:37:08,626 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-04-01 23:37:08,072 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-19) Start refreshing all users data >2014-04-01 23:37:08,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-04-02 00:37:08,074 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-83) Start refreshing all users data >2014-04-02 00:37:08,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-04-02 01:37:08,077 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-95) Start refreshing all users data >2014-04-02 01:37:08,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-04-02 02:37:08,081 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-26) Start refreshing all users data >2014-04-02 02:37:08,633 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-04-02 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-99) Start deleteAgedOutAuditLogs >2014-04-02 03:35:35,005 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-99) Finished deleteAgedOutAuditLogs >2014-04-02 03:37:08,179 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-65) Start refreshing all users data >2014-04-02 03:37:08,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-04-02 04:37:08,181 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-78) Start refreshing all users data >2014-04-02 04:37:08,637 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-04-02 05:37:08,183 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-3) Start refreshing all users data >2014-04-02 05:37:08,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-04-02 06:37:08,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-04-02 06:37:08,654 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-41) Start refreshing all users data >2014-04-02 07:37:08,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-04-02 07:37:08,654 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-63) Start refreshing all users data >2014-04-02 08:37:08,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-04-02 08:37:08,656 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-72) Start refreshing all users data >2014-04-02 09:37:08,655 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-04-02 09:37:08,659 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-52) Start refreshing all users data >2014-04-02 10:37:08,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-04-02 10:37:08,659 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-81) Start refreshing all users data >2014-04-02 11:37:08,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-04-02 11:37:08,661 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-100) Start refreshing all users data >2014-04-02 12:37:08,659 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-04-02 12:37:08,663 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-26) Start refreshing all users data >2014-04-02 13:37:08,660 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-04-02 13:37:08,666 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-12) Start refreshing all users data >2014-04-02 14:37:08,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-04-02 14:37:08,940 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-77) Start refreshing all users data >2014-04-02 15:37:08,940 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-04-02 15:37:08,941 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-96) Start refreshing all users data >2014-04-02 16:37:08,942 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-04-02 16:37:08,943 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-48) Start refreshing all users data >2014-04-02 17:37:08,942 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to update VMs/Templates Ovf. >2014-04-02 17:37:08,979 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-99) Start refreshing all users data >2014-04-02 18:37:08,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-04-02 18:37:08,982 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-20) Start refreshing all users data >2014-04-02 19:37:08,945 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-04-02 19:37:08,985 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-38) Start refreshing all users data >2014-04-02 20:37:08,946 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-04-02 20:37:08,989 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-71) Start refreshing all users data >2014-04-02 21:37:08,947 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-04-02 21:37:08,993 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-8) Start refreshing all users data >2014-04-02 22:26:57,245 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-3) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-04-02 22:26:57,272 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-3) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-04-02 22:27:15,579 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2014-04-02 22:27:15,696 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: UNASSIGNED not exist in string table >2014-04-02 22:27:15,697 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-04-02 22:27:15,698 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-04-02 22:27:15,699 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-04-02 22:27:15,699 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-04-02 22:27:15,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: DWH_STOPPED not exist in string table >2014-04-02 22:27:15,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: DWH_STARTED not exist in string table >2014-04-02 22:27:15,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: DWH_ERROR not exist in string table >2014-04-02 22:27:15,726 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-04-02 22:27:15,727 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-04-02 22:27:15,727 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-04-02 22:27:15,727 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-04-02 22:27:15,727 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-04-02 22:27:15,728 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-04-02 22:27:15,728 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-04-02 22:27:15,728 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-04-02 22:27:15,728 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_EXTEND_DISK_SIZE_UPDATE_VM_FAILURE not have severity. Assumed Normal >2014-04-02 22:27:15,728 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-04-02 22:27:15,729 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-04-02 22:27:15,729 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-04-02 22:27:15,730 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-04-02 22:27:15,730 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_UPDATED_MOM_POLICIES not have severity. Assumed Normal >2014-04-02 22:27:15,730 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) AuditLogType: USER_FAILED_TO_UPDATE_MOM_POLICIES not have severity. Assumed Normal >2014-04-02 22:27:15,780 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-02 22:27:20,593 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginUserCommand internal: false. >2014-04-02 22:27:20,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-02 22:37:08,948 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-04-02 22:37:08,995 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-34) Start refreshing all users data >2014-04-02 23:37:08,950 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-04-02 23:37:08,999 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-62) Start refreshing all users data >2014-04-03 00:37:08,951 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-04-03 00:37:09,003 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-58) Start refreshing all users data >2014-04-03 01:37:08,952 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-04-03 01:37:09,006 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-31) Start refreshing all users data >2014-04-03 02:37:08,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-04-03 02:37:09,010 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-63) Start refreshing all users data >2014-04-03 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-27) Start deleteAgedOutAuditLogs >2014-04-03 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-27) Finished deleteAgedOutAuditLogs >2014-04-03 03:37:08,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-04-03 03:37:09,013 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-69) Start refreshing all users data >2014-04-03 04:37:08,955 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-04-03 04:37:09,015 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-21) Start refreshing all users data >2014-04-03 05:37:08,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-04-03 05:37:09,019 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-30) Start refreshing all users data >2014-04-03 06:37:08,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-04-03 06:37:09,023 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-37) Start refreshing all users data >2014-04-03 07:37:08,957 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-04-03 07:37:09,027 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-90) Start refreshing all users data >2014-04-03 08:37:08,958 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VMs/Templates Ovf. >2014-04-03 08:37:09,030 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-15) Start refreshing all users data >2014-04-03 09:37:08,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-04-03 09:37:09,034 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-46) Start refreshing all users data >2014-04-03 10:37:08,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-04-03 10:37:09,037 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-35) Start refreshing all users data >2014-04-03 11:37:08,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-04-03 11:37:09,040 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-5) Start refreshing all users data >2014-04-03 12:37:08,962 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-04-03 12:37:09,043 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-83) Start refreshing all users data >2014-04-03 13:37:08,962 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-04-03 13:37:09,047 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-81) Start refreshing all users data >2014-04-03 14:37:08,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-04-03 14:37:09,049 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-91) Start refreshing all users data >2014-04-03 15:37:08,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-04-03 15:37:09,053 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-64) Start refreshing all users data >2014-04-03 16:37:08,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-04-03 16:37:09,056 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-25) Start refreshing all users data >2014-04-03 17:37:08,968 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-04-03 17:37:09,063 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-90) Start refreshing all users data >2014-04-03 18:37:08,970 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-04-03 18:37:09,066 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-38) Start refreshing all users data >2014-04-03 19:37:08,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-04-03 19:37:09,070 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-75) Start refreshing all users data >2014-04-03 20:37:08,973 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-04-03 20:37:09,073 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-71) Start refreshing all users data >2014-04-03 21:37:08,975 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-04-03 21:37:09,076 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-2) Start refreshing all users data >2014-04-03 22:37:08,975 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-04-03 22:37:09,079 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-22) Start refreshing all users data >2014-04-03 23:37:08,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-04-03 23:37:09,083 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-99) Start refreshing all users data >2014-04-04 00:37:08,979 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-04-04 00:37:09,086 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-72) Start refreshing all users data >2014-04-04 01:37:08,980 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-04-04 01:37:09,090 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-42) Start refreshing all users data >2014-04-04 02:37:08,982 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-04-04 02:37:09,094 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-80) Start refreshing all users data >2014-04-04 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-56) Start deleteAgedOutAuditLogs >2014-04-04 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-56) Finished deleteAgedOutAuditLogs >2014-04-04 03:37:08,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-04-04 03:37:09,098 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-1) Start refreshing all users data >2014-04-04 04:37:08,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-04-04 04:37:09,101 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-32) Start refreshing all users data >2014-04-04 05:37:08,986 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-04-04 05:37:09,105 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-12) Start refreshing all users data >2014-04-04 06:37:08,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-04-04 06:37:09,108 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-53) Start refreshing all users data >2014-04-04 07:37:08,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-04-04 07:37:09,111 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-91) Start refreshing all users data >2014-04-04 08:37:08,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-04-04 08:37:09,115 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-18) Start refreshing all users data >2014-04-04 09:37:08,991 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-04-04 09:37:09,118 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-46) Start refreshing all users data >2014-04-04 10:37:09,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-04-04 10:37:09,139 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-66) Start refreshing all users data >2014-04-04 11:37:09,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) Attempting to update VMs/Templates Ovf. >2014-04-04 11:37:09,140 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-42) Start refreshing all users data >2014-04-04 12:37:09,139 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-04-04 12:37:09,141 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-30) Start refreshing all users data >2014-04-04 13:37:09,142 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-04-04 13:37:09,143 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-44) Start refreshing all users data >2014-04-04 14:37:09,142 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-04-04 14:37:09,145 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-56) Start refreshing all users data >2014-04-04 15:37:09,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-04-04 15:37:09,151 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-55) Start refreshing all users data >2014-04-04 16:37:09,145 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-04-04 16:37:09,170 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-53) Start refreshing all users data >2014-04-04 17:37:09,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-04-04 17:37:09,173 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-15) Start refreshing all users data >2014-04-04 18:37:09,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-04-04 18:37:09,174 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-36) Start refreshing all users data >2014-04-04 19:37:09,173 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-04-04 19:37:09,176 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-23) Start refreshing all users data >2014-04-04 20:37:09,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-04-04 20:37:09,178 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-78) Start refreshing all users data >2014-04-04 21:37:09,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-04-04 21:37:09,178 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-34) Start refreshing all users data >2014-04-04 22:37:09,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-04-04 22:37:09,180 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-45) Start refreshing all users data >2014-04-04 23:37:09,180 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-04-04 23:37:09,181 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-35) Start refreshing all users data >2014-04-05 00:37:09,179 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-04-05 00:37:09,182 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-85) Start refreshing all users data >2014-04-05 01:37:09,182 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-04-05 01:37:09,183 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-59) Start refreshing all users data >2014-04-05 02:37:09,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-04-05 02:37:09,185 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-35) Start refreshing all users data >2014-04-05 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-55) Start deleteAgedOutAuditLogs >2014-04-05 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-55) Finished deleteAgedOutAuditLogs >2014-04-05 03:37:09,184 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-04-05 03:37:09,187 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-56) Start refreshing all users data >2014-04-05 04:37:09,185 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VMs/Templates Ovf. >2014-04-05 04:37:09,188 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-24) Start refreshing all users data >2014-04-05 05:37:09,187 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-04-05 05:37:09,190 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-54) Start refreshing all users data >2014-04-05 06:37:09,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-04-05 06:37:09,191 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-95) Start refreshing all users data >2014-04-05 07:37:09,192 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-04-05 07:37:09,193 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-47) Start refreshing all users data >2014-04-05 08:37:09,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-04-05 08:37:09,194 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-4) Start refreshing all users data >2014-04-05 09:37:09,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-04-05 09:37:09,196 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-74) Start refreshing all users data >2014-04-05 10:37:09,196 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) Attempting to update VMs/Templates Ovf. >2014-04-05 10:37:09,198 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-18) Start refreshing all users data >2014-04-05 11:37:09,198 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-04-05 11:37:09,199 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-52) Start refreshing all users data >2014-04-05 12:37:09,199 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-04-05 12:37:09,201 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-78) Start refreshing all users data >2014-04-05 13:37:09,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-04-05 13:37:09,203 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-34) Start refreshing all users data >2014-04-05 14:37:09,202 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-04-05 14:37:09,205 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-3) Start refreshing all users data >2014-04-05 15:37:09,204 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-04-05 15:37:09,207 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-98) Start refreshing all users data >2014-04-05 16:37:09,205 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-04-05 16:37:09,208 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-51) Start refreshing all users data >2014-04-05 17:37:09,207 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-04-05 17:37:09,209 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-33) Start refreshing all users data >2014-04-05 18:37:09,208 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-04-05 18:37:09,211 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-98) Start refreshing all users data >2014-04-05 19:37:09,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-04-05 19:37:09,211 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-15) Start refreshing all users data >2014-04-05 20:37:09,211 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-04-05 20:37:09,212 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-42) Start refreshing all users data >2014-04-05 21:37:09,213 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-04-05 21:37:09,214 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-4) Start refreshing all users data >2014-04-05 22:37:09,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-04-05 22:37:09,215 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-87) Start refreshing all users data >2014-04-05 23:37:09,216 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-04-05 23:37:09,217 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-11) Start refreshing all users data >2014-04-06 00:37:09,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-04-06 00:37:09,218 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-53) Start refreshing all users data >2014-04-06 01:37:09,219 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-04-06 01:37:09,221 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-44) Start refreshing all users data >2014-04-06 02:37:09,220 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-04-06 02:37:09,221 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-38) Start refreshing all users data >2014-04-06 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-89) Start deleteAgedOutAuditLogs >2014-04-06 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-89) Finished deleteAgedOutAuditLogs >2014-04-06 03:37:09,221 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-04-06 03:37:09,223 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-16) Start refreshing all users data >2014-04-06 04:37:09,223 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-04-06 04:37:09,224 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-30) Start refreshing all users data >2014-04-06 05:37:09,224 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-04-06 05:37:09,226 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-34) Start refreshing all users data >2014-04-06 06:37:09,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-04-06 06:37:09,227 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-16) Start refreshing all users data >2014-04-06 07:37:09,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-04-06 07:37:09,237 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-73) Start refreshing all users data >2014-04-06 08:37:09,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-04-06 08:37:09,240 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-2) Start refreshing all users data >2014-04-06 09:37:09,230 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-04-06 09:37:09,243 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-83) Start refreshing all users data >2014-04-06 10:37:09,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-04-06 10:37:09,246 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-28) Start refreshing all users data >2014-04-06 11:37:09,234 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-04-06 11:37:09,249 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-44) Start refreshing all users data >2014-04-06 12:37:09,235 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-04-06 12:37:09,253 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-42) Start refreshing all users data >2014-04-06 13:37:09,237 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-04-06 13:37:09,256 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-4) Start refreshing all users data >2014-04-06 14:37:09,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to update VMs/Templates Ovf. >2014-04-06 14:37:09,258 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-96) Start refreshing all users data >2014-04-06 15:37:09,241 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-04-06 15:37:09,261 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-36) Start refreshing all users data >2014-04-06 16:37:09,242 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-04-06 16:37:09,265 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-81) Start refreshing all users data >2014-04-06 17:37:09,243 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-04-06 17:37:09,268 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-70) Start refreshing all users data >2014-04-06 18:37:09,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-04-06 18:37:09,272 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-9) Start refreshing all users data >2014-04-06 19:37:09,247 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-04-06 19:37:09,275 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-75) Start refreshing all users data >2014-04-06 20:37:09,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-04-06 20:37:09,278 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-97) Start refreshing all users data >2014-04-06 21:37:09,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-04-06 21:37:09,281 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-51) Start refreshing all users data >2014-04-06 22:37:09,249 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-04-06 22:37:09,285 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-24) Start refreshing all users data >2014-04-06 23:37:09,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-04-06 23:37:09,288 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-69) Start refreshing all users data >2014-04-07 00:37:09,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-04-07 00:37:09,292 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-29) Start refreshing all users data >2014-04-07 01:37:09,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-04-07 01:37:09,294 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-33) Start refreshing all users data >2014-04-07 02:37:09,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-04-07 02:37:09,298 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-66) Start refreshing all users data >2014-04-07 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-93) Start deleteAgedOutAuditLogs >2014-04-07 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-93) Finished deleteAgedOutAuditLogs >2014-04-07 03:37:09,256 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-04-07 03:37:09,301 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-44) Start refreshing all users data >2014-04-07 04:37:09,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-04-07 04:37:09,303 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-64) Start refreshing all users data >2014-04-07 05:37:09,260 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-04-07 05:37:09,307 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-28) Start refreshing all users data >2014-04-07 06:37:09,260 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-04-07 06:37:09,309 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-44) Start refreshing all users data >2014-04-07 07:37:09,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-04-07 07:37:09,573 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-19) Start refreshing all users data >2014-04-07 08:37:09,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-04-07 08:37:09,577 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-63) Start refreshing all users data >2014-04-07 09:37:09,768 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-04-07 09:37:09,769 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-60) Start refreshing all users data >2014-04-07 10:37:09,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-04-07 10:37:09,771 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) Start refreshing all users data >2014-04-07 11:37:09,773 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-04-07 11:37:09,775 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-68) Start refreshing all users data >2014-04-07 12:37:09,775 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-04-07 12:37:09,776 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-62) Start refreshing all users data >2014-04-07 13:37:09,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-04-07 13:37:09,779 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-65) Start refreshing all users data >2014-04-07 14:37:09,778 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2014-04-07 14:37:09,780 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-6) Start refreshing all users data >2014-04-07 15:37:09,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-04-07 15:37:09,782 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-97) Start refreshing all users data >2014-04-07 16:37:09,783 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-04-07 16:37:09,784 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-76) Start refreshing all users data >2014-04-07 17:37:09,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-04-07 17:37:09,786 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-38) Start refreshing all users data >2014-04-07 18:37:09,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-04-07 18:37:09,788 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-50) Start refreshing all users data >2014-04-07 19:37:09,789 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-04-07 19:37:09,790 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-79) Start refreshing all users data >2014-04-07 20:37:09,790 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-04-07 20:37:09,792 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-36) Start refreshing all users data >2014-04-07 21:37:09,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-04-07 21:37:09,794 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-68) Start refreshing all users data >2014-04-07 22:37:09,794 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-04-07 22:37:09,796 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-84) Start refreshing all users data >2014-04-07 23:37:09,796 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-04-07 23:37:09,798 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-49) Start refreshing all users data >2014-04-08 00:37:09,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-04-08 00:37:09,800 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-16) Start refreshing all users data >2014-04-08 01:37:09,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-04-08 01:37:09,802 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-84) Start refreshing all users data >2014-04-08 02:37:09,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-04-08 02:37:09,805 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-65) Start refreshing all users data >2014-04-08 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-57) Start deleteAgedOutAuditLogs >2014-04-08 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-57) Finished deleteAgedOutAuditLogs >2014-04-08 03:37:09,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-04-08 03:37:09,808 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-14) Start refreshing all users data >2014-04-08 04:37:09,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-04-08 04:37:09,809 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-57) Start refreshing all users data >2014-04-08 05:37:09,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-04-08 05:37:09,824 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-76) Start refreshing all users data >2014-04-08 06:37:09,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-04-08 06:37:09,826 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-52) Start refreshing all users data >2014-04-08 07:37:09,826 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-04-08 07:37:09,827 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-54) Start refreshing all users data >2014-04-08 08:37:09,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-04-08 08:37:09,830 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-87) Start refreshing all users data >2014-04-08 09:37:09,830 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-04-08 09:37:09,832 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-38) Start refreshing all users data >2014-04-08 10:37:09,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-04-08 10:37:09,833 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-4) Start refreshing all users data >2014-04-08 11:37:09,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-04-08 11:37:09,835 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-78) Start refreshing all users data >2014-04-08 12:37:09,835 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-04-08 12:37:09,837 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-31) Start refreshing all users data >2014-04-08 13:37:09,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-04-08 13:37:09,839 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-14) Start refreshing all users data >2014-04-08 14:37:09,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-04-08 14:37:09,842 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-15) Start refreshing all users data >2014-04-08 15:37:09,842 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-04-08 15:37:09,844 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-51) Start refreshing all users data >2014-04-08 16:37:09,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-04-08 16:37:09,846 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-4) Start refreshing all users data >2014-04-08 17:37:09,846 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VMs/Templates Ovf. >2014-04-08 17:37:09,847 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-79) Start refreshing all users data >2014-04-08 18:37:09,848 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-04-08 18:37:09,849 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) Start refreshing all users data >2014-04-08 19:37:09,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-04-08 19:37:09,850 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-83) Start refreshing all users data >2014-04-08 20:37:09,851 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-04-08 20:37:09,853 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-69) Start refreshing all users data >2014-04-08 21:37:09,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-04-08 21:37:09,856 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-76) Start refreshing all users data >2014-04-08 22:37:09,856 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2014-04-08 22:37:09,858 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-42) Start refreshing all users data >2014-04-08 23:37:09,858 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-04-08 23:37:09,859 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-66) Start refreshing all users data >2014-04-09 00:37:09,859 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-04-09 00:37:09,861 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-77) Start refreshing all users data >2014-04-09 01:37:09,861 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-04-09 01:37:09,863 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-1) Start refreshing all users data >2014-04-09 02:37:09,863 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-04-09 02:37:09,864 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-63) Start refreshing all users data >2014-04-09 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-65) Start deleteAgedOutAuditLogs >2014-04-09 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-65) Finished deleteAgedOutAuditLogs >2014-04-09 03:37:09,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-04-09 03:37:09,868 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-93) Start refreshing all users data >2014-04-09 04:37:09,868 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-04-09 04:37:09,870 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-10) Start refreshing all users data >2014-04-09 05:37:09,871 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-04-09 05:37:09,873 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-26) Start refreshing all users data >2014-04-09 06:37:09,874 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-04-09 06:37:09,875 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-60) Start refreshing all users data >2014-04-09 07:37:09,876 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-04-09 07:37:09,877 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-56) Start refreshing all users data >2014-04-09 08:37:09,877 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-04-09 08:37:09,879 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-35) Start refreshing all users data >2014-04-09 09:37:09,879 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-04-09 09:37:09,881 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-78) Start refreshing all users data >2014-04-09 10:37:09,881 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) Attempting to update VMs/Templates Ovf. >2014-04-09 10:37:09,883 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-70) Start refreshing all users data >2014-04-09 11:23:02,818 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginAdminUserCommand internal: false. >2014-04-09 11:23:02,848 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 11:23:09,512 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginUserCommand internal: false. >2014-04-09 11:23:09,556 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 11:28:26,891 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp-/127.0.0.1:8702-8) [51d3b311] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 11:28:27,051 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [51d3b311] Correlation ID: 51d3b311, Call Stack: null, Custom Event ID: -1, Message: Data Center NFS_shyu with Type NFS, Compatibility Version 3.3 and Quota Type DISABLED was added by admin@internal >2014-04-09 11:33:31,605 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-16) [29b64713] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 11:33:31,749 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [29b64713] Correlation ID: 29b64713, Call Stack: null, Custom Event ID: -1, Message: Host cluster NFS_shyu was added by admin@internal >2014-04-09 11:33:54,117 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-13) [2236b9e5] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:33:54,179 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-13) [2236b9e5] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 11:33:54,371 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 00d6eddc-c7e7-4e7b-961c-2508f5de374a Type: VDS >2014-04-09 11:33:54,430 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 11:33:54,439 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1608a4af] Cannot get vdsManager for vdsid=00d6eddc-c7e7-4e7b-961c-2508f5de374a >2014-04-09 11:33:54,470 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] START, RemoveVdsVDSCommand(HostName = 10.66.106.32, HostId = 00d6eddc-c7e7-4e7b-961c-2508f5de374a), log id: 2307db2e >2014-04-09 11:33:54,471 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1608a4af] Cannot get vdsManager for vdsid=00d6eddc-c7e7-4e7b-961c-2508f5de374a >2014-04-09 11:33:54,472 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] FINISH, RemoveVdsVDSCommand, log id: 2307db2e >2014-04-09 11:33:54,474 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1608a4af] Cannot get vdsManager for vdsid=00d6eddc-c7e7-4e7b-961c-2508f5de374a >2014-04-09 11:33:54,477 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] START, AddVdsVDSCommand(HostName = 10.66.106.32, HostId = 00d6eddc-c7e7-4e7b-961c-2508f5de374a), log id: 143a56b0 >2014-04-09 11:33:54,478 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] AddVds - entered , starting logic to add VDS 00d6eddc-c7e7-4e7b-961c-2508f5de374a >2014-04-09 11:33:54,481 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] AddVds - VDS 00d6eddc-c7e7-4e7b-961c-2508f5de374a was added, will try to add it to the resource manager >2014-04-09 11:33:54,490 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-13) [1608a4af] Entered VdsManager constructor >2014-04-09 11:33:54,536 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-13) [1608a4af] Initialize vdsBroker (10.66.106.32,54,321) >2014-04-09 11:33:54,959 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1608a4af] VDS 00d6eddc-c7e7-4e7b-961c-2508f5de374a was added to the Resource Manager >2014-04-09 11:33:54,972 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1608a4af] FINISH, AddVdsVDSCommand, log id: 143a56b0 >2014-04-09 11:33:54,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [1608a4af] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.32. >2014-04-09 11:33:55,100 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-6) [4b3cc6c] Lock Acquired to object EngineLock [exclusiveLocks= key: 00d6eddc-c7e7-4e7b-961c-2508f5de374a value: VDS >, sharedLocks= ] >2014-04-09 11:33:55,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [1608a4af] Correlation ID: 2236b9e5, Job ID: 242c80bd-5d3e-43ae-9abb-61f4d144b69d, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was added by admin@internal. >2014-04-09 11:33:55,129 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-6) [4b3cc6c] Running command: InstallVdsCommand internal: true. Entities affected : ID: 00d6eddc-c7e7-4e7b-961c-2508f5de374a Type: VDS >2014-04-09 11:33:55,130 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-6) [4b3cc6c] Before Installation host 00d6eddc-c7e7-4e7b-961c-2508f5de374a, 10.66.106.32 >2014-04-09 11:33:55,209 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-6) [4b3cc6c] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 00d6eddc-c7e7-4e7b-961c-2508f5de374a, status=Installing, nonOperationalReason=NONE), log id: 369db9a3 >2014-04-09 11:33:55,238 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-6) [4b3cc6c] FINISH, SetVdsStatusVDSCommand, log id: 369db9a3 >2014-04-09 11:33:55,327 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-6) [4b3cc6c] Installation 10.66.106.32: Connected to host 10.66.106.32 with SSH key fingerprint: ad:9d:6c:65:13:cb:67:f4:a9:41:39:50:26:b0:4c:08 >2014-04-09 11:33:55,354 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-6) [4b3cc6c] Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Connected to host 10.66.106.32 with SSH key fingerprint: ad:9d:6c:65:13:cb:67:f4:a9:41:39:50:26:b0:4c:08. >2014-04-09 11:33:55,379 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-6) [4b3cc6c] Installation of 10.66.106.32. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 11:33:55,385 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (pool-4-thread-6) Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' is missing, creating >2014-04-09 11:33:55,758 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-6) SSH execute root@10.66.106.32 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 11:33:57,256 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Initializing >2014-04-09 11:33:57,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Initializing. >2014-04-09 11:33:57,310 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment setup >2014-04-09 11:33:57,322 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment setup. >2014-04-09 11:33:57,383 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment packages setup >2014-04-09 11:33:57,430 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment packages setup. >2014-04-09 11:33:57,965 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-21) Initializing Host: 10.66.106.32 >2014-04-09 11:34:00,642 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Downloading Packages >2014-04-09 11:34:00,663 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Downloading Packages. >2014-04-09 11:34:02,495 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 11:34:02,513 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 11:34:02,513 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Check Package Signatures >2014-04-09 11:34:02,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Check Package Signatures. >2014-04-09 11:34:02,529 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Running Test Transaction >2014-04-09 11:34:02,546 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Running Test Transaction. >2014-04-09 11:34:03,518 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Running Transaction >2014-04-09 11:34:03,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Running Transaction. >2014-04-09 11:34:05,041 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 11:34:05,062 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 11:34:05,647 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum updated: 2/2: dmidecode >2014-04-09 11:34:05,719 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum updated: 2/2: dmidecode. >2014-04-09 11:34:07,241 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-09 11:34:07,279 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-09 11:34:07,338 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-09 11:34:07,354 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-09 11:34:07,652 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Programs detection >2014-04-09 11:34:07,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Programs detection. >2014-04-09 11:34:07,671 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment customization >2014-04-09 11:34:07,687 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment customization. >2014-04-09 11:34:07,744 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Logs at host located at: '/tmp/ovirt-host-deploy-20140409113414.log' >2014-04-09 11:34:07,762 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Logs at host located at: '/tmp/ovirt-host-deploy-20140409113414.log'. >2014-04-09 11:34:07,835 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.32 reports unique id 3584EC38-EBED-11E1-BC99-5CF3FCDC10BC >2014-04-09 11:34:07,876 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 3584EC38-EBED-11E1-BC99-5CF3FCDC10BC to Host 10.66.106.32 >2014-04-09 11:34:08,021 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Setup validation >2014-04-09 11:34:08,037 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Setup validation. >2014-04-09 11:34:08,265 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Hardware supports virtualization >2014-04-09 11:34:08,278 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Hardware supports virtualization. >2014-04-09 11:34:09,695 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Transaction setup >2014-04-09 11:34:09,720 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Transaction setup. >2014-04-09 11:34:09,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Misc configuration >2014-04-09 11:34:09,753 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Misc configuration. >2014-04-09 11:34:09,754 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Package installation >2014-04-09 11:34:09,770 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Package installation. >2014-04-09 11:34:12,905 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-09 11:34:12,965 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.106.32. Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-09 11:34:12,965 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-09 11:34:12,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.106.32. Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-09 11:34:12,978 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Performing yum transaction rollback >2014-04-09 11:34:12,995 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Performing yum transaction rollback. >2014-04-09 11:34:12,995 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Pre-termination >2014-04-09 11:34:13,011 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Pre-termination. >2014-04-09 11:34:13,033 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113413-10.66.106.32-4b3cc6c.log' >2014-04-09 11:34:13,070 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113413-10.66.106.32-4b3cc6c.log'. >2014-04-09 11:34:13,527 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Termination >2014-04-09 11:34:13,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b3cc6c, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Termination. >2014-04-09 11:34:13,664 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-6) SSH error running command root@10.66.106.32:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:13,669 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-6) [4b3cc6c] Error during host 10.66.106.32 install: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:13,671 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-6) [4b3cc6c] Host installation failed for host 00d6eddc-c7e7-4e7b-961c-2508f5de374a, 10.66.106.32.: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:13,678 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-6) [4b3cc6c] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 00d6eddc-c7e7-4e7b-961c-2508f5de374a, status=InstallFailed, nonOperationalReason=NONE), log id: 57af7c0d >2014-04-09 11:34:13,703 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-6) [4b3cc6c] FINISH, SetVdsStatusVDSCommand, log id: 57af7c0d >2014-04-09 11:34:13,728 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-6) [4b3cc6c] Correlation ID: 4b3cc6c, Job ID: 242c80bd-5d3e-43ae-9abb-61f4d144b69d, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 installation failed. Command returned failure code 1 during SSH session 'root@10.66.106.32'. >2014-04-09 11:34:13,761 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-6) [4b3cc6c] Lock freed to object EngineLock [exclusiveLocks= key: 00d6eddc-c7e7-4e7b-961c-2508f5de374a value: VDS >, sharedLocks= ] >2014-04-09 11:34:18,096 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-9) [6829db9e] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.106.40' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:18,161 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-9) [6829db9e] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 11:34:18,198 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: f2c3867e-515e-4f90-8828-a08ca7e3624e Type: VDS >2014-04-09 11:34:18,211 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 11:34:18,212 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [6ac953da] Cannot get vdsManager for vdsid=f2c3867e-515e-4f90-8828-a08ca7e3624e >2014-04-09 11:34:18,216 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] START, RemoveVdsVDSCommand(HostName = 10.66.106.40, HostId = f2c3867e-515e-4f90-8828-a08ca7e3624e), log id: 41135e1f >2014-04-09 11:34:18,217 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [6ac953da] Cannot get vdsManager for vdsid=f2c3867e-515e-4f90-8828-a08ca7e3624e >2014-04-09 11:34:18,217 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] FINISH, RemoveVdsVDSCommand, log id: 41135e1f >2014-04-09 11:34:18,218 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [6ac953da] Cannot get vdsManager for vdsid=f2c3867e-515e-4f90-8828-a08ca7e3624e >2014-04-09 11:34:18,220 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] START, AddVdsVDSCommand(HostName = 10.66.106.40, HostId = f2c3867e-515e-4f90-8828-a08ca7e3624e), log id: 46b88574 >2014-04-09 11:34:18,221 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] AddVds - entered , starting logic to add VDS f2c3867e-515e-4f90-8828-a08ca7e3624e >2014-04-09 11:34:18,224 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] AddVds - VDS f2c3867e-515e-4f90-8828-a08ca7e3624e was added, will try to add it to the resource manager >2014-04-09 11:34:18,224 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [6ac953da] Entered VdsManager constructor >2014-04-09 11:34:18,245 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [6ac953da] Initialize vdsBroker (10.66.106.40,54,321) >2014-04-09 11:34:18,248 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [6ac953da] VDS f2c3867e-515e-4f90-8828-a08ca7e3624e was added to the Resource Manager >2014-04-09 11:34:18,248 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [6ac953da] FINISH, AddVdsVDSCommand, log id: 46b88574 >2014-04-09 11:34:18,256 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [6ac953da] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-09 11:34:18,278 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [6ac953da] Correlation ID: 6829db9e, Job ID: bd9e7072-0967-4147-9651-26e0a48a260f, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was added by admin@internal. >2014-04-09 11:34:18,287 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-7) [52dcd327] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c3867e-515e-4f90-8828-a08ca7e3624e value: VDS >, sharedLocks= ] >2014-04-09 11:34:18,311 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-7) [52dcd327] Running command: InstallVdsCommand internal: true. Entities affected : ID: f2c3867e-515e-4f90-8828-a08ca7e3624e Type: VDS >2014-04-09 11:34:18,311 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-7) [52dcd327] Before Installation host f2c3867e-515e-4f90-8828-a08ca7e3624e, 10.66.106.40 >2014-04-09 11:34:18,330 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-7) [52dcd327] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = f2c3867e-515e-4f90-8828-a08ca7e3624e, status=Installing, nonOperationalReason=NONE), log id: 7c53f3fe >2014-04-09 11:34:18,353 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-7) [52dcd327] FINISH, SetVdsStatusVDSCommand, log id: 7c53f3fe >2014-04-09 11:34:18,454 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-7) [52dcd327] Installation 10.66.106.40: Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd >2014-04-09 11:34:18,469 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-7) [52dcd327] Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd. >2014-04-09 11:34:18,491 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-7) [52dcd327] Installation of 10.66.106.40. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 11:34:18,504 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-7) SSH execute root@10.66.106.40 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 11:34:19,987 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Initializing >2014-04-09 11:34:20,041 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Initializing. >2014-04-09 11:34:20,060 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment setup >2014-04-09 11:34:20,086 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment setup. >2014-04-09 11:34:20,108 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment packages setup >2014-04-09 11:34:20,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment packages setup. >2014-04-09 11:34:21,252 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-56) Initializing Host: 10.66.106.40 >2014-04-09 11:34:23,173 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Downloading Packages >2014-04-09 11:34:23,210 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Downloading Packages. >2014-04-09 11:34:24,763 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 11:34:24,785 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 11:34:24,785 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Check Package Signatures >2014-04-09 11:34:24,802 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Check Package Signatures. >2014-04-09 11:34:24,802 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Running Test Transaction >2014-04-09 11:34:24,818 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Running Test Transaction. >2014-04-09 11:34:25,337 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Running Transaction >2014-04-09 11:34:25,351 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Running Transaction. >2014-04-09 11:34:26,055 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 11:34:26,068 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 11:34:26,692 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum updated: 2/2: dmidecode >2014-04-09 11:34:26,701 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum updated: 2/2: dmidecode. >2014-04-09 11:34:27,990 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-09 11:34:28,001 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-09 11:34:28,085 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-09 11:34:28,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-09 11:34:28,383 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Programs detection >2014-04-09 11:34:28,412 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Programs detection. >2014-04-09 11:34:28,412 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment customization >2014-04-09 11:34:28,426 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment customization. >2014-04-09 11:34:28,465 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Logs at host located at: '/tmp/ovirt-host-deploy-20140409113436.log' >2014-04-09 11:34:28,476 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Logs at host located at: '/tmp/ovirt-host-deploy-20140409113436.log'. >2014-04-09 11:34:28,537 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.40 reports unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 >2014-04-09 11:34:28,540 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 to Host 10.66.106.40 >2014-04-09 11:34:28,652 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Setup validation >2014-04-09 11:34:28,668 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Setup validation. >2014-04-09 11:34:28,830 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Hardware supports virtualization >2014-04-09 11:34:28,851 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Hardware supports virtualization. >2014-04-09 11:34:30,384 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction setup >2014-04-09 11:34:30,409 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction setup. >2014-04-09 11:34:30,433 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-09 11:34:30,451 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-09 11:34:30,451 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Package installation >2014-04-09 11:34:30,468 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Package installation. >2014-04-09 11:34:33,288 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-09 11:34:33,317 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.106.40. Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-09 11:34:33,317 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-09 11:34:33,334 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.106.40. Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-09 11:34:33,334 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Performing yum transaction rollback >2014-04-09 11:34:33,350 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Performing yum transaction rollback. >2014-04-09 11:34:33,351 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Pre-termination >2014-04-09 11:34:33,367 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Pre-termination. >2014-04-09 11:34:33,382 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113433-10.66.106.40-52dcd327.log' >2014-04-09 11:34:33,420 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113433-10.66.106.40-52dcd327.log'. >2014-04-09 11:34:33,698 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Termination >2014-04-09 11:34:33,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 52dcd327, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Termination. >2014-04-09 11:34:33,836 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-7) SSH error running command root@10.66.106.40:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.40' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:33,838 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-7) [52dcd327] Error during host 10.66.106.40 install: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.40' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:33,844 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-7) [52dcd327] Host installation failed for host f2c3867e-515e-4f90-8828-a08ca7e3624e, 10.66.106.40.: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.40' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:34:33,850 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-7) [52dcd327] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = f2c3867e-515e-4f90-8828-a08ca7e3624e, status=InstallFailed, nonOperationalReason=NONE), log id: 4974ba3c >2014-04-09 11:34:33,859 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-7) [52dcd327] FINISH, SetVdsStatusVDSCommand, log id: 4974ba3c >2014-04-09 11:34:33,884 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-7) [52dcd327] Correlation ID: 52dcd327, Job ID: bd9e7072-0967-4147-9651-26e0a48a260f, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 installation failed. Command returned failure code 1 during SSH session 'root@10.66.106.40'. >2014-04-09 11:34:33,892 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-7) [52dcd327] Lock freed to object EngineLock [exclusiveLocks= key: f2c3867e-515e-4f90-8828-a08ca7e3624e value: VDS >, sharedLocks= ] >2014-04-09 11:35:48,811 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [3bc9ae31] Lock Acquired to object EngineLock [exclusiveLocks= key: 00d6eddc-c7e7-4e7b-961c-2508f5de374a value: VDS >, sharedLocks= ] >2014-04-09 11:35:48,854 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-8) [3bc9ae31] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 00d6eddc-c7e7-4e7b-961c-2508f5de374a Type: VDS >2014-04-09 11:35:48,976 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-8) [3bc9ae31] START, RemoveVdsVDSCommand( HostId = 00d6eddc-c7e7-4e7b-961c-2508f5de374a), log id: 12d00bb4 >2014-04-09 11:35:48,976 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-8) [3bc9ae31] vdsManager::disposing >2014-04-09 11:35:48,977 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-8) [3bc9ae31] FINISH, RemoveVdsVDSCommand, log id: 12d00bb4 >2014-04-09 11:35:48,990 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-8) [3bc9ae31] Correlation ID: 3bc9ae31, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was removed by admin@internal. >2014-04-09 11:35:48,990 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-8) [3bc9ae31] Lock freed to object EngineLock [exclusiveLocks= key: 00d6eddc-c7e7-4e7b-961c-2508f5de374a value: VDS >, sharedLocks= ] >2014-04-09 11:36:13,854 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [1ed9f201] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.4.132' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:36:13,886 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [1ed9f201] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 11:36:13,915 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: ada88760-584c-4493-8d10-62091bdc48ed Type: VDS >2014-04-09 11:36:13,928 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 11:36:13,928 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [5030bffe] Cannot get vdsManager for vdsid=ada88760-584c-4493-8d10-62091bdc48ed >2014-04-09 11:36:13,932 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] START, RemoveVdsVDSCommand(HostName = 10.66.4.132, HostId = ada88760-584c-4493-8d10-62091bdc48ed), log id: 19a4e6a6 >2014-04-09 11:36:13,932 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [5030bffe] Cannot get vdsManager for vdsid=ada88760-584c-4493-8d10-62091bdc48ed >2014-04-09 11:36:13,933 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] FINISH, RemoveVdsVDSCommand, log id: 19a4e6a6 >2014-04-09 11:36:13,933 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [5030bffe] Cannot get vdsManager for vdsid=ada88760-584c-4493-8d10-62091bdc48ed >2014-04-09 11:36:13,935 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] START, AddVdsVDSCommand(HostName = 10.66.4.132, HostId = ada88760-584c-4493-8d10-62091bdc48ed), log id: 2afe9d5d >2014-04-09 11:36:13,935 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] AddVds - entered , starting logic to add VDS ada88760-584c-4493-8d10-62091bdc48ed >2014-04-09 11:36:13,937 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] AddVds - VDS ada88760-584c-4493-8d10-62091bdc48ed was added, will try to add it to the resource manager >2014-04-09 11:36:13,938 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [5030bffe] Entered VdsManager constructor >2014-04-09 11:36:13,962 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [5030bffe] Initialize vdsBroker (10.66.4.132,54,321) >2014-04-09 11:36:13,964 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [5030bffe] VDS ada88760-584c-4493-8d10-62091bdc48ed was added to the Resource Manager >2014-04-09 11:36:13,964 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [5030bffe] FINISH, AddVdsVDSCommand, log id: 2afe9d5d >2014-04-09 11:36:13,972 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [5030bffe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.4.132. >2014-04-09 11:36:14,003 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [5030bffe] Correlation ID: 1ed9f201, Job ID: c88a5a18-ce67-4565-a20a-cd29c60b4dea, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.4.132 was added by admin@internal. >2014-04-09 11:36:14,012 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-9) [6776a8a] Lock Acquired to object EngineLock [exclusiveLocks= key: ada88760-584c-4493-8d10-62091bdc48ed value: VDS >, sharedLocks= ] >2014-04-09 11:36:14,028 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-9) [6776a8a] Running command: InstallVdsCommand internal: true. Entities affected : ID: ada88760-584c-4493-8d10-62091bdc48ed Type: VDS >2014-04-09 11:36:14,028 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-9) [6776a8a] Before Installation host ada88760-584c-4493-8d10-62091bdc48ed, 10.66.4.132 >2014-04-09 11:36:14,035 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-9) [6776a8a] START, SetVdsStatusVDSCommand(HostName = 10.66.4.132, HostId = ada88760-584c-4493-8d10-62091bdc48ed, status=Installing, nonOperationalReason=NONE), log id: 76e94ae6 >2014-04-09 11:36:14,045 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-9) [6776a8a] FINISH, SetVdsStatusVDSCommand, log id: 76e94ae6 >2014-04-09 11:36:14,149 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-9) [6776a8a] Installation 10.66.4.132: Connected to host 10.66.4.132 with SSH key fingerprint: b3:ce:df:e8:0e:d8:b2:9c:6f:be:36:c2:0f:28:f2:d8 >2014-04-09 11:36:14,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-9) [6776a8a] Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Connected to host 10.66.4.132 with SSH key fingerprint: b3:ce:df:e8:0e:d8:b2:9c:6f:be:36:c2:0f:28:f2:d8. >2014-04-09 11:36:14,215 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-9) [6776a8a] Installation of 10.66.4.132. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 11:36:14,229 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-9) SSH execute root@10.66.4.132 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 11:36:16,398 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Initializing >2014-04-09 11:36:16,411 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Initializing. >2014-04-09 11:36:16,454 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Environment setup >2014-04-09 11:36:16,476 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Environment setup. >2014-04-09 11:36:16,580 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Environment packages setup >2014-04-09 11:36:16,603 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Environment packages setup. >2014-04-09 11:36:16,967 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-23) Initializing Host: 10.66.4.132 >2014-04-09 11:36:42,300 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Status: Downloading Packages >2014-04-09 11:36:42,376 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Status: Downloading Packages. >2014-04-09 11:36:43,440 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 11:36:43,474 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 11:36:43,474 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Status: Check Package Signatures >2014-04-09 11:36:43,499 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Status: Check Package Signatures. >2014-04-09 11:36:43,499 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Status: Running Test Transaction >2014-04-09 11:36:43,516 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Status: Running Test Transaction. >2014-04-09 11:36:44,741 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Status: Running Transaction >2014-04-09 11:36:44,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Status: Running Transaction. >2014-04-09 11:36:47,515 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 11:36:47,867 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 11:36:49,845 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum updated: 2/2: dmidecode >2014-04-09 11:36:49,930 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum updated: 2/2: dmidecode. >2014-04-09 11:36:52,290 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-09 11:36:52,314 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-09 11:36:52,557 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-09 11:36:52,573 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-09 11:36:53,024 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Programs detection >2014-04-09 11:36:53,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Programs detection. >2014-04-09 11:36:53,040 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Environment customization >2014-04-09 11:36:53,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Environment customization. >2014-04-09 11:36:53,152 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Logs at host located at: '/tmp/ovirt-host-deploy-20140409113615.log' >2014-04-09 11:36:53,164 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Logs at host located at: '/tmp/ovirt-host-deploy-20140409113615.log'. >2014-04-09 11:36:53,238 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.4.132 reports unique id DEE2C6C2-0A1E-5644-25A5-ABBE43B32A8A >2014-04-09 11:36:53,268 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id DEE2C6C2-0A1E-5644-25A5-ABBE43B32A8A to Host 10.66.4.132 >2014-04-09 11:36:53,426 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Setup validation >2014-04-09 11:36:53,439 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Setup validation. >2014-04-09 11:36:53,487 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Machine does not support constant timestamp counter, this may effect performance >2014-04-09 11:36:53,505 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.4.132 installation in progress . Machine does not support constant timestamp counter, this may effect performance. >2014-04-09 11:36:53,522 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Failed to execute stage 'Setup validation': Hardware does not support virtualization >2014-04-09 11:36:53,539 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.4.132. Failed to execute stage 'Setup validation': Hardware does not support virtualization. >2014-04-09 11:36:53,539 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Pre-termination >2014-04-09 11:36:53,556 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Pre-termination. >2014-04-09 11:36:53,587 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113653-10.66.4.132-6776a8a.log' >2014-04-09 11:36:53,597 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113653-10.66.4.132-6776a8a.log'. >2014-04-09 11:36:53,816 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.4.132: Stage: Termination >2014-04-09 11:36:53,954 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6776a8a, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.4.132. Stage: Termination. >2014-04-09 11:36:54,075 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-9) SSH error running command root@10.66.4.132:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.4.132' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:36:54,077 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-9) [6776a8a] Error during host 10.66.4.132 install: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.4.132' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:36:54,078 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-9) [6776a8a] Host installation failed for host ada88760-584c-4493-8d10-62091bdc48ed, 10.66.4.132.: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.4.132' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:36:54,084 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-9) [6776a8a] START, SetVdsStatusVDSCommand(HostName = 10.66.4.132, HostId = ada88760-584c-4493-8d10-62091bdc48ed, status=InstallFailed, nonOperationalReason=NONE), log id: 4fb0a7d9 >2014-04-09 11:36:54,098 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-9) [6776a8a] FINISH, SetVdsStatusVDSCommand, log id: 4fb0a7d9 >2014-04-09 11:36:54,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-9) [6776a8a] Correlation ID: 6776a8a, Job ID: c88a5a18-ce67-4565-a20a-cd29c60b4dea, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.4.132 installation failed. Command returned failure code 1 during SSH session 'root@10.66.4.132'. >2014-04-09 11:36:54,173 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-9) [6776a8a] Lock freed to object EngineLock [exclusiveLocks= key: ada88760-584c-4493-8d10-62091bdc48ed value: VDS >, sharedLocks= ] >2014-04-09 11:37:04,026 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [655345f] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:37:04,063 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [655345f] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 11:37:04,092 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: a3aac231-d93b-4f1d-946c-37fbc1b618ef Type: VDS >2014-04-09 11:37:04,113 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 11:37:04,114 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [135ad39d] Cannot get vdsManager for vdsid=a3aac231-d93b-4f1d-946c-37fbc1b618ef >2014-04-09 11:37:04,118 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] START, RemoveVdsVDSCommand(HostName = 10.66.106.32, HostId = a3aac231-d93b-4f1d-946c-37fbc1b618ef), log id: a866597 >2014-04-09 11:37:04,118 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [135ad39d] Cannot get vdsManager for vdsid=a3aac231-d93b-4f1d-946c-37fbc1b618ef >2014-04-09 11:37:04,118 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] FINISH, RemoveVdsVDSCommand, log id: a866597 >2014-04-09 11:37:04,118 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [135ad39d] Cannot get vdsManager for vdsid=a3aac231-d93b-4f1d-946c-37fbc1b618ef >2014-04-09 11:37:04,121 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] START, AddVdsVDSCommand(HostName = 10.66.106.32, HostId = a3aac231-d93b-4f1d-946c-37fbc1b618ef), log id: 58d9e6d5 >2014-04-09 11:37:04,121 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] AddVds - entered , starting logic to add VDS a3aac231-d93b-4f1d-946c-37fbc1b618ef >2014-04-09 11:37:04,123 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] AddVds - VDS a3aac231-d93b-4f1d-946c-37fbc1b618ef was added, will try to add it to the resource manager >2014-04-09 11:37:04,123 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [135ad39d] Entered VdsManager constructor >2014-04-09 11:37:04,141 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [135ad39d] Initialize vdsBroker (10.66.106.32,54,321) >2014-04-09 11:37:04,145 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [135ad39d] VDS a3aac231-d93b-4f1d-946c-37fbc1b618ef was added to the Resource Manager >2014-04-09 11:37:04,146 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [135ad39d] FINISH, AddVdsVDSCommand, log id: 58d9e6d5 >2014-04-09 11:37:04,154 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [135ad39d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.32. >2014-04-09 11:37:04,189 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [135ad39d] Correlation ID: 655345f, Job ID: 16245a49-a6de-471f-bad5-ae2aa63123ae, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was added by admin@internal. >2014-04-09 11:37:04,197 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-10) [2602fa84] Lock Acquired to object EngineLock [exclusiveLocks= key: a3aac231-d93b-4f1d-946c-37fbc1b618ef value: VDS >, sharedLocks= ] >2014-04-09 11:37:04,213 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-10) [2602fa84] Running command: InstallVdsCommand internal: true. Entities affected : ID: a3aac231-d93b-4f1d-946c-37fbc1b618ef Type: VDS >2014-04-09 11:37:04,213 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-10) [2602fa84] Before Installation host a3aac231-d93b-4f1d-946c-37fbc1b618ef, 10.66.106.32 >2014-04-09 11:37:04,220 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-10) [2602fa84] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = a3aac231-d93b-4f1d-946c-37fbc1b618ef, status=Installing, nonOperationalReason=NONE), log id: 669fcfc7 >2014-04-09 11:37:04,230 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-10) [2602fa84] FINISH, SetVdsStatusVDSCommand, log id: 669fcfc7 >2014-04-09 11:37:04,327 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-10) [2602fa84] Installation 10.66.106.32: Connected to host 10.66.106.32 with SSH key fingerprint: ad:9d:6c:65:13:cb:67:f4:a9:41:39:50:26:b0:4c:08 >2014-04-09 11:37:04,338 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-10) [2602fa84] Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Connected to host 10.66.106.32 with SSH key fingerprint: ad:9d:6c:65:13:cb:67:f4:a9:41:39:50:26:b0:4c:08. >2014-04-09 11:37:04,360 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-10) [2602fa84] Installation of 10.66.106.32. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 11:37:04,374 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-10) SSH execute root@10.66.106.32 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 11:37:05,513 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Initializing >2014-04-09 11:37:05,545 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Initializing. >2014-04-09 11:37:05,572 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment setup >2014-04-09 11:37:05,661 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment setup. >2014-04-09 11:37:05,662 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment packages setup >2014-04-09 11:37:05,704 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment packages setup. >2014-04-09 11:37:07,147 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-52) Initializing Host: 10.66.106.32 >2014-04-09 11:37:08,207 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Programs detection >2014-04-09 11:37:08,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Programs detection. >2014-04-09 11:37:08,261 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment customization >2014-04-09 11:37:08,280 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment customization. >2014-04-09 11:37:08,296 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Logs at host located at: '/tmp/ovirt-host-deploy-20140409113722.log' >2014-04-09 11:37:08,312 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Logs at host located at: '/tmp/ovirt-host-deploy-20140409113722.log'. >2014-04-09 11:37:08,412 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.32 reports unique id 3584EC38-EBED-11E1-BC99-5CF3FCDC10BC >2014-04-09 11:37:08,415 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 3584EC38-EBED-11E1-BC99-5CF3FCDC10BC to Host 10.66.106.32 >2014-04-09 11:37:08,517 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Setup validation >2014-04-09 11:37:08,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Setup validation. >2014-04-09 11:37:08,758 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Hardware supports virtualization >2014-04-09 11:37:08,771 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Hardware supports virtualization. >2014-04-09 11:37:09,883 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-04-09 11:37:09,885 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-63) Start refreshing all users data >2014-04-09 11:37:10,454 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Transaction setup >2014-04-09 11:37:10,479 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Transaction setup. >2014-04-09 11:37:10,499 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Misc configuration >2014-04-09 11:37:10,512 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Misc configuration. >2014-04-09 11:37:10,513 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Package installation >2014-04-09 11:37:10,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Package installation. >2014-04-09 11:37:12,791 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-12) [4da67b97] Lock Acquired to object EngineLock [exclusiveLocks= key: ada88760-584c-4493-8d10-62091bdc48ed value: VDS >, sharedLocks= ] >2014-04-09 11:37:12,799 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-11) [4da67b97] Running command: RemoveVdsCommand internal: false. Entities affected : ID: ada88760-584c-4493-8d10-62091bdc48ed Type: VDS >2014-04-09 11:37:12,848 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-11) [4da67b97] START, RemoveVdsVDSCommand( HostId = ada88760-584c-4493-8d10-62091bdc48ed), log id: 1ea7828c >2014-04-09 11:37:12,848 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-11) [4da67b97] vdsManager::disposing >2014-04-09 11:37:12,849 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-11) [4da67b97] FINISH, RemoveVdsVDSCommand, log id: 1ea7828c >2014-04-09 11:37:12,854 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-11) [4da67b97] Correlation ID: 4da67b97, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.4.132 was removed by admin@internal. >2014-04-09 11:37:12,854 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-11) [4da67b97] Lock freed to object EngineLock [exclusiveLocks= key: ada88760-584c-4493-8d10-62091bdc48ed value: VDS >, sharedLocks= ] >2014-04-09 11:37:13,866 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-09 11:37:13,906 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.106.32. Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-09 11:37:13,907 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-09 11:37:13,920 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.106.32. Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-09 11:37:13,920 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Performing yum transaction rollback >2014-04-09 11:37:13,928 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Performing yum transaction rollback. >2014-04-09 11:37:13,929 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Pre-termination >2014-04-09 11:37:13,937 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Pre-termination. >2014-04-09 11:37:13,954 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113713-10.66.106.32-2602fa84.log' >2014-04-09 11:37:13,970 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409113713-10.66.106.32-2602fa84.log'. >2014-04-09 11:37:14,403 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Termination >2014-04-09 11:37:14,420 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2602fa84, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Termination. >2014-04-09 11:37:14,530 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-10) SSH error running command root@10.66.106.32:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:37:14,532 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-10) [2602fa84] Error during host 10.66.106.32 install: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:37:14,534 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-10) [2602fa84] Host installation failed for host a3aac231-d93b-4f1d-946c-37fbc1b618ef, 10.66.106.32.: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:37:14,538 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-10) [2602fa84] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = a3aac231-d93b-4f1d-946c-37fbc1b618ef, status=InstallFailed, nonOperationalReason=NONE), log id: 560bccd6 >2014-04-09 11:37:14,545 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-10) [2602fa84] FINISH, SetVdsStatusVDSCommand, log id: 560bccd6 >2014-04-09 11:37:14,562 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-10) [2602fa84] Correlation ID: 2602fa84, Job ID: 16245a49-a6de-471f-bad5-ae2aa63123ae, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 installation failed. Command returned failure code 1 during SSH session 'root@10.66.106.32'. >2014-04-09 11:37:14,579 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-10) [2602fa84] Lock freed to object EngineLock [exclusiveLocks= key: a3aac231-d93b-4f1d-946c-37fbc1b618ef value: VDS >, sharedLocks= ] >2014-04-09 11:37:21,803 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-3) [730e0e47] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c3867e-515e-4f90-8828-a08ca7e3624e value: VDS >, sharedLocks= ] >2014-04-09 11:37:21,811 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-12) [730e0e47] Running command: RemoveVdsCommand internal: false. Entities affected : ID: f2c3867e-515e-4f90-8828-a08ca7e3624e Type: VDS >2014-04-09 11:37:21,933 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-12) [730e0e47] START, RemoveVdsVDSCommand( HostId = f2c3867e-515e-4f90-8828-a08ca7e3624e), log id: 361b1d04 >2014-04-09 11:37:21,933 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-12) [730e0e47] vdsManager::disposing >2014-04-09 11:37:21,934 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-12) [730e0e47] FINISH, RemoveVdsVDSCommand, log id: 361b1d04 >2014-04-09 11:37:21,944 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-12) [730e0e47] Correlation ID: 730e0e47, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was removed by admin@internal. >2014-04-09 11:37:21,948 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-12) [730e0e47] Lock freed to object EngineLock [exclusiveLocks= key: f2c3867e-515e-4f90-8828-a08ca7e3624e value: VDS >, sharedLocks= ] >2014-04-09 11:38:12,910 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-13) [624f7c60] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.106.40' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:38:12,946 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-13) [624f7c60] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 11:38:12,974 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:38:12,987 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 11:38:12,987 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Cannot get vdsManager for vdsid=79c710f2-5c70-4ab6-a4ea-f87974c644b2 >2014-04-09 11:38:12,991 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] START, RemoveVdsVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2), log id: 40123086 >2014-04-09 11:38:12,991 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Cannot get vdsManager for vdsid=79c710f2-5c70-4ab6-a4ea-f87974c644b2 >2014-04-09 11:38:12,991 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] FINISH, RemoveVdsVDSCommand, log id: 40123086 >2014-04-09 11:38:12,991 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Cannot get vdsManager for vdsid=79c710f2-5c70-4ab6-a4ea-f87974c644b2 >2014-04-09 11:38:12,993 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] START, AddVdsVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2), log id: 25631bc8 >2014-04-09 11:38:12,993 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] AddVds - entered , starting logic to add VDS 79c710f2-5c70-4ab6-a4ea-f87974c644b2 >2014-04-09 11:38:12,995 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] AddVds - VDS 79c710f2-5c70-4ab6-a4ea-f87974c644b2 was added, will try to add it to the resource manager >2014-04-09 11:38:12,995 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Entered VdsManager constructor >2014-04-09 11:38:13,013 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Initialize vdsBroker (10.66.106.40,54,321) >2014-04-09 11:38:13,030 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-13) [1f54b6ac] VDS 79c710f2-5c70-4ab6-a4ea-f87974c644b2 was added to the Resource Manager >2014-04-09 11:38:13,030 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-13) [1f54b6ac] FINISH, AddVdsVDSCommand, log id: 25631bc8 >2014-04-09 11:38:13,043 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-09 11:38:13,080 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [1f54b6ac] Correlation ID: 624f7c60, Job ID: 04c12e4a-c781-4bea-9756-ff5e4c6a5ad1, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was added by admin@internal. >2014-04-09 11:38:13,087 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-13) [40d2e16e] Lock Acquired to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS >, sharedLocks= ] >2014-04-09 11:38:13,111 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-13) [40d2e16e] Running command: InstallVdsCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:38:13,112 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-13) [40d2e16e] Before Installation host 79c710f2-5c70-4ab6-a4ea-f87974c644b2, 10.66.106.40 >2014-04-09 11:38:13,115 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-13) [40d2e16e] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2, status=Installing, nonOperationalReason=NONE), log id: 7298f8e2 >2014-04-09 11:38:13,128 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-13) [40d2e16e] FINISH, SetVdsStatusVDSCommand, log id: 7298f8e2 >2014-04-09 11:38:13,216 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-13) [40d2e16e] Installation 10.66.106.40: Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd >2014-04-09 11:38:13,228 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-13) [40d2e16e] Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd. >2014-04-09 11:38:13,248 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-13) [40d2e16e] Installation of 10.66.106.40. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 11:38:13,259 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-13) SSH execute root@10.66.106.40 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 11:38:14,436 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Initializing >2014-04-09 11:38:14,461 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Initializing. >2014-04-09 11:38:14,482 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment setup >2014-04-09 11:38:14,495 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment setup. >2014-04-09 11:38:14,496 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment packages setup >2014-04-09 11:38:14,512 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment packages setup. >2014-04-09 11:38:16,018 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-20) Initializing Host: 10.66.106.40 >2014-04-09 11:38:16,162 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Programs detection >2014-04-09 11:38:16,186 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Programs detection. >2014-04-09 11:38:16,187 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment customization >2014-04-09 11:38:16,203 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment customization. >2014-04-09 11:38:16,238 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Logs at host located at: '/tmp/ovirt-host-deploy-20140409113831.log' >2014-04-09 11:38:16,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Logs at host located at: '/tmp/ovirt-host-deploy-20140409113831.log'. >2014-04-09 11:38:16,311 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.40 reports unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 >2014-04-09 11:38:16,315 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 to Host 10.66.106.40 >2014-04-09 11:38:16,401 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Setup validation >2014-04-09 11:38:16,411 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Setup validation. >2014-04-09 11:38:16,561 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Hardware supports virtualization >2014-04-09 11:38:16,569 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Hardware supports virtualization. >2014-04-09 11:38:18,143 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction setup >2014-04-09 11:38:18,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction setup. >2014-04-09 11:38:18,219 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-09 11:38:18,236 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-09 11:38:18,236 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Package installation >2014-04-09 11:38:18,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Package installation. >2014-04-09 11:38:21,246 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Downloading Packages >2014-04-09 11:38:21,269 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Downloading Packages. >2014-04-09 11:38:22,837 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: augeas-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:38:22,852 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: augeas-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:38:25,300 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: augeas-libs-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:38:25,318 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: augeas-libs-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:38:27,341 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:38:27,360 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:38:28,944 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:38:28,990 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:38:30,727 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: fence-agents-3.1.5-35.el6_5.4.x86_64 >2014-04-09 11:38:30,743 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: fence-agents-3.1.5-35.el6_5.4.x86_64. >2014-04-09 11:38:33,363 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: ipmitool-1.8.11-16.el6.x86_64 >2014-04-09 11:38:33,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: ipmitool-1.8.11-16.el6.x86_64. >2014-04-09 11:38:35,067 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: kpartx-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:38:35,084 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: kpartx-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:38:36,957 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 >2014-04-09 11:38:36,975 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64. >2014-04-09 11:38:39,827 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: net-snmp-5.5-49.el6_5.1.x86_64 >2014-04-09 11:38:39,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: net-snmp-5.5-49.el6_5.1.x86_64. >2014-04-09 11:38:43,707 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: net-snmp-libs-5.5-49.el6_5.1.x86_64 >2014-04-09 11:38:43,732 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: net-snmp-libs-5.5-49.el6_5.1.x86_64. >2014-04-09 11:38:45,467 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: net-snmp-utils-5.5-49.el6_5.1.x86_64 >2014-04-09 11:38:45,491 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: net-snmp-utils-5.5-49.el6_5.1.x86_64. >2014-04-09 11:38:47,222 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: perl-Net-Telnet-3.03-11.el6.noarch >2014-04-09 11:38:47,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: perl-Net-Telnet-3.03-11.el6.noarch. >2014-04-09 11:38:47,332 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: pyparted-3.4-4.el6.x86_64 >2014-04-09 11:38:47,400 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: pyparted-3.4-4.el6.x86_64. >2014-04-09 11:38:47,400 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: python-decorator-3.0.1-3.1.el6.noarch >2014-04-09 11:38:47,425 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: python-decorator-3.0.1-3.1.el6.noarch. >2014-04-09 11:38:50,107 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 11:38:50,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 11:38:52,090 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: sanlock-2.8-1.el6.x86_64 >2014-04-09 11:38:52,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: sanlock-2.8-1.el6.x86_64. >2014-04-09 11:38:53,561 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: sanlock-lib-2.8-1.el6.x86_64 >2014-04-09 11:38:53,575 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: sanlock-lib-2.8-1.el6.x86_64. >2014-04-09 11:38:54,744 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: sanlock-python-2.8-1.el6.x86_64 >2014-04-09 11:38:54,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: sanlock-python-2.8-1.el6.x86_64. >2014-04-09 11:38:54,796 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: sg3_utils-1.28-5.el6.x86_64 >2014-04-09 11:38:54,808 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: sg3_utils-1.28-5.el6.x86_64. >2014-04-09 11:38:56,981 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: tree-1.5.3-2.el6.x86_64 >2014-04-09 11:38:57,000 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: tree-1.5.3-2.el6.x86_64. >2014-04-09 11:38:57,012 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: tuned-0.2.19-13.el6.noarch >2014-04-09 11:38:57,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: tuned-0.2.19-13.el6.noarch. >2014-04-09 11:38:59,467 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: vdsm-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:38:59,482 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: vdsm-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:00,537 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: vdsm-cli-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:00,557 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: vdsm-cli-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:01,783 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: vdsm-python-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:39:01,807 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: vdsm-python-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:03,204 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Download/Verify: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:03,224 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Download/Verify: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:03,224 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Check Package Signatures >2014-04-09 11:39:03,240 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Check Package Signatures. >2014-04-09 11:39:03,241 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Running Test Transaction >2014-04-09 11:39:03,249 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Running Test Transaction. >2014-04-09 11:39:04,046 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Status: Running Transaction >2014-04-09 11:39:04,057 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Status: Running Transaction. >2014-04-09 11:39:04,738 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 1/29: sanlock-lib-2.8-1.el6.x86_64 >2014-04-09 11:39:04,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 1/29: sanlock-lib-2.8-1.el6.x86_64. >2014-04-09 11:39:05,128 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 2/29: vdsm-python-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:39:05,140 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 2/29: vdsm-python-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:05,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 3/29: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:05,748 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 3/29: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:05,793 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [1ac1bfcf] Lock Acquired to object EngineLock [exclusiveLocks= key: a3aac231-d93b-4f1d-946c-37fbc1b618ef value: VDS >, sharedLocks= ] >2014-04-09 11:39:05,801 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-14) [1ac1bfcf] Running command: RemoveVdsCommand internal: false. Entities affected : ID: a3aac231-d93b-4f1d-946c-37fbc1b618ef Type: VDS >2014-04-09 11:39:05,818 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-14) [1ac1bfcf] START, RemoveVdsVDSCommand( HostId = a3aac231-d93b-4f1d-946c-37fbc1b618ef), log id: 4dfabe54 >2014-04-09 11:39:05,818 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-14) [1ac1bfcf] vdsManager::disposing >2014-04-09 11:39:05,819 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-14) [1ac1bfcf] FINISH, RemoveVdsVDSCommand, log id: 4dfabe54 >2014-04-09 11:39:05,823 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-14) [1ac1bfcf] Correlation ID: 1ac1bfcf, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was removed by admin@internal. >2014-04-09 11:39:05,824 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-14) [1ac1bfcf] Lock freed to object EngineLock [exclusiveLocks= key: a3aac231-d93b-4f1d-946c-37fbc1b618ef value: VDS >, sharedLocks= ] >2014-04-09 11:39:06,409 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 4/29: sanlock-2.8-1.el6.x86_64 >2014-04-09 11:39:06,423 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 4/29: sanlock-2.8-1.el6.x86_64. >2014-04-09 11:39:06,944 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum update: 5/29: 1:net-snmp-libs-5.5-49.el6_5.1.x86_64 >2014-04-09 11:39:06,982 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum update: 5/29: 1:net-snmp-libs-5.5-49.el6_5.1.x86_64. >2014-04-09 11:39:07,776 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 6/29: 1:net-snmp-utils-5.5-49.el6_5.1.x86_64 >2014-04-09 11:39:07,790 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 6/29: 1:net-snmp-utils-5.5-49.el6_5.1.x86_64. >2014-04-09 11:39:08,192 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 7/29: vdsm-cli-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:08,206 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 7/29: vdsm-cli-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:08,486 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 8/29: sanlock-python-2.8-1.el6.x86_64 >2014-04-09 11:39:08,498 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 8/29: sanlock-python-2.8-1.el6.x86_64. >2014-04-09 11:39:08,775 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 9/29: python-decorator-3.0.1-3.1.el6.noarch >2014-04-09 11:39:08,790 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 9/29: python-decorator-3.0.1-3.1.el6.noarch. >2014-04-09 11:39:09,030 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 10/29: pyparted-3.4-4.el6.x86_64 >2014-04-09 11:39:09,040 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 10/29: pyparted-3.4-4.el6.x86_64. >2014-04-09 11:39:09,509 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 11/29: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:39:09,523 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 11/29: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:39:09,930 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum update: 12/29: augeas-libs-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:39:09,948 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum update: 12/29: augeas-libs-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:39:10,624 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 13/29: augeas-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:39:10,639 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 13/29: augeas-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:39:10,924 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 14/29: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 >2014-04-09 11:39:10,939 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 14/29: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64. >2014-04-09 11:39:11,276 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 15/29: perl-Net-Telnet-3.03-11.el6.noarch >2014-04-09 11:39:11,289 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 15/29: perl-Net-Telnet-3.03-11.el6.noarch. >2014-04-09 11:39:11,575 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 16/29: ipmitool-1.8.11-16.el6.x86_64 >2014-04-09 11:39:11,589 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 16/29: ipmitool-1.8.11-16.el6.x86_64. >2014-04-09 11:39:12,105 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 17/29: sg3_utils-1.28-5.el6.x86_64 >2014-04-09 11:39:12,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 17/29: sg3_utils-1.28-5.el6.x86_64. >2014-04-09 11:39:12,726 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 18/29: fence-agents-3.1.5-35.el6_5.4.x86_64 >2014-04-09 11:39:12,756 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 18/29: fence-agents-3.1.5-35.el6_5.4.x86_64. >2014-04-09 11:39:13,730 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 19/29: tree-1.5.3-2.el6.x86_64 >2014-04-09 11:39:13,756 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 19/29: tree-1.5.3-2.el6.x86_64. >2014-04-09 11:39:14,023 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum update: 20/29: kpartx-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:39:14,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum update: 20/29: kpartx-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:39:14,304 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 21/29: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:39:14,314 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 21/29: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:39:15,199 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 22/29: vdsm-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:39:15,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 22/29: vdsm-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:21,391 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-6) [120f0527] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.106.32' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 11:39:21,422 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-6) [120f0527] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 11:39:21,450 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:39:21,476 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 11:39:21,476 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [53294a4b] Cannot get vdsManager for vdsid=539a81aa-3a8e-4454-b673-e6092c868b2c >2014-04-09 11:39:21,480 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] START, RemoveVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 528ee32d >2014-04-09 11:39:21,481 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [53294a4b] Cannot get vdsManager for vdsid=539a81aa-3a8e-4454-b673-e6092c868b2c >2014-04-09 11:39:21,481 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] FINISH, RemoveVdsVDSCommand, log id: 528ee32d >2014-04-09 11:39:21,481 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [53294a4b] Cannot get vdsManager for vdsid=539a81aa-3a8e-4454-b673-e6092c868b2c >2014-04-09 11:39:21,483 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] START, AddVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 34c5e638 >2014-04-09 11:39:21,483 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] AddVds - entered , starting logic to add VDS 539a81aa-3a8e-4454-b673-e6092c868b2c >2014-04-09 11:39:21,485 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] AddVds - VDS 539a81aa-3a8e-4454-b673-e6092c868b2c was added, will try to add it to the resource manager >2014-04-09 11:39:21,485 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [53294a4b] Entered VdsManager constructor >2014-04-09 11:39:21,504 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [53294a4b] Initialize vdsBroker (10.66.106.32,54,321) >2014-04-09 11:39:21,506 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [53294a4b] VDS 539a81aa-3a8e-4454-b673-e6092c868b2c was added to the Resource Manager >2014-04-09 11:39:21,506 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [53294a4b] FINISH, AddVdsVDSCommand, log id: 34c5e638 >2014-04-09 11:39:21,513 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [53294a4b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.32. >2014-04-09 11:39:21,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [53294a4b] Correlation ID: 120f0527, Job ID: be4e6382-ead2-4cb8-852e-185fbd8dd6ff, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was added by admin@internal. >2014-04-09 11:39:21,564 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-15) [40477571] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:39:21,588 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-15) [40477571] Running command: InstallVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:39:21,589 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-15) [40477571] Before Installation host 539a81aa-3a8e-4454-b673-e6092c868b2c, 10.66.106.32 >2014-04-09 11:39:21,594 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-15) [40477571] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=Installing, nonOperationalReason=NONE), log id: 3a42f207 >2014-04-09 11:39:21,605 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-15) [40477571] FINISH, SetVdsStatusVDSCommand, log id: 3a42f207 >2014-04-09 11:39:21,703 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-15) [40477571] Installation 10.66.106.32: Connected to host 10.66.106.32 with SSH key fingerprint: ad:9d:6c:65:13:cb:67:f4:a9:41:39:50:26:b0:4c:08 >2014-04-09 11:39:21,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-15) [40477571] Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Connected to host 10.66.106.32 with SSH key fingerprint: ad:9d:6c:65:13:cb:67:f4:a9:41:39:50:26:b0:4c:08. >2014-04-09 11:39:21,733 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-15) [40477571] Installation of 10.66.106.32. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 11:39:21,747 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-15) SSH execute root@10.66.106.32 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 11:39:22,916 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Initializing >2014-04-09 11:39:22,930 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Initializing. >2014-04-09 11:39:22,958 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment setup >2014-04-09 11:39:22,980 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment setup. >2014-04-09 11:39:22,980 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment packages setup >2014-04-09 11:39:22,996 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment packages setup. >2014-04-09 11:39:24,509 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-10) Initializing Host: 10.66.106.32 >2014-04-09 11:39:24,809 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Programs detection >2014-04-09 11:39:24,838 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Programs detection. >2014-04-09 11:39:24,838 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Environment customization >2014-04-09 11:39:24,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Environment customization. >2014-04-09 11:39:24,898 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Logs at host located at: '/tmp/ovirt-host-deploy-20140409113940.log' >2014-04-09 11:39:24,913 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Logs at host located at: '/tmp/ovirt-host-deploy-20140409113940.log'. >2014-04-09 11:39:25,017 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.32 reports unique id 3584EC38-EBED-11E1-BC99-5CF3FCDC10BC >2014-04-09 11:39:25,020 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 3584EC38-EBED-11E1-BC99-5CF3FCDC10BC to Host 10.66.106.32 >2014-04-09 11:39:25,132 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Setup validation >2014-04-09 11:39:25,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Setup validation. >2014-04-09 11:39:25,372 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Hardware supports virtualization >2014-04-09 11:39:25,388 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Hardware supports virtualization. >2014-04-09 11:39:27,026 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Transaction setup >2014-04-09 11:39:27,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Transaction setup. >2014-04-09 11:39:27,080 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Misc configuration >2014-04-09 11:39:27,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Misc configuration. >2014-04-09 11:39:27,106 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Package installation >2014-04-09 11:39:27,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Package installation. >2014-04-09 11:39:30,189 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Downloading Packages >2014-04-09 11:39:30,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Downloading Packages. >2014-04-09 11:39:31,056 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: augeas-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:39:31,071 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: augeas-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:39:32,217 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: augeas-libs-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:39:32,229 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: augeas-libs-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:39:33,097 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:39:33,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:39:34,268 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:39:34,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:39:35,393 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: fence-agents-3.1.5-35.el6_5.4.x86_64 >2014-04-09 11:39:35,446 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: fence-agents-3.1.5-35.el6_5.4.x86_64. >2014-04-09 11:39:36,807 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: ipmitool-1.8.11-16.el6.x86_64 >2014-04-09 11:39:36,829 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: ipmitool-1.8.11-16.el6.x86_64. >2014-04-09 11:39:37,747 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: kpartx-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:39:37,779 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: kpartx-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:39:38,760 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 >2014-04-09 11:39:38,779 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64. >2014-04-09 11:39:40,286 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: net-snmp-5.5-49.el6_5.1.x86_64 >2014-04-09 11:39:40,304 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: net-snmp-5.5-49.el6_5.1.x86_64. >2014-04-09 11:39:43,144 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: net-snmp-libs-5.5-49.el6_5.1.x86_64 >2014-04-09 11:39:43,200 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: net-snmp-libs-5.5-49.el6_5.1.x86_64. >2014-04-09 11:39:44,020 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: net-snmp-utils-5.5-49.el6_5.1.x86_64 >2014-04-09 11:39:44,036 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: net-snmp-utils-5.5-49.el6_5.1.x86_64. >2014-04-09 11:39:44,880 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: perl-Net-Telnet-3.03-11.el6.noarch >2014-04-09 11:39:44,895 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: perl-Net-Telnet-3.03-11.el6.noarch. >2014-04-09 11:39:44,895 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: pyparted-3.4-4.el6.x86_64 >2014-04-09 11:39:44,911 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: pyparted-3.4-4.el6.x86_64. >2014-04-09 11:39:44,911 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: python-decorator-3.0.1-3.1.el6.noarch >2014-04-09 11:39:44,919 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: python-decorator-3.0.1-3.1.el6.noarch. >2014-04-09 11:39:45,703 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum update: 23/29: 1:net-snmp-5.5-49.el6_5.1.x86_64 >2014-04-09 11:39:45,719 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum update: 23/29: 1:net-snmp-5.5-49.el6_5.1.x86_64. >2014-04-09 11:39:46,420 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 24/29: tuned-0.2.19-13.el6.noarch >2014-04-09 11:39:46,436 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 24/29: tuned-0.2.19-13.el6.noarch. >2014-04-09 11:39:46,526 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 11:39:46,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 11:39:47,044 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum install: 25/29: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 11:39:47,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum install: 25/29: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 11:39:47,435 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum updated: 26/29: net-snmp >2014-04-09 11:39:47,452 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum updated: 26/29: net-snmp. >2014-04-09 11:39:47,910 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum updated: 27/29: net-snmp-libs >2014-04-09 11:39:47,927 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum updated: 27/29: net-snmp-libs. >2014-04-09 11:39:48,303 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum updated: 28/29: augeas-libs >2014-04-09 11:39:48,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum updated: 28/29: augeas-libs. >2014-04-09 11:39:48,678 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: sanlock-2.8-1.el6.x86_64 >2014-04-09 11:39:48,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: sanlock-2.8-1.el6.x86_64. >2014-04-09 11:39:48,736 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum updated: 29/29: kpartx >2014-04-09 11:39:48,753 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum updated: 29/29: kpartx. >2014-04-09 11:39:49,259 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: sanlock-lib-2.8-1.el6.x86_64 >2014-04-09 11:39:49,269 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: sanlock-lib-2.8-1.el6.x86_64. >2014-04-09 11:39:49,756 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 1/29: kpartx.x86_64 0:0.4.9-72.el6_5.1 - u >2014-04-09 11:39:49,769 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 1/29: kpartx.x86_64 0:0.4.9-72.el6_5.1 - u. >2014-04-09 11:39:49,822 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: sanlock-python-2.8-1.el6.x86_64 >2014-04-09 11:39:49,827 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 2/29: vdsm-cli.noarch 0:4.10.2-1.13.el6ev - u >2014-04-09 11:39:49,836 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: sanlock-python-2.8-1.el6.x86_64. >2014-04-09 11:39:49,836 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: sg3_utils-1.28-5.el6.x86_64 >2014-04-09 11:39:49,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 2/29: vdsm-cli.noarch 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:39:49,854 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: sg3_utils-1.28-5.el6.x86_64. >2014-04-09 11:39:49,906 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 3/29: net-snmp.x86_64 1:5.5-49.el6_5.1 - u >2014-04-09 11:39:49,920 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 3/29: net-snmp.x86_64 1:5.5-49.el6_5.1 - u. >2014-04-09 11:39:49,961 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 4/29: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u >2014-04-09 11:39:49,979 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 4/29: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u. >2014-04-09 11:39:50,027 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 5/29: tree.x86_64 0:1.5.3-2.el6 - u >2014-04-09 11:39:50,037 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 5/29: tree.x86_64 0:1.5.3-2.el6 - u. >2014-04-09 11:39:50,085 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 6/29: sanlock-python.x86_64 0:2.8-1.el6 - u >2014-04-09 11:39:50,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 6/29: sanlock-python.x86_64 0:2.8-1.el6 - u. >2014-04-09 11:39:50,148 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 7/29: tuned.noarch 0:0.2.19-13.el6 - u >2014-04-09 11:39:50,162 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 7/29: tuned.noarch 0:0.2.19-13.el6 - u. >2014-04-09 11:39:50,208 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 8/29: sg3_utils.x86_64 0:1.28-5.el6 - u >2014-04-09 11:39:50,221 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 8/29: sg3_utils.x86_64 0:1.28-5.el6 - u. >2014-04-09 11:39:50,263 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 9/29: sanlock.x86_64 0:2.8-1.el6 - u >2014-04-09 11:39:50,271 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 9/29: sanlock.x86_64 0:2.8-1.el6 - u. >2014-04-09 11:39:50,341 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 10/29: net-snmp-libs.x86_64 1:5.5-49.el6_5.1 - u >2014-04-09 11:39:50,354 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 10/29: net-snmp-libs.x86_64 1:5.5-49.el6_5.1 - u. >2014-04-09 11:39:50,390 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 11/29: fence-agents.x86_64 0:3.1.5-35.el6_5.4 - u >2014-04-09 11:39:50,404 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 11/29: fence-agents.x86_64 0:3.1.5-35.el6_5.4 - u. >2014-04-09 11:39:50,451 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 12/29: vdsm-python.x86_64 0:4.10.2-1.13.el6ev - u >2014-04-09 11:39:50,462 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 12/29: vdsm-python.x86_64 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:39:50,511 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 13/29: device-mapper-multipath.x86_64 0:0.4.9-72.el6_5.1 - u >2014-04-09 11:39:50,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 13/29: device-mapper-multipath.x86_64 0:0.4.9-72.el6_5.1 - u. >2014-04-09 11:39:50,584 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 14/29: vdsm.x86_64 0:4.10.2-1.13.el6ev - u >2014-04-09 11:39:50,595 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 14/29: vdsm.x86_64 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:39:50,625 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 15/29: vdsm-xmlrpc.noarch 0:4.10.2-1.13.el6ev - u >2014-04-09 11:39:50,637 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 15/29: vdsm-xmlrpc.noarch 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:39:50,669 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 16/29: ipmitool.x86_64 0:1.8.11-16.el6 - u >2014-04-09 11:39:50,679 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 16/29: ipmitool.x86_64 0:1.8.11-16.el6 - u. >2014-04-09 11:39:50,735 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 17/29: perl-Net-Telnet.noarch 0:3.03-11.el6 - u >2014-04-09 11:39:50,746 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 17/29: perl-Net-Telnet.noarch 0:3.03-11.el6 - u. >2014-04-09 11:39:50,796 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 18/29: augeas-libs.x86_64 0:1.0.0-5.el6_5.1 - u >2014-04-09 11:39:50,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 18/29: augeas-libs.x86_64 0:1.0.0-5.el6_5.1 - u. >2014-04-09 11:39:50,862 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 19/29: pyparted.x86_64 0:3.4-4.el6 - u >2014-04-09 11:39:50,879 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 19/29: pyparted.x86_64 0:3.4-4.el6 - u. >2014-04-09 11:39:50,909 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 20/29: net-snmp-utils.x86_64 1:5.5-49.el6_5.1 - u >2014-04-09 11:39:50,921 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 20/29: net-snmp-utils.x86_64 1:5.5-49.el6_5.1 - u. >2014-04-09 11:39:50,970 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 21/29: device-mapper-multipath-libs.x86_64 0:0.4.9-72.el6_5.1 - u >2014-04-09 11:39:50,979 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 21/29: device-mapper-multipath-libs.x86_64 0:0.4.9-72.el6_5.1 - u. >2014-04-09 11:39:51,012 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 22/29: libvirt-lock-sanlock.x86_64 0:0.10.2-29.el6_5.7 - u >2014-04-09 11:39:51,029 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 22/29: libvirt-lock-sanlock.x86_64 0:0.10.2-29.el6_5.7 - u. >2014-04-09 11:39:51,079 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 23/29: sanlock-lib.x86_64 0:2.8-1.el6 - u >2014-04-09 11:39:51,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 23/29: sanlock-lib.x86_64 0:2.8-1.el6 - u. >2014-04-09 11:39:51,151 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 24/29: augeas.x86_64 0:1.0.0-5.el6_5.1 - u >2014-04-09 11:39:51,162 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 24/29: augeas.x86_64 0:1.0.0-5.el6_5.1 - u. >2014-04-09 11:39:51,195 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 25/29: python-decorator.noarch 0:3.0.1-3.1.el6 - u >2014-04-09 11:39:51,204 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 25/29: python-decorator.noarch 0:3.0.1-3.1.el6 - u. >2014-04-09 11:39:51,260 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 26/29: net-snmp-libs.x86_64 1:5.5-49.el6 - ud >2014-04-09 11:39:51,271 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 26/29: net-snmp-libs.x86_64 1:5.5-49.el6 - ud. >2014-04-09 11:39:51,271 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 27/29: net-snmp.x86_64 1:5.5-49.el6 - ud >2014-04-09 11:39:51,279 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 27/29: net-snmp.x86_64 1:5.5-49.el6 - ud. >2014-04-09 11:39:51,279 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 28/29: kpartx.x86_64 0:0.4.9-72.el6 - ud >2014-04-09 11:39:51,287 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 28/29: kpartx.x86_64 0:0.4.9-72.el6 - ud. >2014-04-09 11:39:51,288 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Yum Verify: 29/29: augeas-libs.x86_64 0:1.0.0-5.el6 - ud >2014-04-09 11:39:51,296 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Yum Verify: 29/29: augeas-libs.x86_64 0:1.0.0-5.el6 - ud. >2014-04-09 11:39:51,346 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: tree-1.5.3-2.el6.x86_64 >2014-04-09 11:39:51,363 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: tree-1.5.3-2.el6.x86_64. >2014-04-09 11:39:51,363 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: tuned-0.2.19-13.el6.noarch >2014-04-09 11:39:51,379 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: tuned-0.2.19-13.el6.noarch. >2014-04-09 11:39:51,513 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-09 11:39:51,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-09 11:39:51,617 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Setting time >2014-04-09 11:39:51,629 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Setting time. >2014-04-09 11:39:53,664 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: vdsm-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:39:53,687 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: vdsm-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:54,533 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: vdsm-cli-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:54,570 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: vdsm-cli-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:55,346 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Enrolling certificate >2014-04-09 11:39:55,357 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: vdsm-python-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:39:55,362 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Enrolling certificate. >2014-04-09 11:39:55,370 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: vdsm-python-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:56,434 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Download/Verify: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:56,453 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Download/Verify: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:56,454 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Check Package Signatures >2014-04-09 11:39:56,470 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Check Package Signatures. >2014-04-09 11:39:56,470 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Running Test Transaction >2014-04-09 11:39:56,478 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Running Test Transaction. >2014-04-09 11:39:56,641 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction commit >2014-04-09 11:39:56,653 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction commit. >2014-04-09 11:39:56,694 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Closing up >2014-04-09 11:39:56,703 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Closing up. >2014-04-09 11:39:57,417 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Status: Running Transaction >2014-04-09 11:39:57,428 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Status: Running Transaction. >2014-04-09 11:39:58,284 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 1/29: sanlock-lib-2.8-1.el6.x86_64 >2014-04-09 11:39:58,295 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 1/29: sanlock-lib-2.8-1.el6.x86_64. >2014-04-09 11:39:58,699 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 2/29: vdsm-python-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:39:58,712 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 2/29: vdsm-python-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:39:59,213 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 3/29: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch >2014-04-09 11:39:59,228 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 3/29: vdsm-xmlrpc-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:39:59,809 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 4/29: sanlock-2.8-1.el6.x86_64 >2014-04-09 11:39:59,820 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 4/29: sanlock-2.8-1.el6.x86_64. >2014-04-09 11:40:00,334 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum update: 5/29: 1:net-snmp-libs-5.5-49.el6_5.1.x86_64 >2014-04-09 11:40:00,370 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum update: 5/29: 1:net-snmp-libs-5.5-49.el6_5.1.x86_64. >2014-04-09 11:40:00,957 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stopping libvirtd >2014-04-09 11:40:00,969 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stopping libvirtd. >2014-04-09 11:40:01,200 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 6/29: 1:net-snmp-utils-5.5-49.el6_5.1.x86_64 >2014-04-09 11:40:01,206 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Starting vdsm >2014-04-09 11:40:01,213 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 6/29: 1:net-snmp-utils-5.5-49.el6_5.1.x86_64. >2014-04-09 11:40:01,220 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Starting vdsm. >2014-04-09 11:40:01,652 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 7/29: vdsm-cli-4.10.2-1.13.el6ev.noarch >2014-04-09 11:40:01,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 7/29: vdsm-cli-4.10.2-1.13.el6ev.noarch. >2014-04-09 11:40:01,958 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 8/29: sanlock-python-2.8-1.el6.x86_64 >2014-04-09 11:40:01,995 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 8/29: sanlock-python-2.8-1.el6.x86_64. >2014-04-09 11:40:02,205 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 9/29: python-decorator-3.0.1-3.1.el6.noarch >2014-04-09 11:40:02,219 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 9/29: python-decorator-3.0.1-3.1.el6.noarch. >2014-04-09 11:40:02,472 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 10/29: pyparted-3.4-4.el6.x86_64 >2014-04-09 11:40:02,506 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 10/29: pyparted-3.4-4.el6.x86_64. >2014-04-09 11:40:02,943 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 11/29: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:40:02,961 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 11/29: device-mapper-multipath-libs-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:40:03,376 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum update: 12/29: augeas-libs-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:40:03,386 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum update: 12/29: augeas-libs-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:40:04,114 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 13/29: augeas-1.0.0-5.el6_5.1.x86_64 >2014-04-09 11:40:04,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 13/29: augeas-1.0.0-5.el6_5.1.x86_64. >2014-04-09 11:40:04,405 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 14/29: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 >2014-04-09 11:40:04,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 14/29: libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64. >2014-04-09 11:40:04,755 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 15/29: perl-Net-Telnet-3.03-11.el6.noarch >2014-04-09 11:40:04,769 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 15/29: perl-Net-Telnet-3.03-11.el6.noarch. >2014-04-09 11:40:05,062 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 16/29: ipmitool-1.8.11-16.el6.x86_64 >2014-04-09 11:40:05,077 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 16/29: ipmitool-1.8.11-16.el6.x86_64. >2014-04-09 11:40:05,579 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 17/29: sg3_utils-1.28-5.el6.x86_64 >2014-04-09 11:40:05,611 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 17/29: sg3_utils-1.28-5.el6.x86_64. >2014-04-09 11:40:06,186 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 18/29: fence-agents-3.1.5-35.el6_5.4.x86_64 >2014-04-09 11:40:06,202 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 18/29: fence-agents-3.1.5-35.el6_5.4.x86_64. >2014-04-09 11:40:07,180 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 19/29: tree-1.5.3-2.el6.x86_64 >2014-04-09 11:40:07,234 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 19/29: tree-1.5.3-2.el6.x86_64. >2014-04-09 11:40:07,478 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum update: 20/29: kpartx-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:40:07,494 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum update: 20/29: kpartx-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:40:07,763 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 21/29: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64 >2014-04-09 11:40:07,783 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 21/29: device-mapper-multipath-0.4.9-72.el6_5.1.x86_64. >2014-04-09 11:40:08,632 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 22/29: vdsm-4.10.2-1.13.el6ev.x86_64 >2014-04-09 11:40:08,649 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 22/29: vdsm-4.10.2-1.13.el6ev.x86_64. >2014-04-09 11:40:12,091 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Pre-termination >2014-04-09 11:40:12,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Pre-termination. >2014-04-09 11:40:12,395 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409114012-10.66.106.40-40d2e16e.log' >2014-04-09 11:40:12,415 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409114012-10.66.106.40-40d2e16e.log'. >2014-04-09 11:40:12,807 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Termination >2014-04-09 11:40:12,832 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40d2e16e, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Termination. >2014-04-09 11:40:14,315 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-13) [40d2e16e] Engine managed to communicate with VDSM agent on host 10.66.106.40 >2014-04-09 11:40:14,563 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-13) [40d2e16e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.40. >2014-04-09 11:40:14,803 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-13) [39eddedc] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:40:14,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-13) [39eddedc] START, SetupNetworksVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=f02ffe87-f07a-4273-931a-dd6948d27c97, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=f721168f-5edd-4f5f-8976-591eb93f960e, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth3 {id=cb354370-2db7-4342-aec2-96c05bbc068d, vdsId=79c710f2-5c70-4ab6-a4ea-f87974c644b2, macAddress=6c:ae:8b:20:80:85, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}, > eth1 {id=a2abf6fd-d07a-4c56-b981-34686c18fd77, vdsId=79c710f2-5c70-4ab6-a4ea-f87974c644b2, macAddress=6c:ae:8b:20:80:83, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}, > eth2 {id=722757f3-2ed7-4e17-b55f-344e96b3d15a, vdsId=79c710f2-5c70-4ab6-a4ea-f87974c644b2, macAddress=6c:ae:8b:20:80:84, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}, > eth0 {id=b0e550a4-4d2e-43c5-a111-002f9020a638, vdsId=79c710f2-5c70-4ab6-a4ea-f87974c644b2, macAddress=6c:ae:8b:20:80:82, networkName=rhevm, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.66.106.40, subnet=255.255.248.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 55ca7e67 >2014-04-09 11:40:14,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-13) [39eddedc] FINISH, SetupNetworksVDSCommand, log id: 55ca7e67 >2014-04-09 11:40:15,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-13) [39eddedc] Failed in SetupNetworksVDS method >2014-04-09 11:40:15,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-13) [39eddedc] Error code unexpected and error message VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception >2014-04-09 11:40:15,351 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-13) [39eddedc] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception >2014-04-09 11:40:15,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-13) [39eddedc] Command SetupNetworksVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception >2014-04-09 11:40:15,360 ERROR [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-13) [39eddedc] Command org.ovirt.engine.core.bll.network.host.SetupNetworksCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception (Failed with error unexpected and code 16) >2014-04-09 11:40:15,373 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-13) [39eddedc] Failed to configure management network: Failed to configure management network on host 10.66.106.40 due to setup networks failure. >2014-04-09 11:40:15,374 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-13) [39eddedc] Host installation failed for host 79c710f2-5c70-4ab6-a4ea-f87974c644b2, 10.66.106.40.: org.ovirt.engine.core.bll.InstallVdsCommand$VdsInstallException: Failed to configure management network on the host > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:306) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:205) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] >Caused by: org.ovirt.engine.core.bll.network.NetworkConfigurator$NetworkConfiguratorException: Failed to configure management network > at org.ovirt.engine.core.bll.network.NetworkConfigurator.configureManagementNetwork(NetworkConfigurator.java:241) [bll.jar:] > at org.ovirt.engine.core.bll.network.NetworkConfigurator.createManagementNetworkIfRequired(NetworkConfigurator.java:69) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:298) [bll.jar:] > ... 61 more > >2014-04-09 11:40:15,377 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-13) [39eddedc] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2, status=NonOperational, nonOperationalReason=NONE), log id: 6f70c88d >2014-04-09 11:40:15,390 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-13) [39eddedc] FINISH, SetVdsStatusVDSCommand, log id: 6f70c88d >2014-04-09 11:40:15,415 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-13) [39eddedc] Correlation ID: 40d2e16e, Job ID: 04c12e4a-c781-4bea-9756-ff5e4c6a5ad1, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 installation failed. Failed to configure management network on the host. >2014-04-09 11:40:15,423 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-13) [39eddedc] Lock freed to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS >, sharedLocks= ] >2014-04-09 11:40:46,121 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum update: 23/29: 1:net-snmp-5.5-49.el6_5.1.x86_64 >2014-04-09 11:40:46,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum update: 23/29: 1:net-snmp-5.5-49.el6_5.1.x86_64. >2014-04-09 11:40:46,855 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 24/29: tuned-0.2.19-13.el6.noarch >2014-04-09 11:40:46,869 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 24/29: tuned-0.2.19-13.el6.noarch. >2014-04-09 11:40:47,477 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum install: 25/29: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 11:40:47,494 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum install: 25/29: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 11:40:47,844 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum updated: 26/29: net-snmp >2014-04-09 11:40:47,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum updated: 26/29: net-snmp. >2014-04-09 11:40:48,355 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum updated: 27/29: net-snmp-libs >2014-04-09 11:40:48,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum updated: 27/29: net-snmp-libs. >2014-04-09 11:40:48,730 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum updated: 28/29: augeas-libs >2014-04-09 11:40:48,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum updated: 28/29: augeas-libs. >2014-04-09 11:40:49,107 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum updated: 29/29: kpartx >2014-04-09 11:40:49,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum updated: 29/29: kpartx. >2014-04-09 11:40:50,395 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 1/29: kpartx.x86_64 0:0.4.9-72.el6_5.1 - u >2014-04-09 11:40:50,427 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 1/29: kpartx.x86_64 0:0.4.9-72.el6_5.1 - u. >2014-04-09 11:40:50,462 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 2/29: vdsm-cli.noarch 0:4.10.2-1.13.el6ev - u >2014-04-09 11:40:50,477 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 2/29: vdsm-cli.noarch 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:40:50,523 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 3/29: net-snmp.x86_64 1:5.5-49.el6_5.1 - u >2014-04-09 11:40:50,535 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 3/29: net-snmp.x86_64 1:5.5-49.el6_5.1 - u. >2014-04-09 11:40:50,589 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 4/29: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u >2014-04-09 11:40:50,602 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 4/29: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u. >2014-04-09 11:40:50,650 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 5/29: tree.x86_64 0:1.5.3-2.el6 - u >2014-04-09 11:40:50,660 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 5/29: tree.x86_64 0:1.5.3-2.el6 - u. >2014-04-09 11:40:50,692 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 6/29: sanlock-python.x86_64 0:2.8-1.el6 - u >2014-04-09 11:40:50,702 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 6/29: sanlock-python.x86_64 0:2.8-1.el6 - u. >2014-04-09 11:40:50,747 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 7/29: tuned.noarch 0:0.2.19-13.el6 - u >2014-04-09 11:40:50,760 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 7/29: tuned.noarch 0:0.2.19-13.el6 - u. >2014-04-09 11:40:50,808 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 8/29: sg3_utils.x86_64 0:1.28-5.el6 - u >2014-04-09 11:40:50,819 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 8/29: sg3_utils.x86_64 0:1.28-5.el6 - u. >2014-04-09 11:40:50,862 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 9/29: sanlock.x86_64 0:2.8-1.el6 - u >2014-04-09 11:40:50,877 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 9/29: sanlock.x86_64 0:2.8-1.el6 - u. >2014-04-09 11:40:50,923 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 10/29: net-snmp-libs.x86_64 1:5.5-49.el6_5.1 - u >2014-04-09 11:40:50,939 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 10/29: net-snmp-libs.x86_64 1:5.5-49.el6_5.1 - u. >2014-04-09 11:40:50,969 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 11/29: fence-agents.x86_64 0:3.1.5-35.el6_5.4 - u >2014-04-09 11:40:50,981 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 11/29: fence-agents.x86_64 0:3.1.5-35.el6_5.4 - u. >2014-04-09 11:40:51,032 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 12/29: vdsm-python.x86_64 0:4.10.2-1.13.el6ev - u >2014-04-09 11:40:51,047 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 12/29: vdsm-python.x86_64 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:40:51,099 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 13/29: device-mapper-multipath.x86_64 0:0.4.9-72.el6_5.1 - u >2014-04-09 11:40:51,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 13/29: device-mapper-multipath.x86_64 0:0.4.9-72.el6_5.1 - u. >2014-04-09 11:40:51,166 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 14/29: vdsm.x86_64 0:4.10.2-1.13.el6ev - u >2014-04-09 11:40:51,181 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 14/29: vdsm.x86_64 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:40:51,209 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 15/29: vdsm-xmlrpc.noarch 0:4.10.2-1.13.el6ev - u >2014-04-09 11:40:51,231 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 15/29: vdsm-xmlrpc.noarch 0:4.10.2-1.13.el6ev - u. >2014-04-09 11:40:51,250 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 16/29: ipmitool.x86_64 0:1.8.11-16.el6 - u >2014-04-09 11:40:51,264 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 16/29: ipmitool.x86_64 0:1.8.11-16.el6 - u. >2014-04-09 11:40:51,299 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 17/29: perl-Net-Telnet.noarch 0:3.03-11.el6 - u >2014-04-09 11:40:51,314 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 17/29: perl-Net-Telnet.noarch 0:3.03-11.el6 - u. >2014-04-09 11:40:51,354 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 18/29: augeas-libs.x86_64 0:1.0.0-5.el6_5.1 - u >2014-04-09 11:40:51,372 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 18/29: augeas-libs.x86_64 0:1.0.0-5.el6_5.1 - u. >2014-04-09 11:40:51,414 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 19/29: pyparted.x86_64 0:3.4-4.el6 - u >2014-04-09 11:40:51,422 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 19/29: pyparted.x86_64 0:3.4-4.el6 - u. >2014-04-09 11:40:51,466 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 20/29: net-snmp-utils.x86_64 1:5.5-49.el6_5.1 - u >2014-04-09 11:40:51,481 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 20/29: net-snmp-utils.x86_64 1:5.5-49.el6_5.1 - u. >2014-04-09 11:40:51,518 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 21/29: device-mapper-multipath-libs.x86_64 0:0.4.9-72.el6_5.1 - u >2014-04-09 11:40:51,531 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 21/29: device-mapper-multipath-libs.x86_64 0:0.4.9-72.el6_5.1 - u. >2014-04-09 11:40:51,557 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 22/29: libvirt-lock-sanlock.x86_64 0:0.10.2-29.el6_5.7 - u >2014-04-09 11:40:51,572 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 22/29: libvirt-lock-sanlock.x86_64 0:0.10.2-29.el6_5.7 - u. >2014-04-09 11:40:51,609 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 23/29: sanlock-lib.x86_64 0:2.8-1.el6 - u >2014-04-09 11:40:51,622 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 23/29: sanlock-lib.x86_64 0:2.8-1.el6 - u. >2014-04-09 11:40:51,657 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 24/29: augeas.x86_64 0:1.0.0-5.el6_5.1 - u >2014-04-09 11:40:51,672 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 24/29: augeas.x86_64 0:1.0.0-5.el6_5.1 - u. >2014-04-09 11:40:51,702 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 25/29: python-decorator.noarch 0:3.0.1-3.1.el6 - u >2014-04-09 11:40:51,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 25/29: python-decorator.noarch 0:3.0.1-3.1.el6 - u. >2014-04-09 11:40:51,749 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 26/29: net-snmp-libs.x86_64 1:5.5-49.el6 - ud >2014-04-09 11:40:51,764 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 26/29: net-snmp-libs.x86_64 1:5.5-49.el6 - ud. >2014-04-09 11:40:51,764 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 27/29: net-snmp.x86_64 1:5.5-49.el6 - ud >2014-04-09 11:40:51,772 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 27/29: net-snmp.x86_64 1:5.5-49.el6 - ud. >2014-04-09 11:40:51,772 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 28/29: kpartx.x86_64 0:0.4.9-72.el6 - ud >2014-04-09 11:40:51,781 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 28/29: kpartx.x86_64 0:0.4.9-72.el6 - ud. >2014-04-09 11:40:51,781 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Yum Verify: 29/29: augeas-libs.x86_64 0:1.0.0-5.el6 - ud >2014-04-09 11:40:51,789 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Yum Verify: 29/29: augeas-libs.x86_64 0:1.0.0-5.el6 - ud. >2014-04-09 11:40:52,001 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Misc configuration >2014-04-09 11:40:52,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Misc configuration. >2014-04-09 11:40:52,104 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Setting time >2014-04-09 11:40:52,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Setting time. >2014-04-09 11:40:55,801 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Enrolling certificate >2014-04-09 11:40:55,830 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Enrolling certificate. >2014-04-09 11:40:57,056 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Transaction commit >2014-04-09 11:40:57,072 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Transaction commit. >2014-04-09 11:40:57,130 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Closing up >2014-04-09 11:40:57,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Closing up. >2014-04-09 11:41:02,784 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stopping libvirtd >2014-04-09 11:41:02,842 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stopping libvirtd. >2014-04-09 11:41:03,014 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Starting vdsm >2014-04-09 11:41:03,029 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Starting vdsm. >2014-04-09 11:41:15,076 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Pre-termination >2014-04-09 11:41:15,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Pre-termination. >2014-04-09 11:41:15,108 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409114115-10.66.106.32-40477571.log' >2014-04-09 11:41:15,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409114115-10.66.106.32-40477571.log'. >2014-04-09 11:41:15,698 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.32: Stage: Termination >2014-04-09 11:41:15,711 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 40477571, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.32. Stage: Termination. >2014-04-09 11:41:15,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-15) [40477571] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 11:41:15,837 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-15) [40477571] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 11:41:17,341 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-15) [40477571] Engine managed to communicate with VDSM agent on host 10.66.106.32 >2014-04-09 11:41:17,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-15) [40477571] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:41:17,632 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-15) [62dad98e] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:41:17,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-15) [62dad98e] START, SetupNetworksVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=f02ffe87-f07a-4273-931a-dd6948d27c97, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=f721168f-5edd-4f5f-8976-591eb93f960e, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth1 {id=8848a1f3-d6c9-4e78-9146-4286658e0dfa, vdsId=539a81aa-3a8e-4454-b673-e6092c868b2c, macAddress=5c:f3:fc:dc:10:be, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}, > eth0 {id=88066cdf-19fb-470c-94d4-bde89fa75b43, vdsId=539a81aa-3a8e-4454-b673-e6092c868b2c, macAddress=5c:f3:fc:dc:10:bc, networkName=rhevm, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.66.106.32, subnet=255.255.248.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 482e374 >2014-04-09 11:41:17,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-15) [62dad98e] FINISH, SetupNetworksVDSCommand, log id: 482e374 >2014-04-09 11:41:18,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-15) [62dad98e] Failed in SetupNetworksVDS method >2014-04-09 11:41:18,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-15) [62dad98e] Error code unexpected and error message VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception >2014-04-09 11:41:18,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-15) [62dad98e] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception >2014-04-09 11:41:18,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-15) [62dad98e] Command SetupNetworksVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception >2014-04-09 11:41:18,179 ERROR [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-15) [62dad98e] Command org.ovirt.engine.core.bll.network.host.SetupNetworksCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception (Failed with error unexpected and code 16) >2014-04-09 11:41:18,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-15) [62dad98e] Failed to configure management network: Failed to configure management network on host 10.66.106.32 due to setup networks failure. >2014-04-09 11:41:18,194 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-15) [62dad98e] Host installation failed for host 539a81aa-3a8e-4454-b673-e6092c868b2c, 10.66.106.32.: org.ovirt.engine.core.bll.InstallVdsCommand$VdsInstallException: Failed to configure management network on the host > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:306) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:205) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] >Caused by: org.ovirt.engine.core.bll.network.NetworkConfigurator$NetworkConfiguratorException: Failed to configure management network > at org.ovirt.engine.core.bll.network.NetworkConfigurator.configureManagementNetwork(NetworkConfigurator.java:241) [bll.jar:] > at org.ovirt.engine.core.bll.network.NetworkConfigurator.createManagementNetworkIfRequired(NetworkConfigurator.java:69) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:298) [bll.jar:] > ... 61 more > >2014-04-09 11:41:18,200 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-15) [62dad98e] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=NONE), log id: 12729201 >2014-04-09 11:41:18,210 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-15) [62dad98e] FINISH, SetVdsStatusVDSCommand, log id: 12729201 >2014-04-09 11:41:18,235 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-15) [62dad98e] Correlation ID: 40477571, Job ID: be4e6382-ead2-4cb8-852e-185fbd8dd6ff, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 installation failed. Failed to configure management network on the host. >2014-04-09 11:41:18,244 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-15) [62dad98e] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:44:45,250 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-13) [4f9fb57d] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:44:45,314 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-25) [4f9fb57d] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:44:45,316 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-25) [4f9fb57d] Before acquiring lock in order to prevent monitoring for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:44:45,317 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-25) [4f9fb57d] Lock acquired, from now a monitoring of host will be skipped for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:44:45,337 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-25) [4f9fb57d] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=Unassigned, nonOperationalReason=NONE), log id: 74b1896e >2014-04-09 11:44:45,348 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-25) [4f9fb57d] FINISH, SetVdsStatusVDSCommand, log id: 74b1896e >2014-04-09 11:44:45,352 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-4-thread-25) [4f9fb57d] START, ActivateVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 1d42467d >2014-04-09 11:44:45,498 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-25) [4f9fb57d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:44:45,590 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (pool-4-thread-25) [390aad8c] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:44:45,594 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-25) [390aad8c] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 2f179c4a >2014-04-09 11:44:45,607 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-25) [390aad8c] FINISH, SetVdsStatusVDSCommand, log id: 2f179c4a >2014-04-09 11:44:45,670 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (pool-4-thread-25) [390aad8c] Host 10.66.106.32 is set to Non-Operational, it is missing the following networks: rhevm >2014-04-09 11:44:46,040 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-25) [390aad8c] Correlation ID: 390aad8c, Job ID: 0991f352-484d-44a0-ab04-ca9840e1ed6a, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 does not comply with the cluster NFS_shyu networks, the following networks are missing on host: 'rhevm' >2014-04-09 11:44:46,102 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-4-thread-25) [71908752] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:44:46,108 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-4-thread-25) [7e82be3b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:44:46,149 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (pool-4-thread-25) [132a5d25] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:44:46,158 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-25) [132a5d25] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=CLUSTER_VERSION_INCOMPATIBLE_WITH_CLUSTER), log id: 477888d5 >2014-04-09 11:44:46,165 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-25) [132a5d25] FINISH, SetVdsStatusVDSCommand, log id: 477888d5 >2014-04-09 11:44:46,198 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-25) [132a5d25] Correlation ID: 132a5d25, Job ID: d110998f-5417-46c1-bc6d-ebc029fc867a, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 is compatible with versions (3.0,3.1) and cannot join Cluster NFS_shyu which is set to version 3.3. >2014-04-09 11:44:46,207 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-4-thread-25) [132a5d25] FINISH, ActivateVdsVDSCommand, return: Host[10.66.106.32], log id: 1d42467d >2014-04-09 11:44:46,240 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-25) [132a5d25] Activate finished. Lock released. Monitoring can run now for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:44:46,248 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-25) [132a5d25] Correlation ID: 4f9fb57d, Job ID: fe692576-e6aa-4992-8d65-775e4a9439cd, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was activated by admin@internal. >2014-04-09 11:44:46,257 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-25) [132a5d25] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:45:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) Autorecovering 2 hosts >2014-04-09 11:45:00,052 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) Autorecovering hosts id: 79c710f2-5c70-4ab6-a4ea-f87974c644b2, name : 10.66.106.40 >2014-04-09 11:45:00,054 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] Lock Acquired to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS >, sharedLocks= ] >2014-04-09 11:45:00,054 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:45:00,055 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] Before acquiring lock in order to prevent monitoring for host 10.66.106.40 from data-center NFS_shyu >2014-04-09 11:45:00,055 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] Lock acquired, from now a monitoring of host will be skipped for host 10.66.106.40 from data-center NFS_shyu >2014-04-09 11:45:00,059 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2, status=Unassigned, nonOperationalReason=NONE), log id: 5c3d91a0 >2014-04-09 11:45:00,080 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] FINISH, SetVdsStatusVDSCommand, log id: 5c3d91a0 >2014-04-09 11:45:00,084 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] START, ActivateVdsVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2), log id: 7fc2056 >2014-04-09 11:45:02,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [7201b705] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:02,192 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-79) [2b416354] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:45:02,197 WARN [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-79) [1f550678] CanDoAction of action HandleVdsVersion failed. Reasons:VDS_CANNOT_CHECK_VERSION_HOST_NON_RESPONSIVE >2014-04-09 11:45:02,199 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-79) [1f550678] Failed to activate VDS = 79c710f2-5c70-4ab6-a4ea-f87974c644b2 with error: java.net.SocketTimeoutException: connect timed out. >2014-04-09 11:45:02,199 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-79) [1f550678] FINISH, ActivateVdsVDSCommand, return: Host[10.66.106.40], log id: 7fc2056 >2014-04-09 11:45:02,238 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [1f550678] Activate finished. Lock released. Monitoring can run now for host 10.66.106.40 from data-center NFS_shyu >2014-04-09 11:45:02,246 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [1f550678] Correlation ID: 7201b705, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was autorecovered. >2014-04-09 11:45:02,247 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [1f550678] Lock freed to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS >, sharedLocks= ] >2014-04-09 11:45:02,247 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [1f550678] Autorecovering hosts id: 539a81aa-3a8e-4454-b673-e6092c868b2c, name : 10.66.106.32 >2014-04-09 11:45:02,251 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:45:02,251 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:45:02,251 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] Before acquiring lock in order to prevent monitoring for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:45:02,252 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] Lock acquired, from now a monitoring of host will be skipped for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:45:02,261 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=Unassigned, nonOperationalReason=NONE), log id: 51eab22a >2014-04-09 11:45:02,271 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] FINISH, SetVdsStatusVDSCommand, log id: 51eab22a >2014-04-09 11:45:02,275 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-79) [1605d340] START, ActivateVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 43d967ba >2014-04-09 11:45:02,429 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [1605d340] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:45:02,496 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-79) [2a4c9144] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:45:02,502 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [2a4c9144] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 1f56da17 >2014-04-09 11:45:02,513 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [2a4c9144] FINISH, SetVdsStatusVDSCommand, log id: 1f56da17 >2014-04-09 11:45:02,558 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-79) [2a4c9144] Host 10.66.106.32 is set to Non-Operational, it is missing the following networks: rhevm >2014-04-09 11:45:02,571 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [2a4c9144] Correlation ID: 2a4c9144, Job ID: 7cac417e-9536-4a9a-a623-0371e297d3a9, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 does not comply with the cluster NFS_shyu networks, the following networks are missing on host: 'rhevm' >2014-04-09 11:45:02,600 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-79) [66fbf65d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:45:02,605 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-79) [25df9cf8] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:45:02,647 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:45:02,650 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=CLUSTER_VERSION_INCOMPATIBLE_WITH_CLUSTER), log id: 38017106 >2014-04-09 11:45:02,663 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] FINISH, SetVdsStatusVDSCommand, log id: 38017106 >2014-04-09 11:45:02,721 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [6079cede] Correlation ID: 6079cede, Job ID: 8ec97787-f629-41d4-bca2-c70562aabd1e, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 is compatible with versions (3.0,3.1) and cannot join Cluster NFS_shyu which is set to version 3.3. >2014-04-09 11:45:02,730 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] FINISH, ActivateVdsVDSCommand, return: Host[10.66.106.32], log id: 43d967ba >2014-04-09 11:45:02,805 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] Activate finished. Lock released. Monitoring can run now for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:45:02,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [6079cede] Correlation ID: 1605d340, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was autorecovered. >2014-04-09 11:45:02,814 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:45:05,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:05,332 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-86) Failed to refresh VDS , vds = 79c710f2-5c70-4ab6-a4ea-f87974c644b2 : 10.66.106.40, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:10,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:10,354 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-46) Server failed to respond, vds_id = 79c710f2-5c70-4ab6-a4ea-f87974c644b2, vds_name = 10.66.106.40, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:10,379 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-46) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.SocketTimeoutException: connect timed out > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.SocketTimeoutException: connect timed out > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy114.getVdsCapabilities(Unknown Source) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Host 10.66.106.40 is non responsive. >2014-04-09 11:45:10,383 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-4-thread-35) ResourceManager::vdsNotResponding entered for Host 79c710f2-5c70-4ab6-a4ea-f87974c644b2, 10.66.106.40 >2014-04-09 11:45:10,445 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-4-thread-35) [498adb84] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:45:15,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:20,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:25,863 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:30,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:36,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:41,142 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:46,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:51,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:45:56,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:01,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:06,564 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:11,198 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-4-thread-35) [498adb84] SSH connection to host 10.66.106.40 failed: org.apache.sshd.common.RuntimeSshException: Failed to get the session.: org.apache.sshd.common.RuntimeSshException: Failed to get the session. > at org.apache.sshd.client.future.DefaultConnectFuture.getSession(DefaultConnectFuture.java:43) > at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:288) [utils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:73) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$1.run(VdsEventListener.java:141) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] >Caused by: java.net.ConnectException: Connection timed out. > at org.apache.mina.core.polling.AbstractPollingIoConnector.processTimedOutSessions(AbstractPollingIoConnector.java:467) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.access$800(AbstractPollingIoConnector.java:64) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:511) [mina-core.jar:] > at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:] > ... 3 more > >2014-04-09 11:46:11,274 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-4-thread-35) [66731126] Lock Acquired to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS_FENCE >, sharedLocks= ] >2014-04-09 11:46:11,329 ERROR [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-4-thread-35) [66731126] Failed to run Fence script on vds:10.66.106.40, VMs moved to UnKnown instead. >2014-04-09 11:46:11,345 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [66731126] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 became non responsive. It has no power management configured. Please check the host status, manually reboot it, and click "Confirm Host Has Been Rebooted" >2014-04-09 11:46:11,345 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-4-thread-35) [66731126] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VAR__ACTION__RESTART,VDS_FENCE_DISABLED >2014-04-09 11:46:11,345 INFO [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-4-thread-35) [66731126] Lock freed to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS_FENCE >, sharedLocks= ] >2014-04-09 11:46:11,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:16,873 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:21,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:27,045 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:32,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:37,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:42,341 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:47,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:52,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:46:57,539 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:02,621 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:07,679 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:12,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:17,843 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:22,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:28,058 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:33,092 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:38,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:43,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [6079cede] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:48,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:53,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:47:58,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:04,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:09,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:14,376 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:19,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:24,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:29,599 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:34,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:39,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:44,904 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:49,997 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:48:55,098 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:00,195 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:05,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:10,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:15,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:20,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:25,612 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:30,702 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:35,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:41,207 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:46,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:51,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:49:56,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) Autorecovering 1 hosts >2014-04-09 11:50:00,041 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) Autorecovering hosts id: 539a81aa-3a8e-4454-b673-e6092c868b2c, name : 10.66.106.32 >2014-04-09 11:50:00,044 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:50:00,044 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:50:00,044 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] Before acquiring lock in order to prevent monitoring for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:50:00,044 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] Lock acquired, from now a monitoring of host will be skipped for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:50:00,052 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=Unassigned, nonOperationalReason=NONE), log id: 4ca03510 >2014-04-09 11:50:00,073 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] FINISH, SetVdsStatusVDSCommand, log id: 4ca03510 >2014-04-09 11:50:00,077 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] START, ActivateVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 42e356fc >2014-04-09 11:50:00,723 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [1fe8c48b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:50:00,799 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [46f24bdd] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:50:00,801 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [46f24bdd] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 47fd9f41 >2014-04-09 11:50:00,823 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [46f24bdd] FINISH, SetVdsStatusVDSCommand, log id: 47fd9f41 >2014-04-09 11:50:00,826 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [46f24bdd] Host 10.66.106.32 is set to Non-Operational, it is missing the following networks: rhevm >2014-04-09 11:50:00,840 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [46f24bdd] Correlation ID: 46f24bdd, Job ID: 26b90796-3aa0-4e9b-86a9-766a1c5d8018, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 does not comply with the cluster NFS_shyu networks, the following networks are missing on host: 'rhevm' >2014-04-09 11:50:00,861 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-28) [39494996] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:50:00,864 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-28) [72cd5707] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:50:00,907 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:50:00,911 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [2610ec1f] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=CLUSTER_VERSION_INCOMPATIBLE_WITH_CLUSTER), log id: 6436841b >2014-04-09 11:50:00,925 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [2610ec1f] FINISH, SetVdsStatusVDSCommand, log id: 6436841b >2014-04-09 11:50:00,942 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Correlation ID: 2610ec1f, Job ID: 07d1bde7-f257-468d-a39f-eda1fc1de721, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 is compatible with versions (3.0,3.1) and cannot join Cluster NFS_shyu which is set to version 3.3. >2014-04-09 11:50:00,959 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-28) [2610ec1f] FINISH, ActivateVdsVDSCommand, return: Host[10.66.106.32], log id: 42e356fc >2014-04-09 11:50:01,000 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Activate finished. Lock released. Monitoring can run now for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:50:01,003 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:50:01,507 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:06,633 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:11,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:16,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:21,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:27,064 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:32,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:37,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:42,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:47,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:52,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:50:57,576 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:02,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:07,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:12,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:18,740 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:23,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:28,896 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:33,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:39,053 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:44,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:49,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:54,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:51:59,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:04,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:09,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:14,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:19,696 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:24,780 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:29,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:34,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:39,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:45,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:50,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:52:55,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:00,507 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:05,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:10,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:15,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:20,920 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:26,020 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:31,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:36,236 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:41,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:46,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:50,372 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-7) [7253571f] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:53:50,426 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-49) [7253571f] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:53:50,426 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-49) [7253571f] Before acquiring lock in order to prevent monitoring for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:53:50,426 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-49) [7253571f] Lock acquired, from now a monitoring of host will be skipped for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:53:50,439 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [7253571f] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=Unassigned, nonOperationalReason=NONE), log id: 2c7cd4a1 >2014-04-09 11:53:50,452 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [7253571f] FINISH, SetVdsStatusVDSCommand, log id: 2c7cd4a1 >2014-04-09 11:53:50,455 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-4-thread-49) [7253571f] START, ActivateVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 30437b7b >2014-04-09 11:53:50,734 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [7253571f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:53:50,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (pool-4-thread-49) [7253571f] START, GetHardwareInfoVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32]), log id: 12b423c6 >2014-04-09 11:53:50,928 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (pool-4-thread-49) [7253571f] FINISH, GetHardwareInfoVDSCommand, log id: 12b423c6 >2014-04-09 11:53:50,963 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-4-thread-49) [23db64] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:53:50,966 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-4-thread-49) [79ef2088] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:53:50,968 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-4-thread-49) [79ef2088] FINISH, ActivateVdsVDSCommand, return: Host[10.66.106.32], log id: 30437b7b >2014-04-09 11:53:51,001 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-49) [79ef2088] Activate finished. Lock released. Monitoring can run now for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 11:53:51,010 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [79ef2088] Correlation ID: 7253571f, Job ID: 8b29a580-29e8-4187-b39b-3d054fddbc34, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was activated by admin@internal. >2014-04-09 11:53:51,027 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-4-thread-49) [79ef2088] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 11:53:51,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:52,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:53:52,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32]), log id: 514e2b0d >2014-04-09 11:53:52,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GetHardwareInfoVDSCommand, log id: 514e2b0d >2014-04-09 11:53:52,184 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 11:53:52,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32]), log id: 314cd949 >2014-04-09 11:53:52,200 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GetHardwareInfoVDSCommand, log id: 314cd949 >2014-04-09 11:53:52,234 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.32. >2014-04-09 11:53:52,266 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-4) [51d08f87] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 11:53:52,282 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-4) [51d08f87] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 7ce972df >2014-04-09 11:53:52,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-4) [51d08f87] FINISH, SetMOMPolicyParametersVDSCommand, log id: 7ce972df >2014-04-09 11:53:52,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [51d08f87] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.32. >2014-04-09 11:53:52,429 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-4) [27a2c271] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:53:52,455 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-4) [3ea46189] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 11:53:56,704 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 11:53:57,735 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-50) [6252bdf2] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:53:57,784 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-50) [6252bdf2] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:53:57,790 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [6252bdf2] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2, status=Maintenance, nonOperationalReason=NONE), log id: 7b232c15 >2014-04-09 11:53:57,800 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [6252bdf2] FINISH, SetVdsStatusVDSCommand, log id: 7b232c15 >2014-04-09 11:53:57,809 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [6252bdf2] Correlation ID: 6252bdf2, Job ID: 1ab944c8-3d32-42e5-96b6-4fb566e9b4b6, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was switched to Maintenance mode by admin@internal. >2014-04-09 11:54:01,642 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 11:54:05,796 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-3) [65b73ef7] Lock Acquired to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS >, sharedLocks= ] >2014-04-09 11:54:05,802 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-50) [65b73ef7] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 Type: VDS >2014-04-09 11:54:05,853 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-50) [65b73ef7] START, RemoveVdsVDSCommand( HostId = 79c710f2-5c70-4ab6-a4ea-f87974c644b2), log id: 44f70d0f >2014-04-09 11:54:05,853 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-50) [65b73ef7] vdsManager::disposing >2014-04-09 11:54:05,854 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-50) [65b73ef7] FINISH, RemoveVdsVDSCommand, log id: 44f70d0f >2014-04-09 11:54:05,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [65b73ef7] Correlation ID: 65b73ef7, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was removed by admin@internal. >2014-04-09 11:54:05,859 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-50) [65b73ef7] Lock freed to object EngineLock [exclusiveLocks= key: 79c710f2-5c70-4ab6-a4ea-f87974c644b2 value: VDS >, sharedLocks= ] >2014-04-09 12:08:55,965 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-15) [18b83964] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 12:08:55,994 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-15) [71364450] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 12:08:56,007 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-15) [71364450] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 12:08:56,010 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [71364450] Cannot get vdsManager for vdsid=8b916f9f-d5e6-40a1-8e4b-58ef7df47820 >2014-04-09 12:08:56,013 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [71364450] START, RemoveVdsVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: 6ec20bbf >2014-04-09 12:08:56,013 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [71364450] Cannot get vdsManager for vdsid=8b916f9f-d5e6-40a1-8e4b-58ef7df47820 >2014-04-09 12:08:56,013 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [71364450] FINISH, RemoveVdsVDSCommand, log id: 6ec20bbf >2014-04-09 12:08:56,014 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [71364450] Cannot get vdsManager for vdsid=8b916f9f-d5e6-40a1-8e4b-58ef7df47820 >2014-04-09 12:08:56,016 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [71364450] START, AddVdsVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: b3a7794 >2014-04-09 12:08:56,016 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [71364450] AddVds - entered , starting logic to add VDS 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 >2014-04-09 12:08:56,018 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [71364450] AddVds - VDS 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 was added, will try to add it to the resource manager >2014-04-09 12:08:56,018 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-15) [71364450] Entered VdsManager constructor >2014-04-09 12:08:56,042 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-15) [71364450] Initialize vdsBroker (10.66.106.40,54,321) >2014-04-09 12:08:56,043 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [71364450] VDS 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 was added to the Resource Manager >2014-04-09 12:08:56,043 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [71364450] FINISH, AddVdsVDSCommand, log id: b3a7794 >2014-04-09 12:08:56,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [71364450] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-09 12:08:56,091 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-50) [5854d8d] Lock Acquired to object EngineLock [exclusiveLocks= key: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 value: VDS >, sharedLocks= ] >2014-04-09 12:08:56,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [71364450] Correlation ID: 18b83964, Job ID: 7c9eef1c-bd88-46b3-82c6-71e17d18db68, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was added by admin@internal. >2014-04-09 12:08:56,121 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-50) [5854d8d] Running command: InstallVdsCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 12:08:56,121 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-50) [5854d8d] Before Installation host 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, 10.66.106.40 >2014-04-09 12:08:56,126 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [5854d8d] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, status=Installing, nonOperationalReason=NONE), log id: 7a435e2a >2014-04-09 12:08:56,137 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [5854d8d] FINISH, SetVdsStatusVDSCommand, log id: 7a435e2a >2014-04-09 12:08:56,215 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-50) [5854d8d] Installation 10.66.106.40: Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd >2014-04-09 12:08:56,229 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [5854d8d] Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd. >2014-04-09 12:08:56,243 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-50) [5854d8d] Installation of 10.66.106.40. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 12:08:56,257 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-50) SSH execute root@10.66.106.40 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 12:08:57,152 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Initializing >2014-04-09 12:08:57,170 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Initializing. >2014-04-09 12:08:57,184 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment setup >2014-04-09 12:08:57,205 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment setup. >2014-04-09 12:08:57,206 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment packages setup >2014-04-09 12:08:57,230 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment packages setup. >2014-04-09 12:08:58,929 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Programs detection >2014-04-09 12:08:58,955 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Programs detection. >2014-04-09 12:08:58,955 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment customization >2014-04-09 12:08:58,982 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment customization. >2014-04-09 12:08:59,001 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Logs at host located at: '/tmp/ovirt-host-deploy-20140409120914.log' >2014-04-09 12:08:59,022 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Logs at host located at: '/tmp/ovirt-host-deploy-20140409120914.log'. >2014-04-09 12:08:59,049 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-56) Initializing Host: 10.66.106.40 >2014-04-09 12:08:59,073 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.40 reports unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 >2014-04-09 12:08:59,101 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 to Host 10.66.106.40 >2014-04-09 12:08:59,187 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Setup validation >2014-04-09 12:08:59,196 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Setup validation. >2014-04-09 12:08:59,312 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Hardware supports virtualization >2014-04-09 12:08:59,322 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Hardware supports virtualization. >2014-04-09 12:09:00,458 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction setup >2014-04-09 12:09:00,480 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction setup. >2014-04-09 12:09:00,480 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-09 12:09:00,505 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-09 12:09:00,505 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Package installation >2014-04-09 12:09:00,513 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Package installation. >2014-04-09 12:09:02,228 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-09 12:09:02,275 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-09 12:09:02,275 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Setting time >2014-04-09 12:09:02,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Setting time. >2014-04-09 12:09:05,473 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Enrolling certificate >2014-04-09 12:09:05,497 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Enrolling certificate. >2014-04-09 12:09:06,705 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction commit >2014-04-09 12:09:06,772 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction commit. >2014-04-09 12:09:06,772 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Closing up >2014-04-09 12:09:06,788 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Closing up. >2014-04-09 12:09:08,372 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stopping libvirtd >2014-04-09 12:09:08,405 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stopping libvirtd. >2014-04-09 12:09:08,460 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Starting vdsm >2014-04-09 12:09:08,472 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Starting vdsm. >2014-04-09 12:09:10,677 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Pre-termination >2014-04-09 12:09:10,696 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Pre-termination. >2014-04-09 12:09:10,706 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409120910-10.66.106.40-5854d8d.log' >2014-04-09 12:09:10,721 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409120910-10.66.106.40-5854d8d.log'. >2014-04-09 12:09:11,113 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Termination >2014-04-09 12:09:11,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5854d8d, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Termination. >2014-04-09 12:09:11,220 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-50) [5854d8d] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:09:11,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-50) [5854d8d] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:09:11,723 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-50) [5854d8d] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:09:11,724 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-50) [5854d8d] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:09:12,226 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-50) [5854d8d] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:09:12,227 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-50) [5854d8d] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:09:13,168 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-50) [5854d8d] Engine managed to communicate with VDSM agent on host 10.66.106.40 >2014-04-09 12:09:13,366 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [5854d8d] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, status=Initializing, nonOperationalReason=NONE), log id: 1552beb7 >2014-04-09 12:09:13,379 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [5854d8d] FINISH, SetVdsStatusVDSCommand, log id: 1552beb7 >2014-04-09 12:09:13,379 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-50) [5854d8d] After Installation host 10.66.106.40, VDS >2014-04-09 12:09:13,388 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [5854d8d] Correlation ID: 5854d8d, Job ID: 7c9eef1c-bd88-46b3-82c6-71e17d18db68, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 installed >2014-04-09 12:09:13,413 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-50) [5854d8d] Lock freed to object EngineLock [exclusiveLocks= key: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 value: VDS >, sharedLocks= ] >2014-04-09 12:09:14,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vds=Host[10.66.106.40]), log id: c30fe29 >2014-04-09 12:09:14,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GetHardwareInfoVDSCommand, log id: c30fe29 >2014-04-09 12:09:14,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vds=Host[10.66.106.40]), log id: 307b7d23 >2014-04-09 12:09:14,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GetHardwareInfoVDSCommand, log id: 307b7d23 >2014-04-09 12:09:14,587 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-47) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.40. >2014-04-09 12:09:14,599 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-47) [53b70ae6] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 12:09:14,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-47) [53b70ae6] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: 31d74ba3 >2014-04-09 12:09:14,679 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-47) [53b70ae6] FINISH, SetMOMPolicyParametersVDSCommand, log id: 31d74ba3 >2014-04-09 12:09:14,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-47) [53b70ae6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-09 12:09:14,702 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-47) [6d07926c] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 12:09:14,708 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 12:09:30,185 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 12:24:03,441 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 12:37:09,886 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-04-09 12:37:09,887 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Start refreshing all users data >2014-04-09 12:39:42,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 12:45:56,629 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginAdminUserCommand internal: false. >2014-04-09 12:45:56,659 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 12:45:56,739 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginUserCommand internal: false. >2014-04-09 12:45:56,760 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 12:51:24,539 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [3444abf2] Running command: LogoutUserCommand internal: false. >2014-04-09 12:51:24,573 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [3444abf2] Correlation ID: 3444abf2, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-09 12:52:01,083 INFO [org.ovirt.engine.core.bll.storage.AddEmptyStoragePoolCommand] (ajp-/127.0.0.1:8702-12) [5f5fd61f] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 12:52:01,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [5f5fd61f] Correlation ID: 5f5fd61f, Call Stack: null, Custom Event ID: -1, Message: Data Center dc_iscsi with Type ISCSI, Compatibility Version 3.3 and Quota Type DISABLED was added by admin@internal >2014-04-09 12:52:16,009 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-13) [71a27335] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 12:52:16,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [71a27335] Correlation ID: 71a27335, Call Stack: null, Custom Event ID: -1, Message: Host cluster dc_iscsi was added by admin@internal >2014-04-09 12:52:46,316 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [30f551c2] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.5.243' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_51] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 12:52:46,365 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [30f551c2] Running command: AddVdsCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 12:52:46,385 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [24dff771] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 12:52:46,399 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [24dff771] Lock freed to object EngineLock [exclusiveLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 12:52:46,399 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [24dff771] Cannot get vdsManager for vdsid=188df0b2-d0dd-4eca-b792-c015d110d12f >2014-04-09 12:52:46,402 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [24dff771] START, RemoveVdsVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f), log id: 244c417b >2014-04-09 12:52:46,402 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [24dff771] Cannot get vdsManager for vdsid=188df0b2-d0dd-4eca-b792-c015d110d12f >2014-04-09 12:52:46,403 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [24dff771] FINISH, RemoveVdsVDSCommand, log id: 244c417b >2014-04-09 12:52:46,403 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [24dff771] Cannot get vdsManager for vdsid=188df0b2-d0dd-4eca-b792-c015d110d12f >2014-04-09 12:52:46,409 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [24dff771] START, AddVdsVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f), log id: 42316721 >2014-04-09 12:52:46,409 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [24dff771] AddVds - entered , starting logic to add VDS 188df0b2-d0dd-4eca-b792-c015d110d12f >2014-04-09 12:52:46,411 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [24dff771] AddVds - VDS 188df0b2-d0dd-4eca-b792-c015d110d12f was added, will try to add it to the resource manager >2014-04-09 12:52:46,411 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [24dff771] Entered VdsManager constructor >2014-04-09 12:52:46,427 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [24dff771] Initialize vdsBroker (10.66.5.243,54,321) >2014-04-09 12:52:46,429 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [24dff771] VDS 188df0b2-d0dd-4eca-b792-c015d110d12f was added to the Resource Manager >2014-04-09 12:52:46,429 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [24dff771] FINISH, AddVdsVDSCommand, log id: 42316721 >2014-04-09 12:52:46,437 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [24dff771] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host DC-5.243. >2014-04-09 12:52:46,466 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [24dff771] Correlation ID: 30f551c2, Job ID: 41299407-aa64-4c2d-a7de-0db2f6dff2a2, Call Stack: null, Custom Event ID: -1, Message: Host DC-5.243 was added by admin@internal. >2014-04-09 12:52:46,474 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [21f569a5] Lock Acquired to object EngineLock [exclusiveLocks= key: 188df0b2-d0dd-4eca-b792-c015d110d12f value: VDS >, sharedLocks= ] >2014-04-09 12:52:46,490 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [21f569a5] Running command: InstallVdsCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 12:52:46,491 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [21f569a5] Before Installation host 188df0b2-d0dd-4eca-b792-c015d110d12f, DC-5.243 >2014-04-09 12:52:46,494 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [21f569a5] START, SetVdsStatusVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, status=Installing, nonOperationalReason=NONE), log id: 71a8c575 >2014-04-09 12:52:46,499 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [21f569a5] FINISH, SetVdsStatusVDSCommand, log id: 71a8c575 >2014-04-09 12:52:46,587 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-48) [21f569a5] Installation 10.66.5.243: Connected to host 10.66.5.243 with SSH key fingerprint: 10:92:66:c2:a0:31:07:64:25:46:03:1c:34:2b:f6:f8 >2014-04-09 12:52:46,599 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [21f569a5] Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Connected to host 10.66.5.243 with SSH key fingerprint: 10:92:66:c2:a0:31:07:64:25:46:03:1c:34:2b:f6:f8. >2014-04-09 12:52:46,615 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-48) [21f569a5] Installation of 10.66.5.243. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 12:52:46,629 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-48) SSH execute root@10.66.5.243 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 12:52:47,359 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Initializing >2014-04-09 12:52:47,374 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Initializing. >2014-04-09 12:52:47,386 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Environment setup >2014-04-09 12:52:47,418 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Environment setup. >2014-04-09 12:52:47,418 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Environment packages setup >2014-04-09 12:52:47,440 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Environment packages setup. >2014-04-09 12:52:48,041 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginAdminUserCommand internal: false. >2014-04-09 12:52:48,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 12:52:48,211 INFO [org.ovirt.engine.api.restapi.security.auth.LoginValidator] (ajp-/127.0.0.1:8702-2) Validating session failed, reason: Session does not exist. >2014-04-09 12:52:49,434 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-81) Initializing Host: DC-5.243 >2014-04-09 12:52:49,509 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Downloading Packages >2014-04-09 12:52:49,532 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Downloading Packages. >2014-04-09 12:52:50,883 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 12:52:50,898 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 12:52:50,899 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Check Package Signatures >2014-04-09 12:52:50,915 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Check Package Signatures. >2014-04-09 12:52:50,915 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Running Test Transaction >2014-04-09 12:52:50,932 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Running Test Transaction. >2014-04-09 12:52:50,986 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Running Transaction >2014-04-09 12:52:50,998 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Running Transaction. >2014-04-09 12:52:51,336 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 12:52:51,348 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 12:52:51,853 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum updated: 2/2: dmidecode >2014-04-09 12:52:51,865 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum updated: 2/2: dmidecode. >2014-04-09 12:52:52,729 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-09 12:52:52,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-09 12:52:52,851 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-09 12:52:52,873 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-09 12:52:53,106 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Programs detection >2014-04-09 12:52:53,148 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Programs detection. >2014-04-09 12:52:53,148 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Environment customization >2014-04-09 12:52:53,165 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Environment customization. >2014-04-09 12:52:53,176 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Logs at host located at: '/tmp/ovirt-host-deploy-20140409125305.log' >2014-04-09 12:52:53,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Logs at host located at: '/tmp/ovirt-host-deploy-20140409125305.log'. >2014-04-09 12:52:53,233 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.5.243 reports unique id B2395AEE-86EF-323A-ED97-3A5E0C2B3A8A >2014-04-09 12:52:53,262 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id B2395AEE-86EF-323A-ED97-3A5E0C2B3A8A to Host 10.66.5.243 >2014-04-09 12:52:53,356 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Setup validation >2014-04-09 12:52:53,365 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Setup validation. >2014-04-09 12:52:53,376 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Cannot validate host name settings, reason: resolved host does not match any of the local addresses >2014-04-09 12:52:53,390 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Host DC-5.243 installation in progress . Cannot validate host name settings, reason: resolved host does not match any of the local addresses. >2014-04-09 12:52:53,403 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Hardware supports virtualization >2014-04-09 12:52:53,415 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Hardware supports virtualization. >2014-04-09 12:52:53,418 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Transaction setup >2014-04-09 12:52:53,431 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Transaction setup. >2014-04-09 12:52:53,470 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Misc configuration >2014-04-09 12:52:53,481 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Misc configuration. >2014-04-09 12:52:53,482 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Package installation >2014-04-09 12:52:53,490 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Package installation. >2014-04-09 12:52:54,258 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Downloading Packages >2014-04-09 12:52:54,273 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Downloading Packages. >2014-04-09 12:52:56,811 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 12:52:56,831 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 12:52:56,857 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Download/Verify: tuned-0.2.19-13.el6.noarch >2014-04-09 12:52:56,873 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Download/Verify: tuned-0.2.19-13.el6.noarch. >2014-04-09 12:52:56,873 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Check Package Signatures >2014-04-09 12:52:56,881 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Check Package Signatures. >2014-04-09 12:52:56,881 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Running Test Transaction >2014-04-09 12:52:56,889 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Running Test Transaction. >2014-04-09 12:52:56,975 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Status: Running Transaction >2014-04-09 12:52:56,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Status: Running Transaction. >2014-04-09 12:52:57,342 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum install: 1/2: tuned-0.2.19-13.el6.noarch >2014-04-09 12:52:57,356 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum install: 1/2: tuned-0.2.19-13.el6.noarch. >2014-04-09 12:52:58,185 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum install: 2/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 12:52:58,231 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum install: 2/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 12:52:59,072 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u >2014-04-09 12:52:59,089 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u. >2014-04-09 12:52:59,190 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Yum Verify: 2/2: tuned.noarch 0:0.2.19-13.el6 - u >2014-04-09 12:52:59,197 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Yum Verify: 2/2: tuned.noarch 0:0.2.19-13.el6 - u. >2014-04-09 12:52:59,511 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Misc configuration >2014-04-09 12:52:59,522 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Misc configuration. >2014-04-09 12:52:59,578 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Setting time >2014-04-09 12:52:59,589 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Setting time. >2014-04-09 12:53:02,221 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Enrolling certificate >2014-04-09 12:53:02,239 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Enrolling certificate. >2014-04-09 12:53:03,558 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Transaction commit >2014-04-09 12:53:03,572 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Transaction commit. >2014-04-09 12:53:03,603 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Closing up >2014-04-09 12:53:03,614 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Closing up. >2014-04-09 12:53:04,587 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stopping libvirtd >2014-04-09 12:53:04,605 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stopping libvirtd. >2014-04-09 12:53:04,866 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Starting vdsm >2014-04-09 12:53:04,880 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Starting vdsm. >2014-04-09 12:53:06,925 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Pre-termination >2014-04-09 12:53:06,946 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Pre-termination. >2014-04-09 12:53:06,956 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409125306-10.66.5.243-21f569a5.log' >2014-04-09 12:53:06,971 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409125306-10.66.5.243-21f569a5.log'. >2014-04-09 12:53:07,174 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.5.243: Stage: Termination >2014-04-09 12:53:07,238 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 21f569a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-5.243. Stage: Termination. >2014-04-09 12:53:07,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [21f569a5] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:53:07,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [21f569a5] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 12:53:09,977 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-48) [21f569a5] Engine managed to communicate with VDSM agent on host DC-5.243 >2014-04-09 12:53:12,275 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [21f569a5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-5.243. >2014-04-09 12:53:12,346 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-48) [3f8bd5b8] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 12:53:12,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-48) [3f8bd5b8] START, SetupNetworksVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=cb715cd9-0fb4-44da-ad48-ff63a5bb91e0, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth0 {id=bf15b743-caa5-408d-98e7-a726aa203e46, vdsId=188df0b2-d0dd-4eca-b792-c015d110d12f, macAddress=44:37:e6:61:36:63, networkName=rhevm, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.66.5.243, subnet=255.255.252.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 45197e43 >2014-04-09 12:53:12,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-48) [3f8bd5b8] FINISH, SetupNetworksVDSCommand, log id: 45197e43 >2014-04-09 12:53:17,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Command PollVDS execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-04-09 12:53:17,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-04-09 12:53:20,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Command PollVDS execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-04-09 12:53:20,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-04-09 12:53:23,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Command PollVDS execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-04-09 12:53:23,607 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-04-09 12:53:26,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Command PollVDS execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-04-09 12:53:26,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-04-09 12:53:29,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Command PollVDS execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-04-09 12:53:29,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [3f8bd5b8] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-04-09 12:53:34,274 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [3f8bd5b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-5.243. >2014-04-09 12:53:34,358 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-4-thread-48) [489d55c1] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 12:53:34,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-4-thread-48) [489d55c1] START, SetSafeNetworkConfigVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f), log id: 461305c1 >2014-04-09 12:53:36,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-4-thread-48) [489d55c1] FINISH, SetSafeNetworkConfigVDSCommand, log id: 461305c1 >2014-04-09 12:53:36,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [489d55c1] Correlation ID: 489d55c1, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host DC-5.243 >2014-04-09 12:53:36,595 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [489d55c1] START, SetVdsStatusVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, status=Initializing, nonOperationalReason=NONE), log id: 3e3b9833 >2014-04-09 12:53:36,601 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [489d55c1] FINISH, SetVdsStatusVDSCommand, log id: 3e3b9833 >2014-04-09 12:53:36,601 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [489d55c1] After Installation host DC-5.243, VDS >2014-04-09 12:53:36,618 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [489d55c1] Correlation ID: 21f569a5, Job ID: 41299407-aa64-4c2d-a7de-0db2f6dff2a2, Call Stack: null, Custom Event ID: -1, Message: Host DC-5.243 installed >2014-04-09 12:53:36,626 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [489d55c1] Lock freed to object EngineLock [exclusiveLocks= key: 188df0b2-d0dd-4eca-b792-c015d110d12f value: VDS >, sharedLocks= ] >2014-04-09 12:53:40,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-5.243. >2014-04-09 12:53:40,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GetHardwareInfoVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, vds=Host[DC-5.243]), log id: 2481df4 >2014-04-09 12:53:42,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GetHardwareInfoVDSCommand, log id: 2481df4 >2014-04-09 12:53:44,592 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-5.243. >2014-04-09 12:53:44,592 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GetHardwareInfoVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, vds=Host[DC-5.243]), log id: 66eafdf4 >2014-04-09 12:53:46,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GetHardwareInfoVDSCommand, log id: 66eafdf4 >2014-04-09 12:53:46,816 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host DC-5.243. >2014-04-09 12:53:50,984 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-14) [39ce7b5] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 12:53:50,993 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-14) [39ce7b5] START, SetMOMPolicyParametersVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f), log id: 23db0164 >2014-04-09 12:53:53,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-14) [39ce7b5] FINISH, SetMOMPolicyParametersVDSCommand, log id: 23db0164 >2014-04-09 12:53:53,166 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [39ce7b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host DC-5.243. >2014-04-09 12:53:53,188 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-14) [57e6183b] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 12:53:53,194 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-14) [2adec5ff] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 12:54:15,873 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 12:54:16,073 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-5.243 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:09:57,785 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [2adec5ff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:18:24,328 WARN [org.ovirt.engine.core.bll.SearchQuery] (ajp-/127.0.0.1:8702-9) ResourceManager::searchBusinessObjects - erroneous search text - Host: and disk_type = image >2014-04-09 13:22:20,535 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetDeviceListVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, storageType=ISCSI), log id: 193ccbce >2014-04-09 13:22:28,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetDeviceListVDSCommand, return: [], log id: 193ccbce >2014-04-09 13:23:11,103 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-9) [3ad37a07] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:23:11,136 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-9) [3ad37a07] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:23:11,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-9) [3ad37a07] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 585d43dd >2014-04-09 13:23:11,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-9) [3ad37a07] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=469}, log id: 585d43dd >2014-04-09 13:23:11,429 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [3ad37a07] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 returned by VDSM was: Permission settings on the specified path do not allow access to the storage. >Verify permission settings on the specified storage path. >2014-04-09 13:23:11,430 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (ajp-/127.0.0.1:8702-9) [3ad37a07] The connection with details 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 failed because of error code 469 and error message is: permission settings on the specified path do not allow access to the storage. >verify permission settings on the specified storage path. >2014-04-09 13:23:11,440 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-9) [3ad37a07] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand. >2014-04-09 13:23:11,477 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-9) [3ad37a07] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:24:29,005 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-3) [1879270b] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:24:29,034 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-3) [1879270b] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:24:29,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-3) [1879270b] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7662c698 >2014-04-09 13:24:29,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-3) [1879270b] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7662c698 >2014-04-09 13:24:29,159 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-3) [1879270b] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:24:29,317 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-46) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:24:29,326 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:24:29,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 90c4537 >2014-04-09 13:24:29,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 90c4537 >2014-04-09 13:24:29,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] START, CreateStorageDomainVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@91b65d41, args=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1), log id: 14e0382b >2014-04-09 13:24:33,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] FINISH, CreateStorageDomainVDSCommand, log id: 14e0382b >2014-04-09 13:24:33,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] START, GetStorageDomainStatsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878), log id: 34013b42 >2014-04-09 13:24:33,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-12) [33a17d9b] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@335e7d6f, log id: 34013b42 >2014-04-09 13:24:33,200 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [33a17d9b] Correlation ID: 33a17d9b, Job ID: 711934dd-124b-43bd-a850-92c05157c007, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain1 was added by admin@internal >2014-04-09 13:24:33,317 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [2b8b1cb6] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:24:33,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [2b8b1cb6] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ff62fb5 >2014-04-09 13:24:36,063 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-5.243 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:24:36,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [2b8b1cb6] FINISH, DisconnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 5ff62fb5 >2014-04-09 13:24:37,096 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-9) [a63254f] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-09 13:24:37,110 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-9) [15ee2fef] Lock Acquired to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >, sharedLocks= ] >2014-04-09 13:24:37,123 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-9) [15ee2fef] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 13:24:37,314 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-9) [f29dfb4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:24:37,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-9) [f29dfb4] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2308981 >2014-04-09 13:24:37,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-9) [f29dfb4] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 2308981 >2014-04-09 13:24:37,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-9) [f29dfb4] START, CreateStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, storageType=NFS, storagePoolName=NFS_shyu, masterDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, domainsIdList=[dbec8cee-b5e4-4011-9dd5-7c122389a878], masterVersion=1), log id: 41bac2bc >2014-04-09 13:24:48,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetDeviceListVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, storageType=ISCSI), log id: 753f6690 >2014-04-09 13:24:59,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetDeviceListVDSCommand, return: [], log id: 753f6690 >2014-04-09 13:25:05,842 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-9) [f29dfb4] FINISH, CreateStoragePoolVDSCommand, log id: 41bac2bc >2014-04-09 13:25:05,859 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-9) [f29dfb4] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >, sharedLocks= ] >2014-04-09 13:25:05,865 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [126aa81a] Lock Acquired to object EngineLock [exclusiveLocks= key: dbec8cee-b5e4-4011-9dd5-7c122389a878 value: STORAGE >, sharedLocks= ] >2014-04-09 13:25:05,875 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [126aa81a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-09 13:25:05,901 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [126aa81a] Lock freed to object EngineLock [exclusiveLocks= key: dbec8cee-b5e4-4011-9dd5-7c122389a878 value: STORAGE >, sharedLocks= ] >2014-04-09 13:25:05,902 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [126aa81a] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 1:25 PM >2014-04-09 13:25:05,914 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [276be657] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:25:05,916 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [4f3331ff] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:25:05,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [276be657] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 756dc4c3 >2014-04-09 13:25:05,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [4f3331ff] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6a5ea25f >2014-04-09 13:25:05,938 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [4f3331ff] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 6a5ea25f >2014-04-09 13:25:06,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [276be657] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 756dc4c3 >2014-04-09 13:25:06,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-9) [126aa81a] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878), log id: 37478902 >2014-04-09 13:25:06,351 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 13:25:06,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [43a21a22] Correlation ID: 43a21a22, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. >2014-04-09 13:25:06,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] hostFromVds::selectedVds - 10.66.106.32, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-09 13:25:06,423 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 31a42bbe >2014-04-09 13:25:09,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] FINISH, ConnectStoragePoolVDSCommand, log id: 31a42bbe >2014-04-09 13:25:09,804 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] hostFromVds::Connected host to pool - selectedVds - 10.66.106.32, spmStatus Free, storage pool NFS_shyu >2014-04-09 13:25:09,826 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] starting spm on vds 10.66.106.32, storage pool NFS_shyu, prevId -1, LVER -1 >2014-04-09 13:25:09,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] START, SpmStartVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 68a07619 >2014-04-09 13:25:09,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] spmStart polling started: taskId = c03e3b25-acba-40b2-aa9b-e75b25441200 >2014-04-09 13:25:31,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] spmStart polling ended: taskId = c03e3b25-acba-40b2-aa9b-e75b25441200 task status = finished >2014-04-09 13:25:31,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] spmStart polling ended, spm status: SPM >2014-04-09 13:25:31,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=c03e3b25-acba-40b2-aa9b-e75b25441200), log id: 7e0f389a >2014-04-09 13:25:31,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] FINISH, HSMClearTaskVDSCommand, log id: 7e0f389a >2014-04-09 13:25:31,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4f6d5de6, log id: 68a07619 >2014-04-09 13:25:31,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] Initialize Irs proxy from vds: 10.66.106.32 >2014-04-09 13:25:31,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [43a21a22] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.106.32 (Address: 10.66.106.32). >2014-04-09 13:25:31,257 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] FINISH, ActivateStorageDomainVDSCommand, log id: 37478902 >2014-04-09 13:25:31,257 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 1:25 PM >2014-04-09 13:25:31,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) [43a21a22] START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 66664b3b >2014-04-09 13:25:31,280 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) [43a21a22] START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 69c8e05e >2014-04-09 13:25:31,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) [43a21a22] FINISH, ConnectStoragePoolVDSCommand, log id: 66664b3b >2014-04-09 13:25:33,851 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) [43a21a22] FINISH, ConnectStoragePoolVDSCommand, log id: 69c8e05e >2014-04-09 13:25:33,872 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [43a21a22] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 1:25 PM >2014-04-09 13:25:33,897 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [43a21a22] Correlation ID: 126aa81a, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain1 (Data Center NFS_shyu) was activated by admin@internal >2014-04-09 13:25:33,914 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [43a21a22] Correlation ID: 15ee2fef, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center NFS_shyu by admin@internal >2014-04-09 13:25:33,930 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [43a21a22] Correlation ID: a63254f, Job ID: 1640beeb-196b-472e-af18-f2fdbcd5e17f, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain1 was attached to Data Center NFS_shyu by admin@internal >2014-04-09 13:26:43,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetDeviceListVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, storageType=ISCSI), log id: 447d4851 >2014-04-09 13:26:52,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetDeviceListVDSCommand, return: [], log id: 447d4851 >2014-04-09 13:27:17,830 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [69e0985f] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:27:17,851 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [69e0985f] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:17,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-10) [69e0985f] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7e0afe50 >2014-04-09 13:27:17,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-10) [69e0985f] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7e0afe50 >2014-04-09 13:27:18,001 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [69e0985f] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:27:18,184 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:18,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4fc9f58c >2014-04-09 13:27:18,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 4fc9f58c >2014-04-09 13:27:18,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] START, CreateStorageDomainVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@e0436215, args=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2), log id: 53d90ad5 >2014-04-09 13:27:21,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] FINISH, CreateStorageDomainVDSCommand, log id: 53d90ad5 >2014-04-09 13:27:21,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] START, GetStorageDomainStatsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomainId=55cb7668-7c5e-4553-b263-c6f3f86b358f), log id: 2bd66b89 >2014-04-09 13:27:21,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-2) [6f182cbf] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@68ad654b, log id: 2bd66b89 >2014-04-09 13:27:21,942 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [6f182cbf] Correlation ID: 6f182cbf, Job ID: 45838b45-9b1a-44b5-a24a-c68f2293f622, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain2 was added by admin@internal >2014-04-09 13:27:22,025 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-8) [77b15e4e] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:22,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-8) [77b15e4e] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 766f2c3d >2014-04-09 13:27:25,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-8) [77b15e4e] FINISH, DisconnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 766f2c3d >2014-04-09 13:27:25,525 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-6) [553bdbef] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 13:27:25,554 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [5d55d695] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:25,554 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [2e7b0012] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:25,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5d55d695] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bf936a2 >2014-04-09 13:27:25,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [2e7b0012] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bdd456d >2014-04-09 13:27:25,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [2e7b0012] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 7bdd456d >2014-04-09 13:27:25,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5d55d695] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 7bf936a2 >2014-04-09 13:27:25,636 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-6) [553bdbef] START, AttachStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f), log id: 129d157d >2014-04-09 13:27:54,097 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-6) [553bdbef] FINISH, AttachStorageDomainVDSCommand, log id: 129d157d >2014-04-09 13:27:54,147 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] Lock Acquired to object EngineLock [exclusiveLocks= key: 55cb7668-7c5e-4553-b263-c6f3f86b358f value: STORAGE >, sharedLocks= ] >2014-04-09 13:27:54,164 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 13:27:54,171 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] Lock freed to object EngineLock [exclusiveLocks= key: 55cb7668-7c5e-4553-b263-c6f3f86b358f value: STORAGE >, sharedLocks= ] >2014-04-09 13:27:54,172 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 1:27 PM >2014-04-09 13:27:54,184 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [223d1771] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:54,184 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [58ce0d46] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:27:54,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [223d1771] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7acff9f1 >2014-04-09 13:27:54,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [58ce0d46] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 817f3b8 >2014-04-09 13:27:54,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [223d1771] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 7acff9f1 >2014-04-09 13:27:54,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [58ce0d46] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 817f3b8 >2014-04-09 13:27:54,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f), log id: 5ccdf107 >2014-04-09 13:27:57,415 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] FINISH, ActivateStorageDomainVDSCommand, log id: 5ccdf107 >2014-04-09 13:27:57,415 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 1:27 PM >2014-04-09 13:27:57,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [486c7e08] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 7701cfd3 >2014-04-09 13:27:57,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [486c7e08] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 17f362af >2014-04-09 13:27:57,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [486c7e08] FINISH, RefreshStoragePoolVDSCommand, log id: 7701cfd3 >2014-04-09 13:27:57,442 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-50) [486c7e08] Refreshed vds 10.66.106.32 in pool NFS_shyu >2014-04-09 13:27:59,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [486c7e08] FINISH, RefreshStoragePoolVDSCommand, log id: 17f362af >2014-04-09 13:27:59,828 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-49) [486c7e08] Refreshed vds 10.66.106.40 in pool NFS_shyu >2014-04-09 13:27:59,846 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [486c7e08] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 1:27 PM >2014-04-09 13:27:59,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [486c7e08] Correlation ID: 486c7e08, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain2 (Data Center NFS_shyu) was activated by admin@internal >2014-04-09 13:27:59,879 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [486c7e08] Correlation ID: 553bdbef, Job ID: ca2aa948-3f8c-4f68-bd45-42320ca04789, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain2 was attached to Data Center NFS_shyu by admin@internal >2014-04-09 13:34:39,341 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-16) [1ee43204] Lock Acquired to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-04-09 13:34:39,417 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-16) [1ee43204] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 13:34:39,842 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [1ee43204] Correlation ID: 1ee43204, Job ID: 35078e70-5bb4-42ac-9319-51a4963d2dfd, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was created by admin@internal. >2014-04-09 13:34:39,851 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-16) [1ee43204] Lock freed to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-04-09 13:34:40,129 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-49) [b95d531] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-09 13:34:40,152 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-3) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 13:34:40,164 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-4) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 13:34:40,315 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-49) [69585af7] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 13:34:40,431 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [69585af7] Correlation ID: 69585af7, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm1. (User: admin@internal) >2014-04-09 13:34:40,464 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [69585af7] Correlation ID: b95d531, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm1. (User: admin@internal) >2014-04-09 13:34:48,413 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-9) [736df5e8] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM_DISK_BOOT >, sharedLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >] >2014-04-09 13:34:48,463 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-9) [736df5e8] Running command: AddDiskCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM, ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-09 13:34:48,746 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-9) [1b3f7781] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-09 13:34:48,831 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-9) [1b3f7781] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM_DISK_BOOT >, sharedLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >] >2014-04-09 13:34:48,834 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [1b3f7781] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, imageSizeInBytes = 107374182400, volumeFormat = RAW, newImageId = 3b7ab14c-7440-4c79-b302-7c93da9ffb1c, newImageDescription = ), log id: 6632f48d >2014-04-09 13:34:48,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [1b3f7781] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 13:34:48,835 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [1b3f7781] -- createVolume parameters: > sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=d84232e1-e105-4c7e-8657-28d777960e4e > size=107,374,182,400 bytes > volFormat=RAW > volType=Sparse > volUUID=3b7ab14c-7440-4c79-b302-7c93da9ffb1c > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 13:34:48,940 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [1b3f7781] FINISH, CreateImageVDSCommand, return: 3b7ab14c-7440-4c79-b302-7c93da9ffb1c, log id: 6632f48d >2014-04-09 13:34:49,127 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-9) [1b3f7781] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command bf75c1b1-1d78-4a20-beb4-0744c2b4ee44 >2014-04-09 13:34:49,129 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-9) [1b3f7781] CommandMultiAsyncTasks::AttachTask: Attaching task 2033a2ab-9552-42ff-930e-8a3bb28135c9 to command bf75c1b1-1d78-4a20-beb4-0744c2b4ee44. >2014-04-09 13:34:49,172 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-9) [1b3f7781] Adding task 2033a2ab-9552-42ff-930e-8a3bb28135c9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 13:34:49,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [1b3f7781] Correlation ID: 736df5e8, Job ID: 979a6420-8ad1-4b12-b1df-ac55ed931b21, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm1_Disk1 was initiated on VM vm1 by admin@internal. >2014-04-09 13:34:49,222 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-9) [1b3f7781] BaseAsyncTask::StartPollingTask: Starting to poll task 2033a2ab-9552-42ff-930e-8a3bb28135c9. >2014-04-09 13:34:51,505 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-76) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 13:34:51,521 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task 2033a2ab-9552-42ff-930e-8a3bb28135c9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 13:34:51,538 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task 2033a2ab-9552-42ff-930e-8a3bb28135c9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 13:34:51,539 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::EndActionIfNecessary: All tasks of command bf75c1b1-1d78-4a20-beb4-0744c2b4ee44 has ended -> executing EndAction >2014-04-09 13:34:51,540 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: bf75c1b1-1d78-4a20-beb4-0744c2b4ee44): calling EndAction . >2014-04-09 13:34:51,543 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-09 13:34:51,580 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-47) [736df5e8] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-09 13:34:51,595 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-47) [1b3f7781] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-09 13:34:51,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [1b3f7781] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, imageId = 3b7ab14c-7440-4c79-b302-7c93da9ffb1c), log id: 71aed35d >2014-04-09 13:34:51,676 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [1b3f7781] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7c56ded0, log id: 71aed35d >2014-04-09 13:34:51,722 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) Correlation ID: 736df5e8, Job ID: 979a6420-8ad1-4b12-b1df-ac55ed931b21, Call Stack: null, Custom Event ID: -1, Message: The disk vm1_Disk1 was successfully added to VM vm1. >2014-04-09 13:34:51,722 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-09 13:34:51,722 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-09 13:34:51,730 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2033a2ab-9552-42ff-930e-8a3bb28135c9 >2014-04-09 13:34:51,732 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 2033a2ab-9552-42ff-930e-8a3bb28135c9), log id: 4e334b0e >2014-04-09 13:34:51,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=2033a2ab-9552-42ff-930e-8a3bb28135c9), log id: 984ac3e >2014-04-09 13:34:51,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 984ac3e >2014-04-09 13:34:51,751 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 4e334b0e >2014-04-09 13:34:51,763 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 2033a2ab-9552-42ff-930e-8a3bb28135c9 from DataBase >2014-04-09 13:34:51,764 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity bf75c1b1-1d78-4a20-beb4-0744c2b4ee44 >2014-04-09 13:35:18,668 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] START, IsVmDuringInitiatingVDSCommand( vmId = 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 53cb697a >2014-04-09 13:35:18,668 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 53cb697a >2014-04-09 13:35:18,751 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] Running command: RunVmOnceCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 13:35:18,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 22ef187d >2014-04-09 13:35:18,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] FINISH, IsoPrefixVDSCommand, return: , log id: 22ef187d >2014-04-09 13:35:18,875 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 2ac28f44 >2014-04-09 13:35:18,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 52fed7d7 >2014-04-09 13:35:19,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f,devices=[Ljava.util.HashMap;@480ba543,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={} >2014-04-09 13:35:19,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] FINISH, CreateVDSCommand, log id: 52fed7d7 >2014-04-09 13:35:19,136 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-16) [65aedb7a] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2ac28f44 >2014-04-09 13:35:19,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [65aedb7a] Correlation ID: 65aedb7a, Job ID: 9f1984d7-36f2-473d-b107-d9f15d46b2b4, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 13:35:20,011 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-15) [1fb6c74] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.218' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor103.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.GeneratedMethodAccessor102.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 13:35:20,036 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-15) [1fb6c74] Running command: AddVdsCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 13:35:20,064 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 13:35:20,078 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] Lock freed to object EngineLock [exclusiveLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 13:35:20,078 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [75f956fb] Cannot get vdsManager for vdsid=ad1b4923-fe33-4a29-a5a2-01e43e851736 >2014-04-09 13:35:20,082 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] START, RemoveVdsVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736), log id: 6053b46c >2014-04-09 13:35:20,082 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [75f956fb] Cannot get vdsManager for vdsid=ad1b4923-fe33-4a29-a5a2-01e43e851736 >2014-04-09 13:35:20,082 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] FINISH, RemoveVdsVDSCommand, log id: 6053b46c >2014-04-09 13:35:20,082 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [75f956fb] Cannot get vdsManager for vdsid=ad1b4923-fe33-4a29-a5a2-01e43e851736 >2014-04-09 13:35:20,084 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] START, AddVdsVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736), log id: 6ebad6fd >2014-04-09 13:35:20,084 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] AddVds - entered , starting logic to add VDS ad1b4923-fe33-4a29-a5a2-01e43e851736 >2014-04-09 13:35:20,086 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] AddVds - VDS ad1b4923-fe33-4a29-a5a2-01e43e851736 was added, will try to add it to the resource manager >2014-04-09 13:35:20,086 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-15) [75f956fb] Entered VdsManager constructor >2014-04-09 13:35:20,102 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-15) [75f956fb] Initialize vdsBroker (10.66.85.218,54,321) >2014-04-09 13:35:20,103 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [75f956fb] VDS ad1b4923-fe33-4a29-a5a2-01e43e851736 was added to the Resource Manager >2014-04-09 13:35:20,103 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [75f956fb] FINISH, AddVdsVDSCommand, log id: 6ebad6fd >2014-04-09 13:35:20,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [75f956fb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host DC-85.218. >2014-04-09 13:35:20,136 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [75f956fb] Correlation ID: 1fb6c74, Job ID: 964a0e39-09f2-4702-9c1a-8bd70cf1e068, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.218 was added by admin@internal. >2014-04-09 13:35:20,145 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-47) [216196a5] Lock Acquired to object EngineLock [exclusiveLocks= key: ad1b4923-fe33-4a29-a5a2-01e43e851736 value: VDS >, sharedLocks= ] >2014-04-09 13:35:20,161 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-47) [216196a5] Running command: InstallVdsCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 13:35:20,162 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-47) [216196a5] Before Installation host ad1b4923-fe33-4a29-a5a2-01e43e851736, DC-85.218 >2014-04-09 13:35:20,167 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-47) [216196a5] START, SetVdsStatusVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, status=Installing, nonOperationalReason=NONE), log id: 4ad8aa52 >2014-04-09 13:35:20,178 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-47) [216196a5] FINISH, SetVdsStatusVDSCommand, log id: 4ad8aa52 >2014-04-09 13:35:20,312 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-47) [216196a5] Installation 10.66.85.218: Connected to host 10.66.85.218 with SSH key fingerprint: ee:6f:5b:c7:fb:46:e2:d8:bb:6f:c5:61:7c:3b:44:42 >2014-04-09 13:35:20,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [216196a5] Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Connected to host 10.66.85.218 with SSH key fingerprint: ee:6f:5b:c7:fb:46:e2:d8:bb:6f:c5:61:7c:3b:44:42. >2014-04-09 13:35:20,348 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-47) [216196a5] Installation of 10.66.85.218. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 13:35:20,359 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-47) SSH execute root@10.66.85.218 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 13:35:21,576 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from WaitForLaunch --> PoweringUp >2014-04-09 13:35:21,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 47730e85 >2014-04-09 13:35:21,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@52be6268, log id: 47730e85 >2014-04-09 13:35:21,640 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Initializing >2014-04-09 13:35:21,661 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Initializing. >2014-04-09 13:35:21,681 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Environment setup >2014-04-09 13:35:21,695 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Environment setup. >2014-04-09 13:35:21,696 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Environment packages setup >2014-04-09 13:35:21,711 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Environment packages setup. >2014-04-09 13:35:23,106 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-64) Initializing Host: DC-85.218 >2014-04-09 13:35:25,517 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Downloading Packages >2014-04-09 13:35:25,579 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Downloading Packages. >2014-04-09 13:35:27,432 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 13:35:27,444 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 13:35:27,444 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Check Package Signatures >2014-04-09 13:35:27,452 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Check Package Signatures. >2014-04-09 13:35:27,452 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Running Test Transaction >2014-04-09 13:35:27,460 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Running Test Transaction. >2014-04-09 13:35:27,592 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-6) [4787cd04] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 13:35:27,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [4787cd04] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=jc7dcrjsp69r, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5821e92b >2014-04-09 13:35:27,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [4787cd04] FINISH, SetVmTicketVDSCommand, log id: 5821e92b >2014-04-09 13:35:27,664 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Running Transaction >2014-04-09 13:35:27,677 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Running Transaction. >2014-04-09 13:35:27,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [4787cd04] Correlation ID: 4787cd04, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 13:35:28,309 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 13:35:28,327 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 13:35:28,974 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum updated: 2/2: dmidecode >2014-04-09 13:35:28,993 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum updated: 2/2: dmidecode. >2014-04-09 13:35:30,467 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-09 13:35:30,485 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-09 13:35:30,592 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-09 13:35:30,623 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-09 13:35:30,951 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Programs detection >2014-04-09 13:35:30,960 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Programs detection. >2014-04-09 13:35:30,960 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Environment customization >2014-04-09 13:35:30,968 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Environment customization. >2014-04-09 13:35:31,025 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Logs at host located at: '/tmp/ovirt-host-deploy-20140409133538.log' >2014-04-09 13:35:31,035 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Logs at host located at: '/tmp/ovirt-host-deploy-20140409133538.log'. >2014-04-09 13:35:31,120 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.85.218 reports unique id D2942680-8D9D-11DE-988B-E0191061DB7A >2014-04-09 13:35:31,144 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id D2942680-8D9D-11DE-988B-E0191061DB7A to Host 10.66.85.218 >2014-04-09 13:35:31,280 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Setup validation >2014-04-09 13:35:31,302 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Setup validation. >2014-04-09 13:35:31,347 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Hardware supports virtualization >2014-04-09 13:35:31,368 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Hardware supports virtualization. >2014-04-09 13:35:31,378 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Transaction setup >2014-04-09 13:35:31,385 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Transaction setup. >2014-04-09 13:35:31,445 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Misc configuration >2014-04-09 13:35:31,460 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Misc configuration. >2014-04-09 13:35:31,460 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Package installation >2014-04-09 13:35:31,468 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Package installation. >2014-04-09 13:35:32,935 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Downloading Packages >2014-04-09 13:35:32,952 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Downloading Packages. >2014-04-09 13:35:35,552 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 13:35:35,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 13:35:35,611 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Download/Verify: tuned-0.2.19-13.el6.noarch >2014-04-09 13:35:35,647 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Download/Verify: tuned-0.2.19-13.el6.noarch. >2014-04-09 13:35:35,647 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Check Package Signatures >2014-04-09 13:35:35,665 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Check Package Signatures. >2014-04-09 13:35:35,665 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Running Test Transaction >2014-04-09 13:35:35,685 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Running Test Transaction. >2014-04-09 13:35:35,867 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Status: Running Transaction >2014-04-09 13:35:35,902 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Status: Running Transaction. >2014-04-09 13:35:36,542 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum install: 1/2: tuned-0.2.19-13.el6.noarch >2014-04-09 13:35:36,569 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum install: 1/2: tuned-0.2.19-13.el6.noarch. >2014-04-09 13:35:37,630 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum install: 2/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 13:35:37,644 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum install: 2/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 13:35:39,064 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u >2014-04-09 13:35:39,077 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u. >2014-04-09 13:35:39,176 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Yum Verify: 2/2: tuned.noarch 0:0.2.19-13.el6 - u >2014-04-09 13:35:39,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Yum Verify: 2/2: tuned.noarch 0:0.2.19-13.el6 - u. >2014-04-09 13:35:39,550 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Misc configuration >2014-04-09 13:35:39,560 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Misc configuration. >2014-04-09 13:35:39,638 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Setting time >2014-04-09 13:35:39,652 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Setting time. >2014-04-09 13:35:42,170 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Enrolling certificate >2014-04-09 13:35:42,201 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Enrolling certificate. >2014-04-09 13:35:43,476 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Transaction commit >2014-04-09 13:35:43,493 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Transaction commit. >2014-04-09 13:35:43,581 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Closing up >2014-04-09 13:35:43,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Closing up. >2014-04-09 13:35:46,552 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stopping libvirtd >2014-04-09 13:35:46,567 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stopping libvirtd. >2014-04-09 13:35:47,536 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Starting vdsm >2014-04-09 13:35:47,587 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Starting vdsm. >2014-04-09 13:35:51,344 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Pre-termination >2014-04-09 13:35:51,367 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Pre-termination. >2014-04-09 13:35:51,379 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409133551-10.66.85.218-216196a5.log' >2014-04-09 13:35:51,392 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409133551-10.66.85.218-216196a5.log'. >2014-04-09 13:35:51,766 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.218: Stage: Termination >2014-04-09 13:35:51,775 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 216196a5, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.218. Stage: Termination. >2014-04-09 13:35:51,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [216196a5] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:51,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [216196a5] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:52,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [216196a5] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:52,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [216196a5] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:52,921 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [216196a5] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:52,921 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [216196a5] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:53,467 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [49f956c9] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.215' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor103.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.GeneratedMethodAccessor102.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 13:35:53,500 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [49f956c9] Running command: AddVdsCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 13:35:53,528 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 13:35:53,542 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] Lock freed to object EngineLock [exclusiveLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: REGISTER_VDS >, sharedLocks= ] >2014-04-09 13:35:53,542 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [13a1c85e] Cannot get vdsManager for vdsid=6c442434-1073-4f29-a3bd-c20b77a28d91 >2014-04-09 13:35:53,545 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] START, RemoveVdsVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91), log id: 4b96ec88 >2014-04-09 13:35:53,546 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [13a1c85e] Cannot get vdsManager for vdsid=6c442434-1073-4f29-a3bd-c20b77a28d91 >2014-04-09 13:35:53,546 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] FINISH, RemoveVdsVDSCommand, log id: 4b96ec88 >2014-04-09 13:35:53,546 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [13a1c85e] Cannot get vdsManager for vdsid=6c442434-1073-4f29-a3bd-c20b77a28d91 >2014-04-09 13:35:53,548 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] START, AddVdsVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91), log id: 28ac7c17 >2014-04-09 13:35:53,548 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] AddVds - entered , starting logic to add VDS 6c442434-1073-4f29-a3bd-c20b77a28d91 >2014-04-09 13:35:53,550 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] AddVds - VDS 6c442434-1073-4f29-a3bd-c20b77a28d91 was added, will try to add it to the resource manager >2014-04-09 13:35:53,550 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [13a1c85e] Entered VdsManager constructor >2014-04-09 13:35:53,566 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [13a1c85e] Initialize vdsBroker (10.66.85.215,54,321) >2014-04-09 13:35:53,567 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [13a1c85e] VDS 6c442434-1073-4f29-a3bd-c20b77a28d91 was added to the Resource Manager >2014-04-09 13:35:53,568 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [13a1c85e] FINISH, AddVdsVDSCommand, log id: 28ac7c17 >2014-04-09 13:35:53,575 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [13a1c85e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host DC-85.215. >2014-04-09 13:35:53,600 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [13a1c85e] Correlation ID: 49f956c9, Job ID: 9d447686-6db0-4ba0-8254-f63bb0c4c344, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.215 was added by admin@internal. >2014-04-09 13:35:53,609 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1c415086] Lock Acquired to object EngineLock [exclusiveLocks= key: 6c442434-1073-4f29-a3bd-c20b77a28d91 value: VDS >, sharedLocks= ] >2014-04-09 13:35:53,625 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1c415086] Running command: InstallVdsCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 13:35:53,625 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1c415086] Before Installation host 6c442434-1073-4f29-a3bd-c20b77a28d91, DC-85.215 >2014-04-09 13:35:53,630 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [1c415086] START, SetVdsStatusVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, status=Installing, nonOperationalReason=NONE), log id: 1c309f8 >2014-04-09 13:35:53,642 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [1c415086] FINISH, SetVdsStatusVDSCommand, log id: 1c309f8 >2014-04-09 13:35:53,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-49) [1c415086] Installation 10.66.85.215: Connected to host 10.66.85.215 with SSH key fingerprint: 3e:1c:3c:6a:aa:bd:4a:d6:c4:20:59:f0:21:ab:43:5a >2014-04-09 13:35:53,750 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [1c415086] Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Connected to host 10.66.85.215 with SSH key fingerprint: 3e:1c:3c:6a:aa:bd:4a:d6:c4:20:59:f0:21:ab:43:5a. >2014-04-09 13:35:53,776 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-49) [1c415086] Installation of 10.66.85.215. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-09 13:35:53,791 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-49) SSH execute root@10.66.85.215 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-09 13:35:53,905 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-47) [216196a5] Engine managed to communicate with VDSM agent on host DC-85.218 >2014-04-09 13:35:54,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [216196a5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.218. >2014-04-09 13:35:54,173 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-47) [551dcae1] Running command: SetupNetworksCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 13:35:54,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-47) [551dcae1] START, SetupNetworksVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=cb715cd9-0fb4-44da-ad48-ff63a5bb91e0, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth0 {id=9b73fde7-3ead-4bc5-84ee-10f505650ead, vdsId=ad1b4923-fe33-4a29-a5a2-01e43e851736, macAddress=00:21:86:93:f6:b5, networkName=rhevm, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.66.85.218, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 3eb8e753 >2014-04-09 13:35:54,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-47) [551dcae1] FINISH, SetupNetworksVDSCommand, log id: 3eb8e753 >2014-04-09 13:35:55,883 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Initializing >2014-04-09 13:35:55,900 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Initializing. >2014-04-09 13:35:55,923 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Environment setup >2014-04-09 13:35:55,933 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Environment setup. >2014-04-09 13:35:55,938 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Environment packages setup >2014-04-09 13:35:55,950 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Environment packages setup. >2014-04-09 13:35:56,570 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-96) Initializing Host: DC-85.215 >2014-04-09 13:35:57,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:57,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:59,156 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Downloading Packages >2014-04-09 13:35:59,175 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Downloading Packages. >2014-04-09 13:35:59,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:35:59,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:00,829 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 13:36:00,841 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 13:36:00,841 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Check Package Signatures >2014-04-09 13:36:00,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Check Package Signatures. >2014-04-09 13:36:00,858 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Running Test Transaction >2014-04-09 13:36:00,866 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Running Test Transaction. >2014-04-09 13:36:01,059 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Running Transaction >2014-04-09 13:36:01,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Running Transaction. >2014-04-09 13:36:01,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:01,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:01,705 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-09 13:36:01,724 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-09 13:36:02,393 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum updated: 2/2: dmidecode >2014-04-09 13:36:02,408 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum updated: 2/2: dmidecode. >2014-04-09 13:36:03,310 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:03,311 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-47) [551dcae1] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:03,905 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-09 13:36:03,924 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-09 13:36:04,014 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-09 13:36:04,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-09 13:36:04,371 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Programs detection >2014-04-09 13:36:04,382 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Programs detection. >2014-04-09 13:36:04,383 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Environment customization >2014-04-09 13:36:04,391 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Environment customization. >2014-04-09 13:36:04,447 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Logs at host located at: '/tmp/ovirt-host-deploy-20140409133612.log' >2014-04-09 13:36:04,457 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Logs at host located at: '/tmp/ovirt-host-deploy-20140409133612.log'. >2014-04-09 13:36:04,552 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.85.215 reports unique id D0CA6300-8D9D-11DE-AFF1-BD9E7686C411 >2014-04-09 13:36:04,555 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id D0CA6300-8D9D-11DE-AFF1-BD9E7686C411 to Host 10.66.85.215 >2014-04-09 13:36:04,638 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Setup validation >2014-04-09 13:36:04,649 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Setup validation. >2014-04-09 13:36:04,702 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Hardware supports virtualization >2014-04-09 13:36:04,716 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Hardware supports virtualization. >2014-04-09 13:36:04,732 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Transaction setup >2014-04-09 13:36:04,741 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Transaction setup. >2014-04-09 13:36:04,791 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Misc configuration >2014-04-09 13:36:04,807 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Misc configuration. >2014-04-09 13:36:04,808 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Package installation >2014-04-09 13:36:04,816 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Package installation. >2014-04-09 13:36:05,445 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [551dcae1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.218. >2014-04-09 13:36:05,519 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-4-thread-47) [7a073a7a] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 13:36:05,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-4-thread-47) [7a073a7a] START, SetSafeNetworkConfigVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736), log id: 7ea8a623 >2014-04-09 13:36:05,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-4-thread-47) [7a073a7a] FINISH, SetSafeNetworkConfigVDSCommand, log id: 7ea8a623 >2014-04-09 13:36:05,565 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [7a073a7a] Correlation ID: 7a073a7a, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host DC-85.218 >2014-04-09 13:36:05,569 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-47) [7a073a7a] START, SetVdsStatusVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, status=Initializing, nonOperationalReason=NONE), log id: 332ccc43 >2014-04-09 13:36:05,574 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-47) [7a073a7a] FINISH, SetVdsStatusVDSCommand, log id: 332ccc43 >2014-04-09 13:36:05,574 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-47) [7a073a7a] After Installation host DC-85.218, VDS >2014-04-09 13:36:05,591 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [7a073a7a] Correlation ID: 216196a5, Job ID: 964a0e39-09f2-4702-9c1a-8bd70cf1e068, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.218 installed >2014-04-09 13:36:05,599 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-47) [7a073a7a] Lock freed to object EngineLock [exclusiveLocks= key: ad1b4923-fe33-4a29-a5a2-01e43e851736 value: VDS >, sharedLocks= ] >2014-04-09 13:36:06,309 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Downloading Packages >2014-04-09 13:36:06,324 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Downloading Packages. >2014-04-09 13:36:06,432 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-39) Setting new tasks map. The map contains now 0 tasks >2014-04-09 13:36:06,432 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-39) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-09 13:36:07,200 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-50) [2530abf7] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 13:36:07,203 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [2530abf7] START, SetVdsStatusVDSCommand(HostName = DC-5.243, HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 4c972071 >2014-04-09 13:36:07,215 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [2530abf7] FINISH, SetVdsStatusVDSCommand, log id: 4c972071 >2014-04-09 13:36:07,266 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-50) [2530abf7] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 13:36:07,274 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [2530abf7] Correlation ID: 2530abf7, Job ID: 94171206-f75e-42e1-9f30-4c5802ef2372, Call Stack: null, Custom Event ID: -1, Message: Host DC-5.243 was switched to Maintenance mode by admin@internal. >2014-04-09 13:36:07,750 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 13:36:07,765 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Download/Verify: qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 13:36:07,767 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Download/Verify: tuned-0.2.19-13.el6.noarch >2014-04-09 13:36:07,782 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Download/Verify: tuned-0.2.19-13.el6.noarch. >2014-04-09 13:36:07,782 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Check Package Signatures >2014-04-09 13:36:07,790 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Check Package Signatures. >2014-04-09 13:36:07,791 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Running Test Transaction >2014-04-09 13:36:07,799 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Running Test Transaction. >2014-04-09 13:36:08,136 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Status: Running Transaction >2014-04-09 13:36:08,158 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Status: Running Transaction. >2014-04-09 13:36:08,232 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.218. >2014-04-09 13:36:08,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetHardwareInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218]), log id: 9751f4b >2014-04-09 13:36:08,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetHardwareInfoVDSCommand, log id: 9751f4b >2014-04-09 13:36:08,457 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.218. >2014-04-09 13:36:08,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetHardwareInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218]), log id: 2edde063 >2014-04-09 13:36:08,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetHardwareInfoVDSCommand, log id: 2edde063 >2014-04-09 13:36:08,499 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host DC-85.218. >2014-04-09 13:36:08,515 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-23) [1d0e660c] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 13:36:08,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [1d0e660c] START, SetMOMPolicyParametersVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736), log id: 98db3be >2014-04-09 13:36:08,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [1d0e660c] FINISH, SetMOMPolicyParametersVDSCommand, log id: 98db3be >2014-04-09 13:36:08,608 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [1d0e660c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host DC-85.218. >2014-04-09 13:36:08,624 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [67afcd1f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 13:36:08,631 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-23) [40980259] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 13:36:08,861 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum install: 1/2: tuned-0.2.19-13.el6.noarch >2014-04-09 13:36:08,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum install: 1/2: tuned-0.2.19-13.el6.noarch. >2014-04-09 13:36:09,942 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum install: 2/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64 >2014-04-09 13:36:09,957 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum install: 2/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.423.el6.x86_64. >2014-04-09 13:36:11,351 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u >2014-04-09 13:36:11,390 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.423.el6 - u. >2014-04-09 13:36:11,473 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Yum Verify: 2/2: tuned.noarch 0:0.2.19-13.el6 - u >2014-04-09 13:36:11,490 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Yum Verify: 2/2: tuned.noarch 0:0.2.19-13.el6 - u. >2014-04-09 13:36:11,863 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Misc configuration >2014-04-09 13:36:11,873 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Misc configuration. >2014-04-09 13:36:11,959 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Setting time >2014-04-09 13:36:11,973 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Setting time. >2014-04-09 13:36:14,869 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-94) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 188df0b2-d0dd-4eca-b792-c015d110d12f : DC-5.243 >2014-04-09 13:36:15,726 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Enrolling certificate >2014-04-09 13:36:15,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Enrolling certificate. >2014-04-09 13:36:17,096 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Transaction commit >2014-04-09 13:36:17,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Transaction commit. >2014-04-09 13:36:17,179 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Closing up >2014-04-09 13:36:17,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Closing up. >2014-04-09 13:36:20,403 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stopping libvirtd >2014-04-09 13:36:20,422 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stopping libvirtd. >2014-04-09 13:36:20,868 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-4) [710fe2c6] Lock Acquired to object EngineLock [exclusiveLocks= key: 188df0b2-d0dd-4eca-b792-c015d110d12f value: VDS >, sharedLocks= ] >2014-04-09 13:36:20,874 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-35) [710fe2c6] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 188df0b2-d0dd-4eca-b792-c015d110d12f Type: VDS >2014-04-09 13:36:20,901 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-35) [710fe2c6] START, RemoveVdsVDSCommand( HostId = 188df0b2-d0dd-4eca-b792-c015d110d12f), log id: 5fe91de9 >2014-04-09 13:36:20,901 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-35) [710fe2c6] vdsManager::disposing >2014-04-09 13:36:20,901 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-35) [710fe2c6] FINISH, RemoveVdsVDSCommand, log id: 5fe91de9 >2014-04-09 13:36:20,905 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [710fe2c6] Correlation ID: 710fe2c6, Call Stack: null, Custom Event ID: -1, Message: Host DC-5.243 was removed by admin@internal. >2014-04-09 13:36:20,906 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-35) [710fe2c6] Lock freed to object EngineLock [exclusiveLocks= key: 188df0b2-d0dd-4eca-b792-c015d110d12f value: VDS >, sharedLocks= ] >2014-04-09 13:36:21,034 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-22) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from PoweringUp --> Up >2014-04-09 13:36:21,072 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) Correlation ID: 65aedb7a, Job ID: 9f1984d7-36f2-473d-b107-d9f15d46b2b4, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host 10.66.106.32 >2014-04-09 13:36:21,455 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Starting vdsm >2014-04-09 13:36:21,464 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Starting vdsm. >2014-04-09 13:36:23,830 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.218 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:36:25,789 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Pre-termination >2014-04-09 13:36:25,805 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Pre-termination. >2014-04-09 13:36:25,818 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409133625-10.66.85.215-1c415086.log' >2014-04-09 13:36:25,830 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140409133625-10.66.85.215-1c415086.log'. >2014-04-09 13:36:26,209 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.215: Stage: Termination >2014-04-09 13:36:26,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c415086, Call Stack: null, Custom Event ID: -1, Message: Installing Host DC-85.215. Stage: Termination. >2014-04-09 13:36:26,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1c415086] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:26,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1c415086] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:27,449 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1c415086] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:27,449 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1c415086] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:27,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1c415086] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:27,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1c415086] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:29,062 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-49) [1c415086] Engine managed to communicate with VDSM agent on host DC-85.215 >2014-04-09 13:36:29,678 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [1c415086] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.215. >2014-04-09 13:36:29,751 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-4-thread-49) [6fe10cc6] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 13:36:29,753 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-49) [6fe10cc6] START, SetupNetworksVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=cb715cd9-0fb4-44da-ad48-ff63a5bb91e0, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth0 {id=ab55afc2-bcda-4e83-b442-8baa2aa9873a, vdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, macAddress=00:21:86:93:f6:fd, networkName=rhevm, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.66.85.215, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 4a00d745 >2014-04-09 13:36:29,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-4-thread-49) [6fe10cc6] FINISH, SetupNetworksVDSCommand, log id: 4a00d745 >2014-04-09 13:36:33,417 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:33,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:35,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:35,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:37,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:37,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:39,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:39,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:41,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:41,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:43,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:43,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [6fe10cc6] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 13:36:46,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [6fe10cc6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.215. >2014-04-09 13:36:46,199 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-4-thread-49) [4c74ca50] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 13:36:46,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-4-thread-49) [4c74ca50] START, SetSafeNetworkConfigVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91), log id: 71f9aa6c >2014-04-09 13:36:46,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-4-thread-49) [4c74ca50] FINISH, SetSafeNetworkConfigVDSCommand, log id: 71f9aa6c >2014-04-09 13:36:46,237 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [4c74ca50] Correlation ID: 4c74ca50, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host DC-85.215 >2014-04-09 13:36:46,240 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [4c74ca50] START, SetVdsStatusVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, status=Initializing, nonOperationalReason=NONE), log id: 38b6e23c >2014-04-09 13:36:46,245 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [4c74ca50] FINISH, SetVdsStatusVDSCommand, log id: 38b6e23c >2014-04-09 13:36:46,245 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [4c74ca50] After Installation host DC-85.215, VDS >2014-04-09 13:36:46,262 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [4c74ca50] Correlation ID: 1c415086, Job ID: 9d447686-6db0-4ba0-8254-f63bb0c4c344, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.215 installed >2014-04-09 13:36:46,271 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [4c74ca50] Lock freed to object EngineLock [exclusiveLocks= key: 6c442434-1073-4f29-a3bd-c20b77a28d91 value: VDS >, sharedLocks= ] >2014-04-09 13:36:47,720 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.215. >2014-04-09 13:36:47,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GetHardwareInfoVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215]), log id: 7821b8f >2014-04-09 13:36:47,834 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GetHardwareInfoVDSCommand, log id: 7821b8f >2014-04-09 13:36:47,920 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host DC-85.215. >2014-04-09 13:36:47,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GetHardwareInfoVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215]), log id: e0057f9 >2014-04-09 13:36:47,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GetHardwareInfoVDSCommand, log id: e0057f9 >2014-04-09 13:36:47,979 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host DC-85.215. >2014-04-09 13:36:47,989 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-41) [124ebec] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 13:36:47,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-41) [124ebec] START, SetMOMPolicyParametersVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91), log id: 2677056d >2014-04-09 13:36:48,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-41) [124ebec] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2677056d >2014-04-09 13:36:48,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) [124ebec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host DC-85.215. >2014-04-09 13:36:48,115 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-41) [412860a2] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 13:36:48,119 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 13:36:57,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.215 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:37:09,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-04-09 13:37:09,891 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-13) Start refreshing all users data >2014-04-09 13:37:09,891 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 13:37:10,127 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-70) START, UpdateVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 235a903f >2014-04-09 13:37:10,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, UpdateVMVDSCommand, log id: 235a903f >2014-04-09 13:37:10,226 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 13:37:10,226 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 13:37:10,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 13:37:10,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 13:37:10,242 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 13:39:18,601 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-14) [6d5a4051] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 13:39:18,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [6d5a4051] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=k4dMlAC/fpeZ, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5a31665d >2014-04-09 13:39:18,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [6d5a4051] FINISH, SetVmTicketVDSCommand, log id: 5a31665d >2014-04-09 13:39:18,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [6d5a4051] Correlation ID: 6d5a4051, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 13:39:27,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 6af8537f >2014-04-09 13:39:27,999 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [4c9c0a9] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 13:39:28,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [4c9c0a9] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=plN0Fc60FRfL, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 2cec185c >2014-04-09 13:39:28,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [4c9c0a9] FINISH, SetVmTicketVDSCommand, log id: 2cec185c >2014-04-09 13:39:28,183 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [4c9c0a9] Correlation ID: 4c9c0a9, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 13:39:35,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetDeviceListVDSCommand, return: [], log id: 6af8537f >2014-04-09 13:39:45,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp-/127.0.0.1:8702-1) START, DiscoverSendTargetsVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, connection={ id: null, connection: 10.66.90.100, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };), log id: 44ef3b4c >2014-04-09 13:39:45,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, DiscoverSendTargetsVDSCommand, return: [{ id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-12a1f7d03-0daf49b25a84ee02-s3-kyla-131842, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-6eb1f7d03-30cf49b25f24f94d-libvirt-1-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-1661f7d03-5e9f49b2673503d8-s3-bcao-166669-81, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-18d1f7d03-a35f49b2675503d8-s3-bcao-166669-82, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-42a1f7d03-0a3f49b42065281e-s3-jiahu-265383-1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], log id: 44ef3b4c >2014-04-09 13:40:12,761 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-34) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:40:18,702 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-16) [72ec5726] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:40:18,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-16) [72ec5726] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-6eb1f7d03-30cf49b25f24f94d-libvirt-1-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 406723b >2014-04-09 13:40:29,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-16) [72ec5726] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 406723b >2014-04-09 13:40:29,378 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 3a196e4d >2014-04-09 13:40:39,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123], log id: 3a196e4d >2014-04-09 13:41:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-4) [7cecad2e] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:41:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-4) [7cecad2e] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 50717524 >2014-04-09 13:41:10,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-4) [7cecad2e] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 50717524 >2014-04-09 13:41:10,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-17) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 5373ef25 >2014-04-09 13:41:19,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-17) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123, org.ovirt.engine.core.common.businessentities.LUNs@f765ed73], log id: 5373ef25 >2014-04-09 13:41:54,965 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:41:54,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] START, CreateVGVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, deviceList=[36090a038d0f751994bf9045fb249cf34], force=true), log id: 79fde3f9 >2014-04-09 13:41:56,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] FINISH, CreateVGVDSCommand, return: rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY, log id: 79fde3f9 >2014-04-09 13:41:56,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] START, CreateStorageDomainVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@a8cbfcf7, args=rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY), log id: 30847dcf >2014-04-09 13:42:02,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] FINISH, CreateStorageDomainVDSCommand, log id: 30847dcf >2014-04-09 13:42:02,842 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] START, GetStorageDomainStatsVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78), log id: 5f16ac1 >2014-04-09 13:42:03,077 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@122b1ee7, log id: 5f16ac1 >2014-04-09 13:42:03,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] START, GetVGInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, VGID=rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY), log id: 571fee2b >2014-04-09 13:42:03,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-16) [5afa3291] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@c7e5025f], log id: 571fee2b >2014-04-09 13:42:03,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [5afa3291] Correlation ID: 5afa3291, Job ID: 043ffccd-bd7a-4085-b78d-5c0baab8af69, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_1 was added by admin@internal >2014-04-09 13:42:03,440 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-1) [26266589] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:42:03,442 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-1) [57faf49d] Lock Acquired to object EngineLock [exclusiveLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >, sharedLocks= ] >2014-04-09 13:42:03,447 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-1) [57faf49d] Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 13:42:03,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-1) [57faf49d] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: 9cfbeb6a-9870-4034-bc38-385f924f0d70, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 57f26bc7 >2014-04-09 13:42:03,626 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-1) [57faf49d] FINISH, ConnectStorageServerVDSCommand, return: {9cfbeb6a-9870-4034-bc38-385f924f0d70=0}, log id: 57f26bc7 >2014-04-09 13:42:03,632 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [489b011c] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:42:03,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-1) [489b011c] START, GetVGInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, VGID=rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY), log id: 4e1bdcf3 >2014-04-09 13:42:03,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-1) [489b011c] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@c7e5025f], log id: 4e1bdcf3 >2014-04-09 13:42:03,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [489b011c] START, CreateStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType=ISCSI, storagePoolName=dc_iscsi, masterDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, domainsIdList=[e5613c67-ce49-4a35-b8f2-2df469d0fc78], masterVersion=1), log id: 57294c67 >2014-04-09 13:42:41,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [489b011c] FINISH, CreateStoragePoolVDSCommand, log id: 57294c67 >2014-04-09 13:42:41,293 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-1) [489b011c] Lock freed to object EngineLock [exclusiveLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >, sharedLocks= ] >2014-04-09 13:42:41,294 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [22ab1c5d] Lock Acquired to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >, sharedLocks= ] >2014-04-09 13:42:41,302 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [22ab1c5d] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:42:41,310 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [22ab1c5d] Lock freed to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >, sharedLocks= ] >2014-04-09 13:42:41,310 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [22ab1c5d] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 1:42 PM >2014-04-09 13:42:41,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [22ab1c5d] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: 9cfbeb6a-9870-4034-bc38-385f924f0d70, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44e7289a >2014-04-09 13:42:41,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [22ab1c5d] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: 9cfbeb6a-9870-4034-bc38-385f924f0d70, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 569c543f >2014-04-09 13:42:41,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [22ab1c5d] FINISH, ConnectStorageServerVDSCommand, return: {9cfbeb6a-9870-4034-bc38-385f924f0d70=0}, log id: 569c543f >2014-04-09 13:42:41,412 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-47) [15068a95] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:42:41,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-47) [15068a95] START, GetVGInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, VGID=rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY), log id: 2aebc14a >2014-04-09 13:42:41,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-47) [15068a95] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@c7e5025f], log id: 2aebc14a >2014-04-09 13:42:51,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [22ab1c5d] FINISH, ConnectStorageServerVDSCommand, return: {9cfbeb6a-9870-4034-bc38-385f924f0d70=0}, log id: 44e7289a >2014-04-09 13:42:51,849 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-35) [555c038a] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:42:51,856 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] START, GetVGInfoVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, VGID=rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY), log id: 614f8d74 >2014-04-09 13:42:52,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] Failed in GetVGInfoVDS method >2014-04-09 13:42:52,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] Error code VolumeGroupDoesNotExist and error message VDSGenericException: VDSErrorException: Failed to GetVGInfoVDS, error = Volume Group does not exist: ('vg_uuid: rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY',) >2014-04-09 13:42:52,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand return value > >OneVGReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=506, mMessage=Volume Group does not exist: ('vg_uuid: rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY',)]] > >2014-04-09 13:42:52,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] HostName = DC-85.215 >2014-04-09 13:42:52,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] Command GetVGInfoVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVGInfoVDS, error = Volume Group does not exist: ('vg_uuid: rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY',) >2014-04-09 13:42:52,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-35) [555c038a] FINISH, GetVGInfoVDSCommand, log id: 614f8d74 >2014-04-09 13:42:52,102 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-35) [555c038a] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVGInfoVDS, error = Volume Group does not exist: ('vg_uuid: rsU1w5-L17Q-JOAu-5VWY-AnIB-gDfO-CyDncY',) (Failed with error VolumeGroupDoesNotExist and code 506) >2014-04-09 13:42:52,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-1) [22ab1c5d] START, ActivateStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78), log id: 414cc567 >2014-04-09 13:42:52,128 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp-/127.0.0.1:8702-1) [4e720821] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 13:42:52,150 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [4e720821] Correlation ID: 4e720821, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. >2014-04-09 13:42:52,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-1) [4e720821] hostFromVds::selectedVds - DC-85.215, spmStatus Unknown_Pool, storage pool dc_iscsi >2014-04-09 13:42:52,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] START, ConnectStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, vds_spm_id = 3, masterDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion = 1), log id: 31f9530a >2014-04-09 13:42:58,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] FINISH, ConnectStoragePoolVDSCommand, log id: 31f9530a >2014-04-09 13:42:58,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-1) [4e720821] hostFromVds::Connected host to pool - selectedVds - DC-85.215, spmStatus Free, storage pool dc_iscsi >2014-04-09 13:42:58,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-1) [4e720821] starting spm on vds DC-85.215, storage pool dc_iscsi, prevId -1, LVER -1 >2014-04-09 13:42:58,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] START, SpmStartVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7d206f28 >2014-04-09 13:42:58,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] spmStart polling started: taskId = 67f3c6f8-5199-45f4-8850-e000364cee5b >2014-04-09 13:43:21,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] spmStart polling ended: taskId = 67f3c6f8-5199-45f4-8850-e000364cee5b task status = finished >2014-04-09 13:43:21,686 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] spmStart polling ended, spm status: SPM >2014-04-09 13:43:21,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=67f3c6f8-5199-45f4-8850-e000364cee5b), log id: 453158e4 >2014-04-09 13:43:21,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] FINISH, HSMClearTaskVDSCommand, log id: 453158e4 >2014-04-09 13:43:21,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@221b3718, log id: 7d206f28 >2014-04-09 13:43:21,721 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (ajp-/127.0.0.1:8702-1) [4e720821] Initialize Irs proxy from vds: 10.66.85.215 >2014-04-09 13:43:21,738 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [4e720821] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host DC-85.215 (Address: 10.66.85.215). >2014-04-09 13:43:21,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-1) [4e720821] FINISH, ActivateStorageDomainVDSCommand, log id: 414cc567 >2014-04-09 13:43:21,758 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [4e720821] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 1:43 PM >2014-04-09 13:43:21,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-35) [4e720821] START, ConnectStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, vds_spm_id = 2, masterDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion = 1), log id: 7156f58 >2014-04-09 13:43:21,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-47) [4e720821] START, ConnectStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, vds_spm_id = 3, masterDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion = 1), log id: 1040fe0a >2014-04-09 13:43:21,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-47) [4e720821] FINISH, ConnectStoragePoolVDSCommand, log id: 1040fe0a >2014-04-09 13:43:34,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-35) [4e720821] FINISH, ConnectStoragePoolVDSCommand, log id: 7156f58 >2014-04-09 13:43:34,186 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [4e720821] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 1:43 PM >2014-04-09 13:43:34,203 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [4e720821] Correlation ID: 22ab1c5d, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_1 (Data Center dc_iscsi) was activated by admin@internal >2014-04-09 13:43:34,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [4e720821] Correlation ID: 57faf49d, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center dc_iscsi by admin@internal >2014-04-09 13:43:34,219 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [4e720821] Correlation ID: 26266589, Job ID: e4ea8356-a9e7-4696-bea4-ca554ad6ce87, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_1 was attached to Data Center dc_iscsi by admin@internal >2014-04-09 13:45:24,296 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-4) [5f6a273e] Lock Acquired to object EngineLock [exclusiveLocks= key: vm_vnc value: VM_NAME >, sharedLocks= ] >2014-04-09 13:45:24,331 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-4) [5f6a273e] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 13:45:24,406 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [5f6a273e] Correlation ID: 5f6a273e, Job ID: 1628692c-c76d-4dc3-9404-b97976ac91d0, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc was created by admin@internal. >2014-04-09 13:45:24,414 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-4) [5f6a273e] Lock freed to object EngineLock [exclusiveLocks= key: vm_vnc value: VM_NAME >, sharedLocks= ] >2014-04-09 13:45:24,473 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-47) [5a6117e6] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM, ID: 06b6a7c0-599a-4f36-8c3f-d66c7e741d47 Type: VnicProfile >2014-04-09 13:45:24,485 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-2) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 13:45:24,497 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-6) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 13:45:24,534 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-47) [35b77a86] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 13:45:24,573 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [35b77a86] Correlation ID: 35b77a86, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm_vnc. (User: admin@internal) >2014-04-09 13:45:24,602 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [35b77a86] Correlation ID: 5a6117e6, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm_vnc. (User: admin@internal) >2014-04-09 13:45:36,883 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-15) [5a24bb4c] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM_DISK_BOOT >, sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 13:45:36,913 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-15) [5a24bb4c] Running command: AddDiskCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM, ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:45:37,005 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-15) [1898e564] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: e5613c67-ce49-4a35-b8f2-2df469d0fc78 Type: Storage >2014-04-09 13:45:37,030 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-15) [1898e564] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM_DISK_BOOT >, sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 13:45:37,030 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [1898e564] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageSizeInBytes = 8589934592, volumeFormat = RAW, newImageId = a7592631-638d-427c-af5e-58b92e75e40b, newImageDescription = ), log id: 53da8209 >2014-04-09 13:45:37,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [1898e564] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 13:45:37,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [1898e564] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > size=8,589,934,592 bytes > volFormat=RAW > volType=Preallocated > volUUID=a7592631-638d-427c-af5e-58b92e75e40b > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 13:45:37,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [1898e564] FINISH, CreateImageVDSCommand, return: a7592631-638d-427c-af5e-58b92e75e40b, log id: 53da8209 >2014-04-09 13:45:37,197 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-15) [1898e564] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 2031efdb-87f7-4307-a8e8-093a2057e43b >2014-04-09 13:45:37,197 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-15) [1898e564] CommandMultiAsyncTasks::AttachTask: Attaching task b9de71b9-aef7-48db-aa2d-2139ec7f79f5 to command 2031efdb-87f7-4307-a8e8-093a2057e43b. >2014-04-09 13:45:37,213 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-15) [1898e564] Adding task b9de71b9-aef7-48db-aa2d-2139ec7f79f5 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 13:45:37,263 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [1898e564] Correlation ID: 5a24bb4c, Job ID: 5647e9ae-3c66-438b-a4b8-886bc9cee851, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm_vnc_Disk1 was initiated on VM vm_vnc by admin@internal. >2014-04-09 13:45:37,263 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-15) [1898e564] BaseAsyncTask::StartPollingTask: Starting to poll task b9de71b9-aef7-48db-aa2d-2139ec7f79f5. >2014-04-09 13:45:41,741 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 13:45:41,754 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) SPMAsyncTask::PollTask: Polling task b9de71b9-aef7-48db-aa2d-2139ec7f79f5 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 13:45:41,772 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) BaseAsyncTask::OnTaskEndSuccess: Task b9de71b9-aef7-48db-aa2d-2139ec7f79f5 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 13:45:41,773 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) CommandAsyncTask::EndActionIfNecessary: All tasks of command 2031efdb-87f7-4307-a8e8-093a2057e43b has ended -> executing EndAction >2014-04-09 13:45:41,773 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 2031efdb-87f7-4307-a8e8-093a2057e43b): calling EndAction . >2014-04-09 13:45:41,773 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-09 13:45:41,797 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-35) [5a24bb4c] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-09 13:45:41,805 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-35) [1898e564] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-09 13:45:41,820 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [1898e564] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = a7592631-638d-427c-af5e-58b92e75e40b), log id: 4698d654 >2014-04-09 13:45:42,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [1898e564] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@38689364, log id: 4698d654 >2014-04-09 13:45:42,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) Correlation ID: 5a24bb4c, Job ID: 5647e9ae-3c66-438b-a4b8-886bc9cee851, Call Stack: null, Custom Event ID: -1, Message: The disk vm_vnc_Disk1 was successfully added to VM vm_vnc. >2014-04-09 13:45:42,097 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-09 13:45:42,097 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-09 13:45:42,106 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b9de71b9-aef7-48db-aa2d-2139ec7f79f5 >2014-04-09 13:45:42,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = b9de71b9-aef7-48db-aa2d-2139ec7f79f5), log id: 6d3314c9 >2014-04-09 13:45:42,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=b9de71b9-aef7-48db-aa2d-2139ec7f79f5), log id: 5e2f4181 >2014-04-09 13:45:42,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) FINISH, HSMClearTaskVDSCommand, log id: 5e2f4181 >2014-04-09 13:45:42,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) FINISH, SPMClearTaskVDSCommand, log id: 6d3314c9 >2014-04-09 13:45:42,131 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::RemoveTaskFromDB: Removed task b9de71b9-aef7-48db-aa2d-2139ec7f79f5 from DataBase >2014-04-09 13:45:42,139 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 2031efdb-87f7-4307-a8e8-093a2057e43b >2014-04-09 13:45:43,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 29eb429d >2014-04-09 13:45:43,635 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetDeviceListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageType=ISCSI), log id: 3f4df6f3 >2014-04-09 13:45:46,115 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-8) [3a720bd0] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 13:45:46,127 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-8) [3a720bd0] START, IsVmDuringInitiatingVDSCommand( vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 4d571198 >2014-04-09 13:45:46,128 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-8) [3a720bd0] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4d571198 >2014-04-09 13:45:46,213 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [3a720bd0] Running command: RunVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 13:45:46,282 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [3a720bd0] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 44c24343 >2014-04-09 13:45:46,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [3a720bd0] FINISH, IsoPrefixVDSCommand, return: , log id: 44c24343 >2014-04-09 13:45:46,305 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [3a720bd0] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, vm=VM [vm_vnc]), log id: 51ae3e46 >2014-04-09 13:45:46,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [3a720bd0] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, vm=VM [vm_vnc]), log id: 53c5a8b9 >2014-04-09 13:45:46,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [3a720bd0] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=vnc,smartcardEnable=false,tabletEnable=true,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc,devices=[Ljava.util.HashMap;@3d45dc17,acpiEnable=true,vmName=vm_vnc,cpuType=Conroe,custom={} >2014-04-09 13:45:46,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [3a720bd0] FINISH, CreateVDSCommand, log id: 53c5a8b9 >2014-04-09 13:45:46,447 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [3a720bd0] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 51ae3e46 >2014-04-09 13:45:46,447 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [3a720bd0] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 13:45:46,455 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [3a720bd0] Correlation ID: 3a720bd0, Job ID: 02ffcf94-6f8f-4a64-8c20-ad5e1a4395d5, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc was started by admin@internal (Host: DC-85.218). >2014-04-09 13:45:46,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@24548aff], log id: 3f4df6f3 >2014-04-09 13:45:47,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-76) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 4479be13 >2014-04-09 13:45:47,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-76) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@289010b7, log id: 4479be13 >2014-04-09 13:45:47,214 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Received a cirrus Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {specParams={vram=32768, heads=1}, device=cirrus, type=video, deviceId=efaabf3d-dd6b-4213-af13-372373f514c0} >2014-04-09 13:45:47,214 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Received a cdrom Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=b5ede0c9-26fb-45ae-9e6b-48dcb2d24e97} >2014-04-09 13:45:47,214 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Received a disk Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {shared=false, index=0, volumeID=a7592631-638d-427c-af5e-58b92e75e40b, propagateErrors=off, format=raw, type=disk, truesize=8589934592, reqsize=0, iface=virtio, imageID=5d1d405b-6c8d-4973-8e80-c11555885cc5, domainID=e5613c67-ce49-4a35-b8f2-2df469d0fc78, specParams={}, optional=false, device=disk, poolID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, readonly=false, apparentsize=8589934592, deviceId=5d1d405b-6c8d-4973-8e80-c11555885cc5} >2014-04-09 13:45:47,214 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Received a bridge Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {bootOrder=1, nicModel=pv, specParams={}, device=bridge, macAddr=00:01:a4:a5:a5:06, linkActive=true, type=interface, deviceId=90f66977-0422-40c9-a426-b682966dc942, filter=vdsm-no-mac-spoofing, network=rhevm} >2014-04-09 13:45:47,214 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Received a memballoon Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {specParams={model=virtio}, target=1048576, device=memballoon, type=balloon, deviceId=51a052a9-d1da-44ab-a493-41a81f5e9e0c} >2014-04-09 13:45:47,214 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) Received a scsi Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=0533996b-0837-4e8e-8d80-ef93ba3238b7} >2014-04-09 13:45:50,315 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from WaitForLaunch --> PoweringUp >2014-04-09 13:45:50,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-49) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 680dfea9 >2014-04-09 13:45:50,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-49) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@1fd4ee3e, log id: 680dfea9 >2014-04-09 13:45:54,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123, org.ovirt.engine.core.common.businessentities.LUNs@8f6fd83e], log id: 29eb429d >2014-04-09 13:45:57,592 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [5d81f4ec] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 13:45:57,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [5d81f4ec] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=tx9CSKYbJ5sS, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 6000f523 >2014-04-09 13:45:57,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [5d81f4ec] FINISH, SetVmTicketVDSCommand, log id: 6000f523 >2014-04-09 13:45:57,729 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [5d81f4ec] Correlation ID: 5d81f4ec, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 13:46:48,763 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) [40980259] VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from PoweringUp --> Up >2014-04-09 13:46:48,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [40980259] Correlation ID: 3a720bd0, Job ID: 02ffcf94-6f8f-4a64-8c20-ad5e1a4395d5, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc started on Host DC-85.218 >2014-04-09 13:47:06,446 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-91) Setting new tasks map. The map contains now 0 tasks >2014-04-09 13:47:06,447 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-91) Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 13:50:58,927 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 6b4d06e1 >2014-04-09 13:50:58,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetDeviceListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageType=ISCSI), log id: 6cda98b4 >2014-04-09 13:51:02,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@24548aff], log id: 6cda98b4 >2014-04-09 13:51:06,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123, org.ovirt.engine.core.common.businessentities.LUNs@8f6fd83e], log id: 6b4d06e1 >2014-04-09 13:51:47,571 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [5f89a9b] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:51:47,593 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [5f89a9b] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:51:47,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-10) [5f89a9b] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 56592f64 >2014-04-09 13:51:47,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-10) [5f89a9b] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 56592f64 >2014-04-09 13:51:47,768 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [5f89a9b] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 13:51:47,893 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:51:47,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 54268878 >2014-04-09 13:51:47,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 54268878 >2014-04-09 13:51:47,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] START, CreateStorageDomainVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@b47ef6b9, args=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1), log id: 44302ad4 >2014-04-09 13:51:52,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] FINISH, CreateStorageDomainVDSCommand, log id: 44302ad4 >2014-04-09 13:51:52,052 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] START, GetStorageDomainStatsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76), log id: 1c117663 >2014-04-09 13:51:52,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-13) [c81bd95] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@306c4db9, log id: 1c117663 >2014-04-09 13:51:52,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [c81bd95] Correlation ID: c81bd95, Job ID: e4cc622f-5653-4839-8e87-8fe0e2e7bca4, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain3 was added by admin@internal >2014-04-09 13:51:52,229 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-7) [320ae847] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:51:52,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-7) [320ae847] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 257d74c >2014-04-09 13:51:55,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-7) [320ae847] FINISH, DisconnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 257d74c >2014-04-09 13:51:55,621 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-11) [2ef9b5ae] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-09 13:51:55,648 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-35) [704ea5ae] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:51:55,648 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [3b5f7c1c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:51:55,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [704ea5ae] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 70af93e8 >2014-04-09 13:51:55,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [3b5f7c1c] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17179e24 >2014-04-09 13:51:55,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [704ea5ae] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 70af93e8 >2014-04-09 13:51:55,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [3b5f7c1c] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 17179e24 >2014-04-09 13:51:55,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [2ef9b5ae] START, AttachStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76), log id: 295b4d20 >2014-04-09 13:52:23,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [2ef9b5ae] FINISH, AttachStorageDomainVDSCommand, log id: 295b4d20 >2014-04-09 13:52:23,197 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [7604d487] Lock Acquired to object EngineLock [exclusiveLocks= key: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 value: STORAGE >, sharedLocks= ] >2014-04-09 13:52:23,220 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [7604d487] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-09 13:52:23,233 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [7604d487] Lock freed to object EngineLock [exclusiveLocks= key: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 value: STORAGE >, sharedLocks= ] >2014-04-09 13:52:23,233 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [7604d487] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 1:52 PM >2014-04-09 13:52:23,238 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-35) [4e63c684] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:52:23,239 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [1f8b4748] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 13:52:23,243 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [1f8b4748] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6a44e8f8 >2014-04-09 13:52:23,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [4e63c684] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74922f0b >2014-04-09 13:52:23,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [1f8b4748] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 6a44e8f8 >2014-04-09 13:52:23,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [4e63c684] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 74922f0b >2014-04-09 13:52:23,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [7604d487] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76), log id: d1d5214 >2014-04-09 13:52:26,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [7604d487] FINISH, ActivateStorageDomainVDSCommand, log id: d1d5214 >2014-04-09 13:52:26,496 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [7604d487] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 1:52 PM >2014-04-09 13:52:26,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-35) [7604d487] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 6e270311 >2014-04-09 13:52:26,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [7604d487] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 433a8996 >2014-04-09 13:52:26,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-35) [7604d487] FINISH, RefreshStoragePoolVDSCommand, log id: 6e270311 >2014-04-09 13:52:26,521 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-35) [7604d487] Refreshed vds 10.66.106.32 in pool NFS_shyu >2014-04-09 13:52:28,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [7604d487] FINISH, RefreshStoragePoolVDSCommand, log id: 433a8996 >2014-04-09 13:52:28,961 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-49) [7604d487] Refreshed vds 10.66.106.40 in pool NFS_shyu >2014-04-09 13:52:28,982 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [7604d487] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 1:52 PM >2014-04-09 13:52:28,999 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [7604d487] Correlation ID: 7604d487, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain3 (Data Center NFS_shyu) was activated by admin@internal >2014-04-09 13:52:29,016 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [7604d487] Correlation ID: 2ef9b5ae, Job ID: 048c3726-550f-4d50-ae6f-805f3e8b0e52, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain3 was attached to Data Center NFS_shyu by admin@internal >2014-04-09 13:54:36,239 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-31) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from Up --> RebootInProgress >2014-04-09 13:54:36,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-31) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 6f9fea39 >2014-04-09 13:54:36,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-31) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@6bca7d6f, log id: 6f9fea39 >2014-04-09 13:54:36,316 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 13:55:37,411 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-47) [1ad889f5] VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from RebootInProgress --> Up >2014-04-09 14:02:07,109 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-13) [7381c8cd] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:02:07,145 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-13) [7381c8cd] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 14:02:07,362 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [7381c8cd] Correlation ID: 7381c8cd, Job ID: 988e799a-0fbf-41de-be1e-24159a9ded38, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was created by admin@internal. >2014-04-09 14:02:07,370 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-13) [7381c8cd] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:02:07,469 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-49) [29eb1af2] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-09 14:02:07,489 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-1) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 14:02:07,500 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-2) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 14:02:07,578 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-49) [2015986d] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:02:07,612 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [2015986d] Correlation ID: 2015986d, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm2. (User: admin@internal) >2014-04-09 14:02:07,637 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [2015986d] Correlation ID: 29eb1af2, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm2. (User: admin@internal) >2014-04-09 14:02:19,446 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Up --> RebootInProgress >2014-04-09 14:02:19,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-53) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 4583f2d9 >2014-04-09 14:02:19,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-53) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@59bca836, log id: 4583f2d9 >2014-04-09 14:02:43,798 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-3) [6c908032] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:02:43,832 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-3) [6c908032] Running command: UpdateVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:02:43,915 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [6c908032] Correlation ID: 6c908032, Job ID: 20ce9240-c36e-4d59-80cb-61f48bd47af2, Call Stack: null, Custom Event ID: -1, Message: VM vm2 configuration was updated by admin@internal. >2014-04-09 14:02:43,924 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-3) [6c908032] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:02:44,019 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-6) MultipleActionsRunner of type AddVmInterface invoked with no actions >2014-04-09 14:02:44,047 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-14) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 14:02:44,074 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-8) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 14:02:45,906 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-5) [565dd127] Lock Acquired to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:02:45,918 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [565dd127] START, IsVmDuringInitiatingVDSCommand( vmId = e7983b62-8992-42a8-afd7-f7b815d80bbb), log id: 162dc364 >2014-04-09 14:02:45,918 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [565dd127] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 162dc364 >2014-04-09 14:02:46,007 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [565dd127] Running command: RunVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:02:46,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [565dd127] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 614ca366 >2014-04-09 14:02:46,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [565dd127] FINISH, IsoPrefixVDSCommand, return: , log id: 614ca366 >2014-04-09 14:02:46,102 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [565dd127] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, vm=VM [vm2]), log id: 24ebee1 >2014-04-09 14:02:46,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [565dd127] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, vm=VM [vm2]), log id: 4df7181a >2014-04-09 14:02:46,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [565dd127] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb,devices=[Ljava.util.HashMap;@7b6abe89,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={} >2014-04-09 14:02:46,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [565dd127] FINISH, CreateVDSCommand, log id: 4df7181a >2014-04-09 14:02:46,199 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [565dd127] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 24ebee1 >2014-04-09 14:02:46,199 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [565dd127] Lock freed to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:02:46,207 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [565dd127] Correlation ID: 565dd127, Job ID: cbe7d888-155d-4a65-bf2f-572a61dc6e62, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:02:47,549 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-77) VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb moved from WaitForLaunch --> PoweringUp >2014-04-09 14:02:47,550 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-77) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[e7983b62-8992-42a8-afd7-f7b815d80bbb]), log id: 3a4875ec >2014-04-09 14:02:47,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-77) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@6b35f6d8, log id: 3a4875ec >2014-04-09 14:03:20,456 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-57) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from RebootInProgress --> Up >2014-04-09 14:03:48,634 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) [3ea46189] VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb moved from PoweringUp --> Up >2014-04-09 14:03:48,675 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [3ea46189] Correlation ID: 565dd127, Job ID: cbe7d888-155d-4a65-bf2f-572a61dc6e62, Call Stack: null, Custom Event ID: -1, Message: VM vm2 started on Host 10.66.106.32 >2014-04-09 14:03:57,883 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (ajp-/127.0.0.1:8702-7) [210bbad7] Lock Acquired to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:03:58,016 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-47) [210bbad7] Running command: HibernateVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:03:58,033 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-47) [210bbad7] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@49035811), log id: 6886f399 >2014-04-09 14:03:58,035 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-47) [210bbad7] FINISH, UpdateVmDynamicDataVDSCommand, log id: 6886f399 >2014-04-09 14:03:58,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = d79d4283-fcad-41d7-99c9-ac8f2cf21208, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 151ae4a4-9f27-411d-936a-3e6dbf40c5b1, newImageDescription = ), log id: 565ebc99 >2014-04-09 14:03:58,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:03:58,044 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] -- createVolume parameters: > sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=d79d4283-fcad-41d7-99c9-ac8f2cf21208 > size=1,350,565,888 bytes > volFormat=RAW > volType=Sparse > volUUID=151ae4a4-9f27-411d-936a-3e6dbf40c5b1 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:03:58,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] FINISH, CreateImageVDSCommand, return: 151ae4a4-9f27-411d-936a-3e6dbf40c5b1, log id: 565ebc99 >2014-04-09 14:03:58,319 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) [210bbad7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ff94c6a5-1638-4b4e-a251-b925087fbf3e >2014-04-09 14:03:58,319 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-47) [210bbad7] CommandMultiAsyncTasks::AttachTask: Attaching task 60c6d283-74d3-4f31-aeaf-3ded364e5986 to command ff94c6a5-1638-4b4e-a251-b925087fbf3e. >2014-04-09 14:03:58,327 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-47) [210bbad7] Adding task 60c6d283-74d3-4f31-aeaf-3ded364e5986 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:03:58,350 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 8e8c9f69-4e4e-44af-8d2b-e82b4496c118, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = ecccb83c-2094-4b8a-9026-a156afb37df9, newImageDescription = ), log id: 56c346a7 >2014-04-09 14:03:58,350 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:03:58,350 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] -- createVolume parameters: > sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=8e8c9f69-4e4e-44af-8d2b-e82b4496c118 > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=ecccb83c-2094-4b8a-9026-a156afb37df9 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:03:58,514 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-47) [210bbad7] FINISH, CreateImageVDSCommand, return: ecccb83c-2094-4b8a-9026-a156afb37df9, log id: 56c346a7 >2014-04-09 14:03:58,534 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-47) [210bbad7] CommandMultiAsyncTasks::AttachTask: Attaching task 8e831297-ac40-451e-a6dd-d2b71c18e427 to command ff94c6a5-1638-4b4e-a251-b925087fbf3e. >2014-04-09 14:03:58,557 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-47) [210bbad7] Adding task 8e831297-ac40-451e-a6dd-d2b71c18e427 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:03:58,577 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-47) [210bbad7] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@2b00b3ec), log id: 6b981563 >2014-04-09 14:03:58,582 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-47) [210bbad7] FINISH, UpdateVmDynamicDataVDSCommand, log id: 6b981563 >2014-04-09 14:03:58,599 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [210bbad7] Correlation ID: 210bbad7, Job ID: 0b5c63b1-a5ce-495f-b2cd-8f6b05b77899, Call Stack: null, Custom Event ID: -1, Message: Suspending VM vm2 was initiated by User admin@internal (Host: 10.66.106.32). >2014-04-09 14:03:58,599 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) [210bbad7] BaseAsyncTask::StartPollingTask: Starting to poll task 60c6d283-74d3-4f31-aeaf-3ded364e5986. >2014-04-09 14:03:58,599 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) [210bbad7] BaseAsyncTask::StartPollingTask: Starting to poll task 8e831297-ac40-451e-a6dd-d2b71c18e427. >2014-04-09 14:03:58,599 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-47) [210bbad7] Lock freed to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:04:00,797 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-82) VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb moved from PreparingForHibernate --> Up >2014-04-09 14:04:02,801 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-54) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-04-09 14:04:02,814 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) SPMAsyncTask::PollTask: Polling task 60c6d283-74d3-4f31-aeaf-3ded364e5986 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:04:02,824 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) BaseAsyncTask::OnTaskEndSuccess: Task 60c6d283-74d3-4f31-aeaf-3ded364e5986 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:04:02,824 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-54) Task with DB Task ID b026b7a2-557c-4dc7-ae4e-0d867aa6d400 and VDSM Task ID 8e831297-ac40-451e-a6dd-d2b71c18e427 is in state Polling. End action for command ff94c6a5-1638-4b4e-a251-b925087fbf3e will proceed when all the entitys tasks are completed. >2014-04-09 14:04:02,824 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) SPMAsyncTask::PollTask: Polling task 8e831297-ac40-451e-a6dd-d2b71c18e427 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:04:02,832 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) BaseAsyncTask::OnTaskEndSuccess: Task 8e831297-ac40-451e-a6dd-d2b71c18e427 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:04:02,832 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-54) CommandAsyncTask::EndActionIfNecessary: All tasks of command ff94c6a5-1638-4b4e-a251-b925087fbf3e has ended -> executing EndAction >2014-04-09 14:04:02,832 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-54) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: ff94c6a5-1638-4b4e-a251-b925087fbf3e): calling EndAction . >2014-04-09 14:04:02,833 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction Unknown, executionIndex: 0 >2014-04-09 14:04:02,857 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-47) Ending command successfully: org.ovirt.engine.core.bll.HibernateVmCommand >2014-04-09 14:04:02,862 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-47) START, HibernateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, hibernationVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,d79d4283-fcad-41d7-99c9-ac8f2cf21208,151ae4a4-9f27-411d-936a-3e6dbf40c5b1,8e8c9f69-4e4e-44af-8d2b-e82b4496c118,ecccb83c-2094-4b8a-9026-a156afb37df9), log id: 5fed8439 >2014-04-09 14:04:02,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-47) START, HibernateBrokerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, hibernationVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,d79d4283-fcad-41d7-99c9-ac8f2cf21208,151ae4a4-9f27-411d-936a-3e6dbf40c5b1,8e8c9f69-4e4e-44af-8d2b-e82b4496c118,ecccb83c-2094-4b8a-9026-a156afb37df9), log id: 663835a4 >2014-04-09 14:04:02,876 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-47) FINISH, HibernateBrokerVDSCommand, log id: 663835a4 >2014-04-09 14:04:02,890 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-47) FINISH, HibernateVDSCommand, log id: 5fed8439 >2014-04-09 14:04:02,892 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm completed, handling the result. >2014-04-09 14:04:02,892 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm succeeded, clearing tasks. >2014-04-09 14:04:02,899 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 60c6d283-74d3-4f31-aeaf-3ded364e5986 >2014-04-09 14:04:02,899 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 60c6d283-74d3-4f31-aeaf-3ded364e5986), log id: 31e72488 >2014-04-09 14:04:02,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=60c6d283-74d3-4f31-aeaf-3ded364e5986), log id: 3e0f7650 >2014-04-09 14:04:02,927 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 3e0f7650 >2014-04-09 14:04:02,928 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 31e72488 >2014-04-09 14:04:02,932 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 60c6d283-74d3-4f31-aeaf-3ded364e5986 from DataBase >2014-04-09 14:04:02,932 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8e831297-ac40-451e-a6dd-d2b71c18e427 >2014-04-09 14:04:02,932 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 8e831297-ac40-451e-a6dd-d2b71c18e427), log id: 23279ee8 >2014-04-09 14:04:02,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=8e831297-ac40-451e-a6dd-d2b71c18e427), log id: 7e31a35f >2014-04-09 14:04:02,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 7e31a35f >2014-04-09 14:04:02,964 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 23279ee8 >2014-04-09 14:04:02,974 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 8e831297-ac40-451e-a6dd-d2b71c18e427 from DataBase >2014-04-09 14:04:02,974 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ff94c6a5-1638-4b4e-a251-b925087fbf3e >2014-04-09 14:04:06,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-25) START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, force=false, secondsToWait=0, gracefully=false), log id: 3a824e18 >2014-04-09 14:04:07,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, DestroyVDSCommand, log id: 3a824e18 >2014-04-09 14:04:07,381 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm2 on Host 10.66.106.32 is suspended. >2014-04-09 14:04:07,384 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) vm vm2 running in db and not running in vds - add to rerun treatment. vds 10.66.106.32 >2014-04-09 14:04:19,863 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-49) [59c8bf62] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:04:19,886 INFO [org.ovirt.engine.core.bll.RemoveVmHibernationVolumesCommand] (pool-4-thread-49) [3c815ba7] Running command: RemoveVmHibernationVolumesCommand internal: true. >2014-04-09 14:04:19,932 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-49) [3c815ba7] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = d79d4283-fcad-41d7-99c9-ac8f2cf21208, postZeros = false, forceDelete = false), log id: 47140840 >2014-04-09 14:04:20,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-49) [3c815ba7] FINISH, DeleteImageGroupVDSCommand, log id: 47140840 >2014-04-09 14:04:20,088 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) [3c815ba7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76 >2014-04-09 14:04:20,088 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-49) [3c815ba7] CommandMultiAsyncTasks::AttachTask: Attaching task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 to command 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76. >2014-04-09 14:04:20,096 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-49) [3c815ba7] Adding task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:04:20,132 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-49) [3c815ba7] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 8e8c9f69-4e4e-44af-8d2b-e82b4496c118, postZeros = false, forceDelete = false), log id: 1557b4d3 >2014-04-09 14:04:20,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-49) [3c815ba7] FINISH, DeleteImageGroupVDSCommand, log id: 1557b4d3 >2014-04-09 14:04:20,224 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-49) [3c815ba7] CommandMultiAsyncTasks::AttachTask: Attaching task ce276d73-47ac-4647-8d24-81909adb627b to command 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76. >2014-04-09 14:04:20,238 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-49) [3c815ba7] Adding task ce276d73-47ac-4647-8d24-81909adb627b (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:04:20,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [3c815ba7] Correlation ID: 59c8bf62, Job ID: 4b63edf2-5461-4424-9f9e-04019f27c1cd, Call Stack: null, Custom Event ID: -1, Message: Suspended VM vm2 powered off by admin@internal. >2014-04-09 14:04:20,272 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) [3c815ba7] BaseAsyncTask::StartPollingTask: Starting to poll task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583. >2014-04-09 14:04:20,272 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) [3c815ba7] BaseAsyncTask::StartPollingTask: Starting to poll task ce276d73-47ac-4647-8d24-81909adb627b. >2014-04-09 14:04:22,835 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-04-09 14:04:22,847 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) SPMAsyncTask::PollTask: Polling task ce276d73-47ac-4647-8d24-81909adb627b (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:04:22,863 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) BaseAsyncTask::OnTaskEndSuccess: Task ce276d73-47ac-4647-8d24-81909adb627b (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:04:22,863 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-20) Task with DB Task ID ed40f510-eb7b-43d5-acb0-d63af405c287 and VDSM Task ID 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 is in state Polling. End action for command 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76 will proceed when all the entitys tasks are completed. >2014-04-09 14:04:22,863 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) SPMAsyncTask::PollTask: Polling task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:04:22,871 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) BaseAsyncTask::OnTaskEndSuccess: Task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:04:22,872 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) CommandAsyncTask::EndActionIfNecessary: All tasks of command 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76 has ended -> executing EndAction >2014-04-09 14:04:22,872 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76): calling EndAction . >2014-04-09 14:04:22,872 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction ShutdownVm, executionIndex: 0 >2014-04-09 14:04:22,888 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-49) Ending command successfully: org.ovirt.engine.core.bll.ShutdownVmCommand >2014-04-09 14:04:22,905 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type ShutdownVm completed, handling the result. >2014-04-09 14:04:22,905 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type ShutdownVm succeeded, clearing tasks. >2014-04-09 14:04:22,913 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 >2014-04-09 14:04:22,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 4af5b10b-cab1-48ef-9cb6-cecc8aae6583), log id: 5065d563 >2014-04-09 14:04:22,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=4af5b10b-cab1-48ef-9cb6-cecc8aae6583), log id: 4d9c7fd1 >2014-04-09 14:04:22,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 4d9c7fd1 >2014-04-09 14:04:22,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 5065d563 >2014-04-09 14:04:22,938 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 4af5b10b-cab1-48ef-9cb6-cecc8aae6583 from DataBase >2014-04-09 14:04:22,938 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ce276d73-47ac-4647-8d24-81909adb627b >2014-04-09 14:04:22,938 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = ce276d73-47ac-4647-8d24-81909adb627b), log id: 33ad7b0f >2014-04-09 14:04:22,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=ce276d73-47ac-4647-8d24-81909adb627b), log id: 426a304a >2014-04-09 14:04:22,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 426a304a >2014-04-09 14:04:22,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 33ad7b0f >2014-04-09 14:04:22,963 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task ce276d73-47ac-4647-8d24-81909adb627b from DataBase >2014-04-09 14:04:22,963 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 9ebfe630-ebb9-45e9-93b9-5f430ef7ba76 >2014-04-09 14:04:31,311 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-17) [7d62c3db] Lock Acquired to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:04:31,323 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-17) [7d62c3db] START, IsVmDuringInitiatingVDSCommand( vmId = e7983b62-8992-42a8-afd7-f7b815d80bbb), log id: 33315557 >2014-04-09 14:04:31,323 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-17) [7d62c3db] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 33315557 >2014-04-09 14:04:31,404 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-47) [7d62c3db] Running command: RunVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:04:31,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-47) [7d62c3db] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 324830ce >2014-04-09 14:04:31,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-47) [7d62c3db] FINISH, IsoPrefixVDSCommand, return: , log id: 324830ce >2014-04-09 14:04:31,541 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-47) [7d62c3db] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, vm=VM [vm2]), log id: 438784cf >2014-04-09 14:04:31,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-47) [7d62c3db] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, vm=VM [vm2]), log id: 7a90b3a2 >2014-04-09 14:04:31,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-47) [7d62c3db] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb,devices=[Ljava.util.HashMap;@538c34e2,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6device_b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393device_dd7e8d59-db54-4af8-8057-88de79e551e6=VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=dd7e8d59-db54-4af8-8057-88de79e551e6, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6device_b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393device_dd7e8d59-db54-4af8-8057-88de79e551e6device_27141e9c-b22f-49a1-8250-f14f47399713=VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=27141e9c-b22f-49a1-8250-f14f47399713, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6=VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=81c0f662-628a-46eb-a120-af0564ccf0b6, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6device_b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393=VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6=VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=c1ed2d60-8ac3-4a54-a28f-130a6b1484d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}} >2014-04-09 14:04:31,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-47) [7d62c3db] FINISH, CreateVDSCommand, log id: 7a90b3a2 >2014-04-09 14:04:31,637 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-47) [7d62c3db] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 438784cf >2014-04-09 14:04:31,637 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-47) [7d62c3db] Lock freed to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:04:31,645 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [7d62c3db] Correlation ID: 7d62c3db, Job ID: ec936f3b-fb80-433b-902c-6a9058ee92bf, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:04:31,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-96) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[e7983b62-8992-42a8-afd7-f7b815d80bbb]), log id: 6cde9286 >2014-04-09 14:04:31,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-96) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@865d341, log id: 6cde9286 >2014-04-09 14:04:31,828 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) Received a memballoon Device without an address when processing VM e7983b62-8992-42a8-afd7-f7b815d80bbb devices, skipping device: {specParams={model=virtio}, target=1048576, device=memballoon, type=balloon, deviceId=2491b314-5a52-4196-893f-d07d4fa06335} >2014-04-09 14:04:34,947 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb moved from WaitForLaunch --> PoweringUp >2014-04-09 14:04:34,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-78) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[e7983b62-8992-42a8-afd7-f7b815d80bbb]), log id: 1222210f >2014-04-09 14:04:34,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-78) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@7ea86915, log id: 1222210f >2014-04-09 14:04:39,449 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-12) [558adc7b] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:04:39,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-12) [558adc7b] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=IQUzwsRhwTmH, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1951f7c3 >2014-04-09 14:04:39,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-12) [558adc7b] FINISH, SetVmTicketVDSCommand, log id: 1951f7c3 >2014-04-09 14:04:39,552 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [558adc7b] Correlation ID: 558adc7b, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 14:04:47,100 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-4) [45009aa1] Running command: SetVmTicketCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:04:47,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [45009aa1] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, ticket=1+Kw+/aHf6TU, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 538c5551 >2014-04-09 14:04:47,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [45009aa1] FINISH, SetVmTicketVDSCommand, log id: 538c5551 >2014-04-09 14:04:47,185 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [45009aa1] Correlation ID: 45009aa1, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm2 >2014-04-09 14:05:06,467 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) Setting new tasks map. The map contains now 2 tasks >2014-04-09 14:05:33,194 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb moved from PoweringUp --> Up >2014-04-09 14:05:33,296 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) Correlation ID: 7d62c3db, Job ID: ec936f3b-fb80-433b-902c-6a9058ee92bf, Call Stack: null, Custom Event ID: -1, Message: VM vm2 started on Host 10.66.106.32 >2014-04-09 14:05:36,468 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Setting new tasks map. The map contains now 0 tasks >2014-04-09 14:05:36,468 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-09 14:05:54,624 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-16) [bf97974] Lock Acquired to object EngineLock [exclusiveLocks= key: vm3 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:05:54,660 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-16) [bf97974] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 14:05:54,826 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [bf97974] Correlation ID: bf97974, Job ID: 973ab18a-a0b5-4252-a55e-dfa85327055b, Call Stack: null, Custom Event ID: -1, Message: VM vm3 was created by admin@internal. >2014-04-09 14:05:54,835 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-16) [bf97974] Lock freed to object EngineLock [exclusiveLocks= key: vm3 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:05:54,950 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-49) [28e30894] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-09 14:05:54,966 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-15) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 14:05:54,986 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-5) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 14:05:55,004 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-49) [cb1c5df] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:05:55,043 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [cb1c5df] Correlation ID: cb1c5df, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm3. (User: admin@internal) >2014-04-09 14:05:55,068 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [cb1c5df] Correlation ID: 28e30894, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm3. (User: admin@internal) >2014-04-09 14:06:02,820 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-15) [687cd6df] Lock Acquired to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM_DISK_BOOT >, sharedLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >] >2014-04-09 14:06:02,851 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-15) [687cd6df] Running command: AddDiskCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM, ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-09 14:06:02,942 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-15) [77a0e5c7] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-09 14:06:02,967 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-15) [77a0e5c7] Lock freed to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM_DISK_BOOT >, sharedLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >] >2014-04-09 14:06:02,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [77a0e5c7] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = 75fbb675-c45b-4977-a046-84ac78c9c372, imageSizeInBytes = 10737418240, volumeFormat = RAW, newImageId = 70bf7589-51a3-471d-bb14-93ecaaff1e0f, newImageDescription = ), log id: 77aa3422 >2014-04-09 14:06:02,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [77a0e5c7] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:06:02,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [77a0e5c7] -- createVolume parameters: > sdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=75fbb675-c45b-4977-a046-84ac78c9c372 > size=10,737,418,240 bytes > volFormat=RAW > volType=Sparse > volUUID=70bf7589-51a3-471d-bb14-93ecaaff1e0f > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:06:03,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-15) [77a0e5c7] FINISH, CreateImageVDSCommand, return: 70bf7589-51a3-471d-bb14-93ecaaff1e0f, log id: 77aa3422 >2014-04-09 14:06:03,046 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-15) [77a0e5c7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 7c36636a-19c6-4101-8a2e-abbf1645fdcc >2014-04-09 14:06:03,046 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-15) [77a0e5c7] CommandMultiAsyncTasks::AttachTask: Attaching task 94fe59b6-82ad-4580-addd-4c550fcf7082 to command 7c36636a-19c6-4101-8a2e-abbf1645fdcc. >2014-04-09 14:06:03,119 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-15) [77a0e5c7] Adding task 94fe59b6-82ad-4580-addd-4c550fcf7082 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:06:03,392 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [77a0e5c7] Correlation ID: 687cd6df, Job ID: d3f02ea9-7ad8-4e79-820a-4482cfe2e399, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm3_Disk1 was initiated on VM vm3 by admin@internal. >2014-04-09 14:06:03,393 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-15) [77a0e5c7] BaseAsyncTask::StartPollingTask: Starting to poll task 94fe59b6-82ad-4580-addd-4c550fcf7082. >2014-04-09 14:06:12,040 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-14) [9298e35] Lock Acquired to object EngineLock [exclusiveLocks= key: vm4 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:06:12,083 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-14) [9298e35] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-09 14:06:12,200 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [9298e35] Correlation ID: 9298e35, Job ID: 44a567db-fc25-4f68-8fa4-6a0e71e90695, Call Stack: null, Custom Event ID: -1, Message: VM vm4 was created by admin@internal. >2014-04-09 14:06:12,208 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-14) [9298e35] Lock freed to object EngineLock [exclusiveLocks= key: vm4 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:06:12,419 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-47) [67b11380] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-09 14:06:12,432 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-16) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 14:06:12,448 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-1) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 14:06:12,468 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-47) [73575ed5] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM >2014-04-09 14:06:12,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [73575ed5] Correlation ID: 73575ed5, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm4. (User: admin@internal) >2014-04-09 14:06:12,533 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [73575ed5] Correlation ID: 67b11380, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm4. (User: admin@internal) >2014-04-09 14:06:13,054 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-45) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 14:06:13,066 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-45) SPMAsyncTask::PollTask: Polling task 94fe59b6-82ad-4580-addd-4c550fcf7082 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:06:13,141 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-45) BaseAsyncTask::OnTaskEndSuccess: Task 94fe59b6-82ad-4580-addd-4c550fcf7082 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:06:13,142 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-45) CommandAsyncTask::EndActionIfNecessary: All tasks of command 7c36636a-19c6-4101-8a2e-abbf1645fdcc has ended -> executing EndAction >2014-04-09 14:06:13,142 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-45) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 7c36636a-19c6-4101-8a2e-abbf1645fdcc): calling EndAction . >2014-04-09 14:06:13,142 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-09 14:06:13,158 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-47) [687cd6df] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-09 14:06:13,165 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-47) [77a0e5c7] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-09 14:06:13,180 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [77a0e5c7] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = 75fbb675-c45b-4977-a046-84ac78c9c372, imageId = 70bf7589-51a3-471d-bb14-93ecaaff1e0f), log id: 3ec5a0c9 >2014-04-09 14:06:13,239 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [77a0e5c7] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@4bb376d7, log id: 3ec5a0c9 >2014-04-09 14:06:13,300 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) Correlation ID: 687cd6df, Job ID: d3f02ea9-7ad8-4e79-820a-4482cfe2e399, Call Stack: null, Custom Event ID: -1, Message: The disk vm3_Disk1 was successfully added to VM vm3. >2014-04-09 14:06:13,300 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-09 14:06:13,300 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-09 14:06:13,308 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 94fe59b6-82ad-4580-addd-4c550fcf7082 >2014-04-09 14:06:13,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 94fe59b6-82ad-4580-addd-4c550fcf7082), log id: ee42dae >2014-04-09 14:06:13,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=94fe59b6-82ad-4580-addd-4c550fcf7082), log id: 26730225 >2014-04-09 14:06:13,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 26730225 >2014-04-09 14:06:13,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) FINISH, SPMClearTaskVDSCommand, log id: ee42dae >2014-04-09 14:06:13,333 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 94fe59b6-82ad-4580-addd-4c550fcf7082 from DataBase >2014-04-09 14:06:13,333 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 7c36636a-19c6-4101-8a2e-abbf1645fdcc >2014-04-09 14:06:19,173 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) [796fc761] Lock Acquired to object EngineLock [exclusiveLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM_DISK_BOOT >, sharedLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM >] >2014-04-09 14:06:19,216 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) [796fc761] Running command: AddDiskCommand internal: false. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM, ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-09 14:06:19,299 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-1) [5fc4adf8] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-09 14:06:19,332 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-1) [5fc4adf8] Lock freed to object EngineLock [exclusiveLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM_DISK_BOOT >, sharedLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM >] >2014-04-09 14:06:19,332 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [5fc4adf8] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = 0c0fd37f-6e74-4837-84c6-66e9d7ca9a89, imageSizeInBytes = 10737418240, volumeFormat = RAW, newImageId = 406ddd12-6e7b-412b-bf49-f29822e1e785, newImageDescription = ), log id: 5704281a >2014-04-09 14:06:19,333 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [5fc4adf8] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:06:19,333 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [5fc4adf8] -- createVolume parameters: > sdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=0c0fd37f-6e74-4837-84c6-66e9d7ca9a89 > size=10,737,418,240 bytes > volFormat=RAW > volType=Sparse > volUUID=406ddd12-6e7b-412b-bf49-f29822e1e785 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:06:19,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [5fc4adf8] FINISH, CreateImageVDSCommand, return: 406ddd12-6e7b-412b-bf49-f29822e1e785, log id: 5704281a >2014-04-09 14:06:19,408 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-1) [5fc4adf8] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 3e2f2cc0-ad36-4027-b7d6-7834c82edde2 >2014-04-09 14:06:19,408 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-1) [5fc4adf8] CommandMultiAsyncTasks::AttachTask: Attaching task ade780f4-9954-4730-a022-14a25d371a46 to command 3e2f2cc0-ad36-4027-b7d6-7834c82edde2. >2014-04-09 14:06:19,518 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-1) [5fc4adf8] Adding task ade780f4-9954-4730-a022-14a25d371a46 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:06:19,674 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [5fc4adf8] Correlation ID: 796fc761, Job ID: 73ce447a-e3ff-4c20-acbd-cd65dbceb9d1, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm4_Disk1 was initiated on VM vm4 by admin@internal. >2014-04-09 14:06:19,675 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-1) [5fc4adf8] BaseAsyncTask::StartPollingTask: Starting to poll task ade780f4-9954-4730-a022-14a25d371a46. >2014-04-09 14:06:23,142 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-85) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-09 14:06:23,154 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) SPMAsyncTask::PollTask: Polling task ade780f4-9954-4730-a022-14a25d371a46 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:06:23,182 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) BaseAsyncTask::OnTaskEndSuccess: Task ade780f4-9954-4730-a022-14a25d371a46 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:06:23,182 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-85) CommandAsyncTask::EndActionIfNecessary: All tasks of command 3e2f2cc0-ad36-4027-b7d6-7834c82edde2 has ended -> executing EndAction >2014-04-09 14:06:23,182 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-85) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 3e2f2cc0-ad36-4027-b7d6-7834c82edde2): calling EndAction . >2014-04-09 14:06:23,183 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-09 14:06:23,199 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-49) [796fc761] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-09 14:06:23,208 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-49) [5fc4adf8] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-09 14:06:23,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-49) [5fc4adf8] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = 0c0fd37f-6e74-4837-84c6-66e9d7ca9a89, imageId = 406ddd12-6e7b-412b-bf49-f29822e1e785), log id: 1da7aaae >2014-04-09 14:06:23,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-49) [5fc4adf8] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@161ef96, log id: 1da7aaae >2014-04-09 14:06:23,332 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) Correlation ID: 796fc761, Job ID: 73ce447a-e3ff-4c20-acbd-cd65dbceb9d1, Call Stack: null, Custom Event ID: -1, Message: The disk vm4_Disk1 was successfully added to VM vm4. >2014-04-09 14:06:23,332 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-09 14:06:23,332 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-09 14:06:23,340 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ade780f4-9954-4730-a022-14a25d371a46 >2014-04-09 14:06:23,341 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = ade780f4-9954-4730-a022-14a25d371a46), log id: 190fc11c >2014-04-09 14:06:23,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=ade780f4-9954-4730-a022-14a25d371a46), log id: 594f221e >2014-04-09 14:06:23,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 594f221e >2014-04-09 14:06:23,359 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 190fc11c >2014-04-09 14:06:23,365 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task ade780f4-9954-4730-a022-14a25d371a46 from DataBase >2014-04-09 14:06:23,366 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 3e2f2cc0-ad36-4027-b7d6-7834c82edde2 >2014-04-09 14:06:39,339 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.218 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 14:07:11,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.215 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 14:07:36,471 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-68) Setting new tasks map. The map contains now 0 tasks >2014-04-09 14:07:36,471 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-68) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-09 14:08:04,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-17) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 4e69b449 >2014-04-09 14:08:04,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetDeviceListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageType=ISCSI), log id: 180abac5 >2014-04-09 14:08:07,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@24548aff], log id: 180abac5 >2014-04-09 14:08:12,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-17) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123, org.ovirt.engine.core.common.businessentities.LUNs@8f6fd83e], log id: 4e69b449 >2014-04-09 14:08:42,071 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-11) [10cb4c55] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 14:08:42,093 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-11) [10cb4c55] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:08:42,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-11) [10cb4c55] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5966645a >2014-04-09 14:08:42,200 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-11) [10cb4c55] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 5966645a >2014-04-09 14:08:42,276 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-11) [10cb4c55] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2 value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 14:08:42,352 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:08:42,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 506a2a13 >2014-04-09 14:08:42,385 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 506a2a13 >2014-04-09 14:08:42,388 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] START, CreateStorageDomainVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@f7793918, args=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2), log id: 6cecb18e >2014-04-09 14:08:46,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] FINISH, CreateStorageDomainVDSCommand, log id: 6cecb18e >2014-04-09 14:08:46,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] START, GetStorageDomainStatsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storageDomainId=65eafe2b-4fa9-4ea1-a869-7deb5afd4654), log id: 3c181efe >2014-04-09 14:08:46,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-15) [69656fe5] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@9fd3aa55, log id: 3c181efe >2014-04-09 14:08:46,351 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [69656fe5] Correlation ID: 69656fe5, Job ID: c32be0a0-4bd7-4196-900f-6906e554df0a, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain4 was added by admin@internal >2014-04-09 14:08:46,443 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-17) [662c8957] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:08:46,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-17) [662c8957] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1270f597 >2014-04-09 14:08:52,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-17) [662c8957] FINISH, DisconnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 1270f597 >2014-04-09 14:08:52,809 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-12) [10ffa612] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 Type: Storage >2014-04-09 14:08:52,828 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-35) [2d2be882] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:08:52,829 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [1dadc5f9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:08:52,833 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [2d2be882] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5157ab09 >2014-04-09 14:08:52,833 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [1dadc5f9] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3b1f8016 >2014-04-09 14:08:52,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [2d2be882] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 5157ab09 >2014-04-09 14:08:52,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [1dadc5f9] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 3b1f8016 >2014-04-09 14:08:52,973 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [10ffa612] START, AttachStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 65eafe2b-4fa9-4ea1-a869-7deb5afd4654), log id: 5cf7967f >2014-04-09 14:09:22,813 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [10ffa612] FINISH, AttachStorageDomainVDSCommand, log id: 5cf7967f >2014-04-09 14:09:22,822 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] Lock Acquired to object EngineLock [exclusiveLocks= key: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 value: STORAGE >, sharedLocks= ] >2014-04-09 14:09:22,852 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 Type: Storage >2014-04-09 14:09:22,872 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] Lock freed to object EngineLock [exclusiveLocks= key: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 value: STORAGE >, sharedLocks= ] >2014-04-09 14:09:22,872 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 2:09 PM >2014-04-09 14:09:22,884 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [4b490bc5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:09:22,884 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [28a3d920] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:09:22,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [4b490bc5] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4289d0ba >2014-04-09 14:09:22,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [28a3d920] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 264bbd18 >2014-04-09 14:09:22,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [28a3d920] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 264bbd18 >2014-04-09 14:09:22,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [4b490bc5] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 4289d0ba >2014-04-09 14:09:22,908 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 65eafe2b-4fa9-4ea1-a869-7deb5afd4654), log id: 69f61f2b >2014-04-09 14:09:27,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] FINISH, ActivateStorageDomainVDSCommand, log id: 69f61f2b >2014-04-09 14:09:27,136 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 2:09 PM >2014-04-09 14:09:27,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [5ae1260a] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 14662428 >2014-04-09 14:09:27,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [5ae1260a] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 763d23dd >2014-04-09 14:09:27,178 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [5ae1260a] FINISH, RefreshStoragePoolVDSCommand, log id: 763d23dd >2014-04-09 14:09:27,178 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-49) [5ae1260a] Refreshed vds 10.66.106.32 in pool NFS_shyu >2014-04-09 14:09:29,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [5ae1260a] FINISH, RefreshStoragePoolVDSCommand, log id: 14662428 >2014-04-09 14:09:29,634 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-50) [5ae1260a] Refreshed vds 10.66.106.40 in pool NFS_shyu >2014-04-09 14:09:29,646 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [5ae1260a] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 2:09 PM >2014-04-09 14:09:29,663 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [5ae1260a] Correlation ID: 5ae1260a, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain4 (Data Center NFS_shyu) was activated by admin@internal >2014-04-09 14:09:29,680 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [5ae1260a] Correlation ID: 10ffa612, Job ID: e8325c7d-8618-4f8a-8b8f-ff3d7c0b1a09, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain4 was attached to Data Center NFS_shyu by admin@internal >2014-04-09 14:09:57,560 INFO [org.ovirt.engine.core.bll.MoveDisksCommand] (ajp-/127.0.0.1:8702-17) [5d5863fa] Running command: MoveDisksCommand internal: false. Entities affected : ID: d84232e1-e105-4c7e-8657-28d777960e4e Type: Disk >2014-04-09 14:09:57,702 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (ajp-/127.0.0.1:8702-17) [5d5863fa] Lock Acquired to object EngineLock [exclusiveLocks= key: d84232e1-e105-4c7e-8657-28d777960e4e value: DISK >, sharedLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >] >2014-04-09 14:09:57,841 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-47) [5d5863fa] Running command: LiveMigrateVmDisksCommand Task handler: LiveSnapshotTaskHandler internal: false. Entities affected : ID: 3b7ab14c-7440-4c79-b302-7c93da9ffb1c Type: Disk, ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 14:09:58,026 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-47) Running command: CreateAllSnapshotsFromVmCommand internal: true. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:09:58,136 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-47) [2303f15a] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:09:58,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-47) [2303f15a] START, CreateSnapshotVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, imageSizeInBytes = 107374182400, volumeFormat = COW, newImageId = b92846d7-f3a1-45ca-a75c-60d6cdc217d1, newImageDescription = , imageId = 3b7ab14c-7440-4c79-b302-7c93da9ffb1c, sourceImageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e), log id: 75c3ff62 >2014-04-09 14:09:58,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-47) [2303f15a] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:09:58,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-47) [2303f15a] -- createVolume parameters: > sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=d84232e1-e105-4c7e-8657-28d777960e4e > size=107,374,182,400 bytes > volFormat=COW > volType=Sparse > volUUID=b92846d7-f3a1-45ca-a75c-60d6cdc217d1 > descr= > srcImgGUID=d84232e1-e105-4c7e-8657-28d777960e4e > srcVolUUID=3b7ab14c-7440-4c79-b302-7c93da9ffb1c > >2014-04-09 14:09:58,209 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-47) [2303f15a] FINISH, CreateSnapshotVDSCommand, return: b92846d7-f3a1-45ca-a75c-60d6cdc217d1, log id: 75c3ff62 >2014-04-09 14:09:58,336 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) [2303f15a] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 2cdcb1a6-965b-489b-94c2-fe076c33ebf9 >2014-04-09 14:09:58,336 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-47) [2303f15a] CommandMultiAsyncTasks::AttachTask: Attaching task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3 to command 2cdcb1a6-965b-489b-94c2-fe076c33ebf9. >2014-04-09 14:09:58,351 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-47) [2303f15a] Adding task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:09:58,401 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) Correlation ID: 2fc4d0fe, Job ID: 01f266fd-0962-46e0-bd5f-4aaf68e2c590, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'Auto-generated for Live Storage Migration' creation for VM 'vm1' was initiated by admin@internal. >2014-04-09 14:09:58,418 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::StartPollingTask: Starting to poll task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3. >2014-04-09 14:10:03,193 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-84) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 14:10:03,204 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-84) SPMAsyncTask::PollTask: Polling task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:10:03,226 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-84) BaseAsyncTask::OnTaskEndSuccess: Task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:10:03,226 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-84) CommandAsyncTask::EndActionIfNecessary: All tasks of command 2cdcb1a6-965b-489b-94c2-fe076c33ebf9 has ended -> executing EndAction >2014-04-09 14:10:03,226 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-84) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 2cdcb1a6-965b-489b-94c2-fe076c33ebf9): calling EndAction . >2014-04-09 14:10:03,227 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateVmDisks, executionIndex: 0 >2014-04-09 14:10:03,240 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand >2014-04-09 14:10:03,288 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-04-09 14:10:03,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) START, SnapshotVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 2ae591b2 >2014-04-09 14:10:13,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) FINISH, SnapshotVDSCommand, log id: 2ae591b2 >2014-04-09 14:10:13,341 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [2303f15a] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-04-09 14:10:13,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [2303f15a] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, imageId = b92846d7-f3a1-45ca-a75c-60d6cdc217d1), log id: 5c769e04 >2014-04-09 14:10:13,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [2303f15a] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@b44b61aa, log id: 5c769e04 >2014-04-09 14:10:13,459 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'Auto-generated for Live Storage Migration' creation for VM 'vm1' has been completed. >2014-04-09 14:10:13,491 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-50) Running command: LiveMigrateVmDisksCommand Task handler: LiveMigrateDisksTaskHandler internal: false. Entities affected : ID: 3b7ab14c-7440-4c79-b302-7c93da9ffb1c Type: Disk, ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 14:10:13,609 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-50) [5eea5d24] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >] >2014-04-09 14:10:13,633 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-50) [5eea5d24] Running command: LiveMigrateDiskCommand Task handler: CreateImagePlaceholderTaskHandler internal: true. Entities affected : ID: d84232e1-e105-4c7e-8657-28d777960e4e Type: Disk, ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 14:10:13,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CloneImageGroupStructureVDSCommand] (pool-4-thread-50) [5eea5d24] START, CloneImageGroupStructureVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, dstDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f), log id: 1bf828c0 >2014-04-09 14:10:13,721 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CloneImageGroupStructureVDSCommand] (pool-4-thread-50) [5eea5d24] FINISH, CloneImageGroupStructureVDSCommand, log id: 1bf828c0 >2014-04-09 14:10:13,811 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [5eea5d24] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command c3eb5d70-8501-4d7c-b44d-96af95a15a87 >2014-04-09 14:10:13,811 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [5eea5d24] CommandMultiAsyncTasks::AttachTask: Attaching task 33437bb6-ab00-4b88-8aa5-f7f6f069c453 to command c3eb5d70-8501-4d7c-b44d-96af95a15a87. >2014-04-09 14:10:13,833 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [5eea5d24] Adding task 33437bb6-ab00-4b88-8aa5-f7f6f069c453 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:10:13,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [5eea5d24] Correlation ID: 5eea5d24, Job ID: 055e84e2-69d7-4c70-a2d4-b6ae77037586, Call Stack: null, Custom Event ID: -1, Message: User admin@internal moving disk vm1_Disk1 to domain NFS_shyu_domain2. >2014-04-09 14:10:13,874 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [5eea5d24] BaseAsyncTask::StartPollingTask: Starting to poll task 33437bb6-ab00-4b88-8aa5-f7f6f069c453. >2014-04-09 14:10:13,876 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [5eea5d24] BaseAsyncTask::StartPollingTask: Starting to poll task 33437bb6-ab00-4b88-8aa5-f7f6f069c453. >2014-04-09 14:10:13,879 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-50) [5eea5d24] Lock freed to object EngineLock [exclusiveLocks= key: d84232e1-e105-4c7e-8657-28d777960e4e value: DISK >, sharedLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >] >2014-04-09 14:10:13,879 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateVmDisks completed, handling the result. >2014-04-09 14:10:13,879 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateVmDisks succeeded, clearing tasks. >2014-04-09 14:10:13,883 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3 >2014-04-09 14:10:13,883 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 95f47e00-87c8-469c-bc02-fc6ddd9c12e3), log id: 68bc8523 >2014-04-09 14:10:13,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=95f47e00-87c8-469c-bc02-fc6ddd9c12e3), log id: 30c8f28d >2014-04-09 14:10:13,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 30c8f28d >2014-04-09 14:10:13,901 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 68bc8523 >2014-04-09 14:10:13,908 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 95f47e00-87c8-469c-bc02-fc6ddd9c12e3 from DataBase >2014-04-09 14:10:13,908 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 2cdcb1a6-965b-489b-94c2-fe076c33ebf9 >2014-04-09 14:10:22,832 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-44) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 14:10:23,226 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-16) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-09 14:10:23,239 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-16) SPMAsyncTask::PollTask: Polling task 33437bb6-ab00-4b88-8aa5-f7f6f069c453 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:10:23,265 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-16) BaseAsyncTask::OnTaskEndSuccess: Task 33437bb6-ab00-4b88-8aa5-f7f6f069c453 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:10:23,265 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-16) CommandAsyncTask::EndActionIfNecessary: All tasks of command c3eb5d70-8501-4d7c-b44d-96af95a15a87 has ended -> executing EndAction >2014-04-09 14:10:23,265 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-16) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: c3eb5d70-8501-4d7c-b44d-96af95a15a87): calling EndAction . >2014-04-09 14:10:23,266 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateDisk, executionIndex: 0 >2014-04-09 14:10:23,359 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-50) [5eea5d24] Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand >2014-04-09 14:10:23,359 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-50) [5eea5d24] Running command: LiveMigrateDiskCommand Task handler: VmReplicateDiskStartTaskHandler internal: false. Entities affected : ID: d84232e1-e105-4c7e-8657-28d777960e4e Type: Disk, ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 14:10:23,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskStartVDSCommand] (pool-4-thread-50) [5eea5d24] START, VmReplicateDiskStartVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 628b5160 >2014-04-09 14:10:23,599 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskStartVDSCommand] (pool-4-thread-50) [5eea5d24] FINISH, VmReplicateDiskStartVDSCommand, log id: 628b5160 >2014-04-09 14:10:23,617 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SyncImageGroupDataVDSCommand] (pool-4-thread-50) [5eea5d24] START, SyncImageGroupDataVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, dstDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, syncType=INTERNAL), log id: 70a4c154 >2014-04-09 14:10:23,752 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SyncImageGroupDataVDSCommand] (pool-4-thread-50) [5eea5d24] FINISH, SyncImageGroupDataVDSCommand, log id: 70a4c154 >2014-04-09 14:10:23,769 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [5eea5d24] CommandMultiAsyncTasks::AttachTask: Attaching task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 to command c3eb5d70-8501-4d7c-b44d-96af95a15a87. >2014-04-09 14:10:23,782 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [5eea5d24] Adding task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:10:23,790 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [5eea5d24] BaseAsyncTask::StartPollingTask: Starting to poll task 23701148-2ea0-4945-9393-0ceb1ddfb8f7. >2014-04-09 14:10:23,790 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk completed, handling the result. >2014-04-09 14:10:23,790 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk succeeded, clearing tasks. >2014-04-09 14:10:23,791 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 33437bb6-ab00-4b88-8aa5-f7f6f069c453 >2014-04-09 14:10:23,791 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 33437bb6-ab00-4b88-8aa5-f7f6f069c453), log id: 2913b112 >2014-04-09 14:10:23,793 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, taskId=33437bb6-ab00-4b88-8aa5-f7f6f069c453), log id: 4bce29cf >2014-04-09 14:10:23,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 4bce29cf >2014-04-09 14:10:23,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 2913b112 >2014-04-09 14:10:23,840 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 33437bb6-ab00-4b88-8aa5-f7f6f069c453 from DataBase >2014-04-09 14:10:23,840 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [within thread]: Some of the tasks related to command id c3eb5d70-8501-4d7c-b44d-96af95a15a87 were not cleared yet (Task id 23701148-2ea0-4945-9393-0ceb1ddfb8f7 is in state Polling). >2014-04-09 14:10:28,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-35) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 477c6fbd >2014-04-09 14:10:28,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-35) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@3a8c05f5, log id: 477c6fbd >2014-04-09 14:10:33,266 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-78) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-04-09 14:10:33,277 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-78) SPMAsyncTask::PollTask: Polling task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:10:33,277 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-78) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:11:06,478 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-44) Setting new tasks map. The map contains now 2 tasks >2014-04-09 14:11:13,315 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-09 14:11:13,326 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:11:14,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Used Network resources of host 10.66.106.32 [96%] exceeded defined threshold [95%]. >2014-04-09 14:11:36,479 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-74) Setting new tasks map. The map contains now 1 tasks >2014-04-09 14:11:43,351 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-34) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 14:11:43,368 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-34) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:12:59,210 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-6) [7209c6] Lock Acquired to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-09 14:12:59,219 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [7209c6] START, IsVmDuringInitiatingVDSCommand( vmId = c9ccfdfe-0f0d-4c96-8bd7-47723067081a), log id: 2509abc7 >2014-04-09 14:12:59,219 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [7209c6] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2509abc7 >2014-04-09 14:12:59,304 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-35) [7209c6] Running command: RunVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:12:59,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-35) [7209c6] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 4a7f0e23 >2014-04-09 14:12:59,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-35) [7209c6] FINISH, IsoPrefixVDSCommand, return: , log id: 4a7f0e23 >2014-04-09 14:12:59,395 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-35) [7209c6] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, vm=VM [vm3]), log id: b1893f5 >2014-04-09 14:12:59,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [7209c6] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, vm=VM [vm3]), log id: 6f07661b >2014-04-09 14:12:59,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [7209c6] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a,devices=[Ljava.util.HashMap;@5499c853,acpiEnable=true,vmName=vm3,cpuType=Conroe,custom={} >2014-04-09 14:12:59,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [7209c6] FINISH, CreateVDSCommand, log id: 6f07661b >2014-04-09 14:12:59,496 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-35) [7209c6] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: b1893f5 >2014-04-09 14:12:59,496 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-35) [7209c6] Lock freed to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-09 14:12:59,524 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [7209c6] Correlation ID: 7209c6, Job ID: d2364bb3-57b8-4a73-bfcb-a53bf3531275, Call Stack: null, Custom Event ID: -1, Message: VM vm3 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:13:00,808 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) VM vm3 c9ccfdfe-0f0d-4c96-8bd7-47723067081a moved from WaitForLaunch --> PoweringUp >2014-04-09 14:13:00,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[c9ccfdfe-0f0d-4c96-8bd7-47723067081a]), log id: 736995ad >2014-04-09 14:13:00,832 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@18e1cc0d, log id: 736995ad >2014-04-09 14:13:01,144 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-8) [20ace127] Lock Acquired to object EngineLock [exclusiveLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM >, sharedLocks= ] >2014-04-09 14:13:01,156 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-8) [20ace127] START, IsVmDuringInitiatingVDSCommand( vmId = a3a055b8-512e-47e3-95ec-2a8cfd338eb4), log id: 6df87305 >2014-04-09 14:13:01,157 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-8) [20ace127] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6df87305 >2014-04-09 14:13:01,232 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-35) [20ace127] Running command: RunVmCommand internal: false. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM >2014-04-09 14:13:01,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-35) [20ace127] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 271f36fa >2014-04-09 14:13:01,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-35) [20ace127] FINISH, IsoPrefixVDSCommand, return: , log id: 271f36fa >2014-04-09 14:13:01,388 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-35) [20ace127] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=a3a055b8-512e-47e3-95ec-2a8cfd338eb4, vm=VM [vm4]), log id: 3443f098 >2014-04-09 14:13:01,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [20ace127] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=a3a055b8-512e-47e3-95ec-2a8cfd338eb4, vm=VM [vm4]), log id: 426be033 >2014-04-09 14:13:01,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [20ace127] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=a3a055b8-512e-47e3-95ec-2a8cfd338eb4,devices=[Ljava.util.HashMap;@fe04bb4,acpiEnable=true,vmName=vm4,cpuType=Conroe,custom={} >2014-04-09 14:13:01,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [20ace127] FINISH, CreateVDSCommand, log id: 426be033 >2014-04-09 14:13:01,474 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-35) [20ace127] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3443f098 >2014-04-09 14:13:01,474 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-35) [20ace127] Lock freed to object EngineLock [exclusiveLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM >, sharedLocks= ] >2014-04-09 14:13:01,482 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [20ace127] Correlation ID: 20ace127, Job ID: 4ef39137-f5f0-401d-b78c-92ef005ec05e, Call Stack: null, Custom Event ID: -1, Message: VM vm4 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:13:03,976 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) VM vm4 a3a055b8-512e-47e3-95ec-2a8cfd338eb4 moved from WaitForLaunch --> PoweringUp >2014-04-09 14:13:03,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-64) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[a3a055b8-512e-47e3-95ec-2a8cfd338eb4]), log id: 2c39e310 >2014-04-09 14:13:03,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-64) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@c6a461f, log id: 2c39e310 >2014-04-09 14:14:02,267 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) VM vm4 a3a055b8-512e-47e3-95ec-2a8cfd338eb4 moved from PoweringUp --> Up >2014-04-09 14:14:02,274 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) VM vm3 c9ccfdfe-0f0d-4c96-8bd7-47723067081a moved from PoweringUp --> Up >2014-04-09 14:14:02,357 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: 20ace127, Job ID: 4ef39137-f5f0-401d-b78c-92ef005ec05e, Call Stack: null, Custom Event ID: -1, Message: VM vm4 started on Host 10.66.106.32 >2014-04-09 14:14:02,374 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: 7209c6, Job ID: d2364bb3-57b8-4a73-bfcb-a53bf3531275, Call Stack: null, Custom Event ID: -1, Message: VM vm3 started on Host 10.66.106.32 >2014-04-09 14:14:53,353 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-14) Running command: LoginAdminUserCommand internal: false. >2014-04-09 14:14:53,376 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 14:14:53,425 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-04-09 14:14:53,443 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 14:15:03,076 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [60c698b5] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:15:03,083 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [60c698b5] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=XUBm+43SX+Aq, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5bc68249 >2014-04-09 14:15:03,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [60c698b5] FINISH, SetVmTicketVDSCommand, log id: 5bc68249 >2014-04-09 14:15:03,175 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [60c698b5] Correlation ID: 60c698b5, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 14:15:09,756 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-6) [2b982432] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:15:09,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [2b982432] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=PU86sMDH6Stu, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 18548cbe >2014-04-09 14:15:09,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [2b982432] FINISH, SetVmTicketVDSCommand, log id: 18548cbe >2014-04-09 14:15:09,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [2b982432] Correlation ID: 2b982432, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 14:16:05,250 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp-/127.0.0.1:8702-13) [17fb5d31] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:16:05,325 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:16:05,357 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [291d7e77] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:16:05,373 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [291d7e77] START, CreateSnapshotVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageSizeInBytes = 8589934592, volumeFormat = COW, newImageId = 23abee19-f5d5-45cb-91ff-99d44660d5db, newImageDescription = , imageId = a7592631-638d-427c-af5e-58b92e75e40b, sourceImageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5), log id: 514ae15e >2014-04-09 14:16:05,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [291d7e77] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:16:05,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [291d7e77] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > size=8,589,934,592 bytes > volFormat=COW > volType=Sparse > volUUID=23abee19-f5d5-45cb-91ff-99d44660d5db > descr= > srcImgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > srcVolUUID=a7592631-638d-427c-af5e-58b92e75e40b > >2014-04-09 14:16:05,421 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [291d7e77] FINISH, CreateSnapshotVDSCommand, return: 23abee19-f5d5-45cb-91ff-99d44660d5db, log id: 514ae15e >2014-04-09 14:16:05,460 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [291d7e77] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 8a790ffd-32c1-46f7-b9eb-20124e913382 >2014-04-09 14:16:05,460 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [291d7e77] CommandMultiAsyncTasks::AttachTask: Attaching task 838b4711-ec87-483a-9abe-b7b25f0d63f4 to command 8a790ffd-32c1-46f7-b9eb-20124e913382. >2014-04-09 14:16:05,475 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [291d7e77] Adding task 838b4711-ec87-483a-9abe-b7b25f0d63f4 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:16:05,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 0f33259d-58db-4ad1-a97e-12c73b0491ba, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 1b1f7c12-2488-4e71-a17f-32da7c410a2a, newImageDescription = ), log id: 2c32edf >2014-04-09 14:16:05,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:16:05,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=0f33259d-58db-4ad1-a97e-12c73b0491ba > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=1b1f7c12-2488-4e71-a17f-32da7c410a2a > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:16:05,554 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) FINISH, CreateImageVDSCommand, return: 1b1f7c12-2488-4e71-a17f-32da7c410a2a, log id: 2c32edf >2014-04-09 14:16:05,578 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) CommandMultiAsyncTasks::AttachTask: Attaching task def9cb7a-0297-46d7-8943-cd33ca2a8f0f to command 8a790ffd-32c1-46f7-b9eb-20124e913382. >2014-04-09 14:16:05,583 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) Adding task def9cb7a-0297-46d7-8943-cd33ca2a8f0f (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:16:05,592 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 7d81046a-1238-4b5d-b312-ebc24ac08300, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = b852083b-06ce-4581-a2fd-c3f7f6bfb5e8, newImageDescription = ), log id: 1f670fc1 >2014-04-09 14:16:05,592 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:16:05,593 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=7d81046a-1238-4b5d-b312-ebc24ac08300 > size=1,350,565,888 bytes > volFormat=RAW > volType=Preallocated > volUUID=b852083b-06ce-4581-a2fd-c3f7f6bfb5e8 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:16:05,637 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) FINISH, CreateImageVDSCommand, return: b852083b-06ce-4581-a2fd-c3f7f6bfb5e8, log id: 1f670fc1 >2014-04-09 14:16:05,661 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) CommandMultiAsyncTasks::AttachTask: Attaching task 287a743b-d454-4e6a-81c6-29729f7e358a to command 8a790ffd-32c1-46f7-b9eb-20124e913382. >2014-04-09 14:16:05,675 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) Adding task 287a743b-d454-4e6a-81c6-29729f7e358a (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:16:05,708 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: 17fb5d31, Job ID: fd34de8d-76f5-4f88-bba1-f173659b8d78, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's1' creation for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:16:05,709 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task 838b4711-ec87-483a-9abe-b7b25f0d63f4. >2014-04-09 14:16:05,709 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task def9cb7a-0297-46d7-8943-cd33ca2a8f0f. >2014-04-09 14:16:05,709 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task 287a743b-d454-4e6a-81c6-29729f7e358a. >2014-04-09 14:16:14,509 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-31) Polling and updating Async Tasks: 4 tasks, 4 tasks to poll now >2014-04-09 14:16:14,560 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) SPMAsyncTask::PollTask: Polling task 287a743b-d454-4e6a-81c6-29729f7e358a (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:16:14,582 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) BaseAsyncTask::OnTaskEndSuccess: Task 287a743b-d454-4e6a-81c6-29729f7e358a (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:16:14,582 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-31) Task with DB Task ID 51bcdbf1-b338-46c2-b5cc-bc226eccdef6 and VDSM Task ID def9cb7a-0297-46d7-8943-cd33ca2a8f0f is in state Polling. End action for command 8a790ffd-32c1-46f7-b9eb-20124e913382 will proceed when all the entitys tasks are completed. >2014-04-09 14:16:14,583 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) SPMAsyncTask::PollTask: Polling task 838b4711-ec87-483a-9abe-b7b25f0d63f4 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:16:14,591 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) BaseAsyncTask::OnTaskEndSuccess: Task 838b4711-ec87-483a-9abe-b7b25f0d63f4 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:16:14,591 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-31) Task with DB Task ID 51bcdbf1-b338-46c2-b5cc-bc226eccdef6 and VDSM Task ID def9cb7a-0297-46d7-8943-cd33ca2a8f0f is in state Polling. End action for command 8a790ffd-32c1-46f7-b9eb-20124e913382 will proceed when all the entitys tasks are completed. >2014-04-09 14:16:14,591 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) SPMAsyncTask::PollTask: Polling task def9cb7a-0297-46d7-8943-cd33ca2a8f0f (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:16:14,607 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) BaseAsyncTask::OnTaskEndSuccess: Task def9cb7a-0297-46d7-8943-cd33ca2a8f0f (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:16:14,608 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-31) CommandAsyncTask::EndActionIfNecessary: All tasks of command 8a790ffd-32c1-46f7-b9eb-20124e913382 has ended -> executing EndAction >2014-04-09 14:16:14,608 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-31) CommandAsyncTask::EndAction: Ending action for 3 tasks (command ID: 8a790ffd-32c1-46f7-b9eb-20124e913382): calling EndAction . >2014-04-09 14:16:14,608 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-31) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:16:14,608 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-04-09 14:16:14,674 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-04-09 14:16:14,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) START, SnapshotVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 3874d9ca >2014-04-09 14:16:18,264 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Up --> Paused >2014-04-09 14:16:29,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) FINISH, SnapshotVDSCommand, log id: 3874d9ca >2014-04-09 14:16:29,239 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [291d7e77] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-04-09 14:16:29,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [291d7e77] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 23abee19-f5d5-45cb-91ff-99d44660d5db), log id: 54ffe39b >2014-04-09 14:16:29,744 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [291d7e77] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@15a8bf47, log id: 54ffe39b >2014-04-09 14:16:29,810 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:16:29,831 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: 17fb5d31, Job ID: fd34de8d-76f5-4f88-bba1-f173659b8d78, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's1' creation for VM 'vm_vnc' has been completed. >2014-04-09 14:16:29,832 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-04-09 14:16:29,832 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-04-09 14:16:29,839 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task def9cb7a-0297-46d7-8943-cd33ca2a8f0f >2014-04-09 14:16:29,839 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = def9cb7a-0297-46d7-8943-cd33ca2a8f0f), log id: 3d92bf6a >2014-04-09 14:16:29,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=def9cb7a-0297-46d7-8943-cd33ca2a8f0f), log id: 6d54e7ba >2014-04-09 14:16:29,854 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 6d54e7ba >2014-04-09 14:16:29,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 3d92bf6a >2014-04-09 14:16:29,872 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task def9cb7a-0297-46d7-8943-cd33ca2a8f0f from DataBase >2014-04-09 14:16:29,872 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 838b4711-ec87-483a-9abe-b7b25f0d63f4 >2014-04-09 14:16:29,872 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 838b4711-ec87-483a-9abe-b7b25f0d63f4), log id: 3ff36b20 >2014-04-09 14:16:29,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=838b4711-ec87-483a-9abe-b7b25f0d63f4), log id: 5fe22ad >2014-04-09 14:16:29,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 5fe22ad >2014-04-09 14:16:29,885 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 3ff36b20 >2014-04-09 14:16:29,897 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 838b4711-ec87-483a-9abe-b7b25f0d63f4 from DataBase >2014-04-09 14:16:29,897 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 287a743b-d454-4e6a-81c6-29729f7e358a >2014-04-09 14:16:29,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 287a743b-d454-4e6a-81c6-29729f7e358a), log id: 41526435 >2014-04-09 14:16:29,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=287a743b-d454-4e6a-81c6-29729f7e358a), log id: 830f514 >2014-04-09 14:16:29,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 830f514 >2014-04-09 14:16:29,910 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 41526435 >2014-04-09 14:16:29,914 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 287a743b-d454-4e6a-81c6-29729f7e358a from DataBase >2014-04-09 14:16:29,914 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 8a790ffd-32c1-46f7-b9eb-20124e913382 >2014-04-09 14:16:30,427 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Paused --> Up >2014-04-09 14:16:30,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-59) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 2ecd42c7 >2014-04-09 14:16:30,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-59) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@25db2ed2, log id: 2ecd42c7 >2014-04-09 14:16:47,457 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp-/127.0.0.1:8702-15) [f9a71f9] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:16:47,570 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:16:47,598 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [b08e8cc] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:16:47,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [b08e8cc] START, CreateSnapshotVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageSizeInBytes = 8589934592, volumeFormat = COW, newImageId = 075b984c-9cb0-4d70-bcc6-ff1cc52f2672, newImageDescription = , imageId = 23abee19-f5d5-45cb-91ff-99d44660d5db, sourceImageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5), log id: 10ffe19e >2014-04-09 14:16:47,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [b08e8cc] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:16:47,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [b08e8cc] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > size=8,589,934,592 bytes > volFormat=COW > volType=Sparse > volUUID=075b984c-9cb0-4d70-bcc6-ff1cc52f2672 > descr= > srcImgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > srcVolUUID=23abee19-f5d5-45cb-91ff-99d44660d5db > >2014-04-09 14:16:47,647 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [b08e8cc] FINISH, CreateSnapshotVDSCommand, return: 075b984c-9cb0-4d70-bcc6-ff1cc52f2672, log id: 10ffe19e >2014-04-09 14:16:47,658 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [b08e8cc] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 39b59c97-88e0-4611-a004-f8f6f5c4550e >2014-04-09 14:16:47,658 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [b08e8cc] CommandMultiAsyncTasks::AttachTask: Attaching task 7aed56ea-ee43-41c7-aed3-e29e65c088bc to command 39b59c97-88e0-4611-a004-f8f6f5c4550e. >2014-04-09 14:16:47,671 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [b08e8cc] Adding task 7aed56ea-ee43-41c7-aed3-e29e65c088bc (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:16:47,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 8842ce60-85b6-4192-9d0f-8896df2bf936, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 6ff7fe7f-6fcd-45ea-ac4d-c709b8775ccd, newImageDescription = ), log id: 69519008 >2014-04-09 14:16:47,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:16:47,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=8842ce60-85b6-4192-9d0f-8896df2bf936 > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=6ff7fe7f-6fcd-45ea-ac4d-c709b8775ccd > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:16:47,742 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) FINISH, CreateImageVDSCommand, return: 6ff7fe7f-6fcd-45ea-ac4d-c709b8775ccd, log id: 69519008 >2014-04-09 14:16:47,766 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) CommandMultiAsyncTasks::AttachTask: Attaching task e375f620-4aae-46ed-b5a3-da27e613971b to command 39b59c97-88e0-4611-a004-f8f6f5c4550e. >2014-04-09 14:16:47,779 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) Adding task e375f620-4aae-46ed-b5a3-da27e613971b (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:16:47,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = c47d93e6-d757-4fc0-88e2-c3511ff8ac3b, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 07edaec2-6b6d-4c94-89d9-eef1180447e1, newImageDescription = ), log id: 2f69f143 >2014-04-09 14:16:47,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:16:47,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=c47d93e6-d757-4fc0-88e2-c3511ff8ac3b > size=1,350,565,888 bytes > volFormat=RAW > volType=Preallocated > volUUID=07edaec2-6b6d-4c94-89d9-eef1180447e1 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:16:47,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) FINISH, CreateImageVDSCommand, return: 07edaec2-6b6d-4c94-89d9-eef1180447e1, log id: 2f69f143 >2014-04-09 14:16:47,848 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) CommandMultiAsyncTasks::AttachTask: Attaching task 22ff34af-c5b1-42df-aa28-f669a7fd7999 to command 39b59c97-88e0-4611-a004-f8f6f5c4550e. >2014-04-09 14:16:47,862 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) Adding task 22ff34af-c5b1-42df-aa28-f669a7fd7999 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:16:47,897 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: f9a71f9, Job ID: d1ba6d9a-9e9c-4b1c-83fa-2bc558a552a3, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's2' creation for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:16:47,897 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task 7aed56ea-ee43-41c7-aed3-e29e65c088bc. >2014-04-09 14:16:47,897 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task e375f620-4aae-46ed-b5a3-da27e613971b. >2014-04-09 14:16:47,898 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task 22ff34af-c5b1-42df-aa28-f669a7fd7999. >2014-04-09 14:16:54,752 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-70) Polling and updating Async Tasks: 7 tasks, 4 tasks to poll now >2014-04-09 14:16:54,781 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) SPMAsyncTask::PollTask: Polling task 7aed56ea-ee43-41c7-aed3-e29e65c088bc (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:16:54,797 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) BaseAsyncTask::OnTaskEndSuccess: Task 7aed56ea-ee43-41c7-aed3-e29e65c088bc (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:16:54,797 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-70) Task with DB Task ID 7fa10177-aca9-4216-a15e-7842c5b9edc5 and VDSM Task ID 22ff34af-c5b1-42df-aa28-f669a7fd7999 is in state Polling. End action for command 39b59c97-88e0-4611-a004-f8f6f5c4550e will proceed when all the entitys tasks are completed. >2014-04-09 14:16:54,797 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) SPMAsyncTask::PollTask: Polling task e375f620-4aae-46ed-b5a3-da27e613971b (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:16:54,805 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) BaseAsyncTask::OnTaskEndSuccess: Task e375f620-4aae-46ed-b5a3-da27e613971b (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:16:54,805 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-70) Task with DB Task ID 7fa10177-aca9-4216-a15e-7842c5b9edc5 and VDSM Task ID 22ff34af-c5b1-42df-aa28-f669a7fd7999 is in state Polling. End action for command 39b59c97-88e0-4611-a004-f8f6f5c4550e will proceed when all the entitys tasks are completed. >2014-04-09 14:16:54,805 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) SPMAsyncTask::PollTask: Polling task 22ff34af-c5b1-42df-aa28-f669a7fd7999 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:16:54,813 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-70) BaseAsyncTask::OnTaskEndSuccess: Task 22ff34af-c5b1-42df-aa28-f669a7fd7999 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:16:54,813 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-70) CommandAsyncTask::EndActionIfNecessary: All tasks of command 39b59c97-88e0-4611-a004-f8f6f5c4550e has ended -> executing EndAction >2014-04-09 14:16:54,814 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-70) CommandAsyncTask::EndAction: Ending action for 3 tasks (command ID: 39b59c97-88e0-4611-a004-f8f6f5c4550e): calling EndAction . >2014-04-09 14:16:54,814 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-70) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:16:54,814 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-04-09 14:16:54,838 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-04-09 14:16:54,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) START, SnapshotVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 421e248c >2014-04-09 14:16:58,319 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-2) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Up --> Paused >2014-04-09 14:17:09,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) FINISH, SnapshotVDSCommand, log id: 421e248c >2014-04-09 14:17:09,448 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [b08e8cc] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-04-09 14:17:09,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [b08e8cc] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 075b984c-9cb0-4d70-bcc6-ff1cc52f2672), log id: 15c65a7d >2014-04-09 14:17:10,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [b08e8cc] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@c560b950, log id: 15c65a7d >2014-04-09 14:17:10,120 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:17:10,173 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: f9a71f9, Job ID: d1ba6d9a-9e9c-4b1c-83fa-2bc558a552a3, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's2' creation for VM 'vm_vnc' has been completed. >2014-04-09 14:17:10,173 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-04-09 14:17:10,173 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-04-09 14:17:10,197 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 22ff34af-c5b1-42df-aa28-f669a7fd7999 >2014-04-09 14:17:10,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 22ff34af-c5b1-42df-aa28-f669a7fd7999), log id: 18eca24b >2014-04-09 14:17:10,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=22ff34af-c5b1-42df-aa28-f669a7fd7999), log id: 54123343 >2014-04-09 14:17:10,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 54123343 >2014-04-09 14:17:10,210 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 18eca24b >2014-04-09 14:17:10,221 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 22ff34af-c5b1-42df-aa28-f669a7fd7999 from DataBase >2014-04-09 14:17:10,221 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7aed56ea-ee43-41c7-aed3-e29e65c088bc >2014-04-09 14:17:10,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 7aed56ea-ee43-41c7-aed3-e29e65c088bc), log id: 3be1ab92 >2014-04-09 14:17:10,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=7aed56ea-ee43-41c7-aed3-e29e65c088bc), log id: 5cc71cf4 >2014-04-09 14:17:10,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 5cc71cf4 >2014-04-09 14:17:10,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 3be1ab92 >2014-04-09 14:17:10,246 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 7aed56ea-ee43-41c7-aed3-e29e65c088bc from DataBase >2014-04-09 14:17:10,247 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e375f620-4aae-46ed-b5a3-da27e613971b >2014-04-09 14:17:10,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = e375f620-4aae-46ed-b5a3-da27e613971b), log id: 535f848a >2014-04-09 14:17:10,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=e375f620-4aae-46ed-b5a3-da27e613971b), log id: 23f6aac9 >2014-04-09 14:17:10,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 23f6aac9 >2014-04-09 14:17:10,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 535f848a >2014-04-09 14:17:10,271 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task e375f620-4aae-46ed-b5a3-da27e613971b from DataBase >2014-04-09 14:17:10,271 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 39b59c97-88e0-4611-a004-f8f6f5c4550e >2014-04-09 14:17:10,658 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Paused --> Up >2014-04-09 14:17:10,659 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-33) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 5b9e7836 >2014-04-09 14:17:10,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-33) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@e65038, log id: 5b9e7836 >2014-04-09 14:17:18,355 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp-/127.0.0.1:8702-14) [223327c1] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:17:18,446 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-35) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:17:18,470 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-35) [52f5a310] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:17:18,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-35) [52f5a310] START, CreateSnapshotVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageSizeInBytes = 8589934592, volumeFormat = COW, newImageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88, newImageDescription = , imageId = 075b984c-9cb0-4d70-bcc6-ff1cc52f2672, sourceImageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5), log id: 52eb9351 >2014-04-09 14:17:18,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-35) [52f5a310] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:17:18,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-35) [52f5a310] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > size=8,589,934,592 bytes > volFormat=COW > volType=Sparse > volUUID=67516081-3b96-4d92-90be-c5eeb4c6ba88 > descr= > srcImgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > srcVolUUID=075b984c-9cb0-4d70-bcc6-ff1cc52f2672 > >2014-04-09 14:17:18,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-35) [52f5a310] FINISH, CreateSnapshotVDSCommand, return: 67516081-3b96-4d92-90be-c5eeb4c6ba88, log id: 52eb9351 >2014-04-09 14:17:18,532 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) [52f5a310] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 508a03eb-e6c2-4c8d-acad-995676ebf8f6 >2014-04-09 14:17:18,533 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-35) [52f5a310] CommandMultiAsyncTasks::AttachTask: Attaching task c095af61-1961-495f-9767-9cf6805c40e9 to command 508a03eb-e6c2-4c8d-acad-995676ebf8f6. >2014-04-09 14:17:18,546 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-35) [52f5a310] Adding task c095af61-1961-495f-9767-9cf6805c40e9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:17:18,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = b4dc902a-fa9d-4087-be6f-d205e1d06ab5, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = c94403f2-9c40-4485-b8bc-0164ebb23c50, newImageDescription = ), log id: 6e843eb >2014-04-09 14:17:18,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:17:18,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=b4dc902a-fa9d-4087-be6f-d205e1d06ab5 > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=c94403f2-9c40-4485-b8bc-0164ebb23c50 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:17:18,610 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) FINISH, CreateImageVDSCommand, return: c94403f2-9c40-4485-b8bc-0164ebb23c50, log id: 6e843eb >2014-04-09 14:17:18,648 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-35) CommandMultiAsyncTasks::AttachTask: Attaching task 308ebc9e-2ebe-4793-9cc5-34b2602ca571 to command 508a03eb-e6c2-4c8d-acad-995676ebf8f6. >2014-04-09 14:17:18,655 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-35) Adding task 308ebc9e-2ebe-4793-9cc5-34b2602ca571 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:17:18,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 943affa0-5d18-4fe7-a029-c5fef2e67cae, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 90c6db7d-d8f0-41a0-861b-20a4f6ae3cbb, newImageDescription = ), log id: 51c5c0be >2014-04-09 14:17:18,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:17:18,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=943affa0-5d18-4fe7-a029-c5fef2e67cae > size=1,350,565,888 bytes > volFormat=RAW > volType=Preallocated > volUUID=90c6db7d-d8f0-41a0-861b-20a4f6ae3cbb > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:17:18,700 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-35) FINISH, CreateImageVDSCommand, return: 90c6db7d-d8f0-41a0-861b-20a4f6ae3cbb, log id: 51c5c0be >2014-04-09 14:17:18,730 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-35) CommandMultiAsyncTasks::AttachTask: Attaching task d56dc903-c211-4e59-8299-61e3f717749f to command 508a03eb-e6c2-4c8d-acad-995676ebf8f6. >2014-04-09 14:17:18,737 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-35) Adding task d56dc903-c211-4e59-8299-61e3f717749f (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:17:18,771 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) Correlation ID: 223327c1, Job ID: af0a3467-b3c2-4d0e-ad3b-89f965a513c4, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's3' creation for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:17:18,771 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::StartPollingTask: Starting to poll task c095af61-1961-495f-9767-9cf6805c40e9. >2014-04-09 14:17:18,771 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::StartPollingTask: Starting to poll task 308ebc9e-2ebe-4793-9cc5-34b2602ca571. >2014-04-09 14:17:18,772 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::StartPollingTask: Starting to poll task d56dc903-c211-4e59-8299-61e3f717749f. >2014-04-09 14:17:24,842 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-58) Polling and updating Async Tasks: 10 tasks, 4 tasks to poll now >2014-04-09 14:17:25,270 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task d56dc903-c211-4e59-8299-61e3f717749f (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:17:25,295 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) BaseAsyncTask::OnTaskEndSuccess: Task d56dc903-c211-4e59-8299-61e3f717749f (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:17:25,295 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-58) Task with DB Task ID 4e23c40d-babf-4b34-9cd9-1eb9fd428476 and VDSM Task ID 308ebc9e-2ebe-4793-9cc5-34b2602ca571 is in state Polling. End action for command 508a03eb-e6c2-4c8d-acad-995676ebf8f6 will proceed when all the entitys tasks are completed. >2014-04-09 14:17:25,295 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task c095af61-1961-495f-9767-9cf6805c40e9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:17:25,303 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) BaseAsyncTask::OnTaskEndSuccess: Task c095af61-1961-495f-9767-9cf6805c40e9 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:17:25,304 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-58) Task with DB Task ID 4e23c40d-babf-4b34-9cd9-1eb9fd428476 and VDSM Task ID 308ebc9e-2ebe-4793-9cc5-34b2602ca571 is in state Polling. End action for command 508a03eb-e6c2-4c8d-acad-995676ebf8f6 will proceed when all the entitys tasks are completed. >2014-04-09 14:17:25,304 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task 308ebc9e-2ebe-4793-9cc5-34b2602ca571 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:17:25,312 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) BaseAsyncTask::OnTaskEndSuccess: Task 308ebc9e-2ebe-4793-9cc5-34b2602ca571 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:17:25,312 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-58) CommandAsyncTask::EndActionIfNecessary: All tasks of command 508a03eb-e6c2-4c8d-acad-995676ebf8f6 has ended -> executing EndAction >2014-04-09 14:17:25,312 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-58) CommandAsyncTask::EndAction: Ending action for 3 tasks (command ID: 508a03eb-e6c2-4c8d-acad-995676ebf8f6): calling EndAction . >2014-04-09 14:17:25,312 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-04-09 14:17:25,315 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-58) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:17:25,337 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-04-09 14:17:25,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) START, SnapshotVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 97409f6 >2014-04-09 14:17:28,973 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-57) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Up --> Paused >2014-04-09 14:17:36,488 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) Setting new tasks map. The map contains now 7 tasks >2014-04-09 14:17:40,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-50) FINISH, SnapshotVDSCommand, log id: 97409f6 >2014-04-09 14:17:40,393 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [52f5a310] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-04-09 14:17:40,408 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [52f5a310] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88), log id: ca0126b >2014-04-09 14:17:40,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [52f5a310] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@b8d18842, log id: ca0126b >2014-04-09 14:17:40,960 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:17:40,976 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: 223327c1, Job ID: af0a3467-b3c2-4d0e-ad3b-89f965a513c4, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's3' creation for VM 'vm_vnc' has been completed. >2014-04-09 14:17:40,976 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-04-09 14:17:40,977 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-04-09 14:17:40,985 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 308ebc9e-2ebe-4793-9cc5-34b2602ca571 >2014-04-09 14:17:40,985 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 308ebc9e-2ebe-4793-9cc5-34b2602ca571), log id: 3621a057 >2014-04-09 14:17:40,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=308ebc9e-2ebe-4793-9cc5-34b2602ca571), log id: 59a5cb84 >2014-04-09 14:17:40,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 59a5cb84 >2014-04-09 14:17:40,998 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 3621a057 >2014-04-09 14:17:41,001 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 308ebc9e-2ebe-4793-9cc5-34b2602ca571 from DataBase >2014-04-09 14:17:41,001 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d56dc903-c211-4e59-8299-61e3f717749f >2014-04-09 14:17:41,002 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = d56dc903-c211-4e59-8299-61e3f717749f), log id: 3092996f >2014-04-09 14:17:41,003 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=d56dc903-c211-4e59-8299-61e3f717749f), log id: 68975f52 >2014-04-09 14:17:41,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 68975f52 >2014-04-09 14:17:41,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 3092996f >2014-04-09 14:17:41,018 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task d56dc903-c211-4e59-8299-61e3f717749f from DataBase >2014-04-09 14:17:41,018 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c095af61-1961-495f-9767-9cf6805c40e9 >2014-04-09 14:17:41,019 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = c095af61-1961-495f-9767-9cf6805c40e9), log id: 41d8c4a >2014-04-09 14:17:41,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=c095af61-1961-495f-9767-9cf6805c40e9), log id: 2fe55062 >2014-04-09 14:17:41,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 2fe55062 >2014-04-09 14:17:41,040 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 41d8c4a >2014-04-09 14:17:41,051 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task c095af61-1961-495f-9767-9cf6805c40e9 from DataBase >2014-04-09 14:17:41,051 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 508a03eb-e6c2-4c8d-acad-995676ebf8f6 >2014-04-09 14:17:41,167 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Paused --> Up >2014-04-09 14:17:41,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-69) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 35e027a9 >2014-04-09 14:17:41,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-69) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@f4be3e1, log id: 35e027a9 >2014-04-09 14:17:45,329 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-83) Polling and updating Async Tasks: 7 tasks, 1 tasks to poll now >2014-04-09 14:17:45,340 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-83) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:17:51,401 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 in problem. vds: 10.66.106.32 >2014-04-09 14:17:51,403 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 in problem. vds: 10.66.106.32 >2014-04-09 14:18:06,488 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-89) Setting new tasks map. The map contains now 4 tasks >2014-04-09 14:18:14,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-84) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=0, gracefully=false), log id: 68e33510 >2014-04-09 14:18:15,002 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, DestroyVDSCommand, log id: 68e33510 >2014-04-09 14:18:15,057 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc is down. Exit message: Lost connection with qemu process. >2014-04-09 14:18:15,060 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) vm vm_vnc running in db and not running in vds - add to rerun treatment. vds DC-85.218 >2014-04-09 14:18:15,366 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-04-09 14:18:15,377 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:18:36,489 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) Setting new tasks map. The map contains now 1 tasks >2014-04-09 14:18:36,490 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 14:18:45,399 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-9) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 14:18:45,411 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-9) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:18:50,411 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-17) [c5fb85f] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:18:50,460 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-17) [c5fb85f] START, IsVmDuringInitiatingVDSCommand( vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 77bb1404 >2014-04-09 14:18:50,461 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-17) [c5fb85f] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 77bb1404 >2014-04-09 14:18:50,535 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [c5fb85f] Running command: RunVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:18:50,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [c5fb85f] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 59bc464f >2014-04-09 14:18:50,660 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [c5fb85f] FINISH, IsoPrefixVDSCommand, return: , log id: 59bc464f >2014-04-09 14:18:50,667 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [c5fb85f] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, vm=VM [vm_vnc]), log id: 5b2c2b39 >2014-04-09 14:18:50,673 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [c5fb85f] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, vm=VM [vm_vnc]), log id: 21b1c7fc >2014-04-09 14:18:50,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [c5fb85f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=vnc,smartcardEnable=false,tabletEnable=true,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-2,transparentHugePages=true,vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc,devices=[Ljava.util.HashMap;@6d8f37e8,acpiEnable=true,vmName=vm_vnc,cpuType=Conroe,custom={device_2170b554-07d2-4932-af24-eaf52f187305=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=2170b554-07d2-4932-af24-eaf52f187305, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_2170b554-07d2-4932-af24-eaf52f187305device_80e621ba-33b4-4cd2-ade6-1d431db71373device_568c94b3-94a9-43d3-b8cd-f71bd40ab4b7device_087318d3-da92-4611-b0ef-be99f01b5c3b=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=087318d3-da92-4611-b0ef-be99f01b5c3b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_2170b554-07d2-4932-af24-eaf52f187305device_80e621ba-33b4-4cd2-ade6-1d431db71373=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=80e621ba-33b4-4cd2-ade6-1d431db71373, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_2170b554-07d2-4932-af24-eaf52f187305device_80e621ba-33b4-4cd2-ade6-1d431db71373device_568c94b3-94a9-43d3-b8cd-f71bd40ab4b7=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=568c94b3-94a9-43d3-b8cd-f71bd40ab4b7, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-04-09 14:18:50,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [c5fb85f] FINISH, CreateVDSCommand, log id: 21b1c7fc >2014-04-09 14:18:50,752 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [c5fb85f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5b2c2b39 >2014-04-09 14:18:50,752 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [c5fb85f] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:18:50,769 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [c5fb85f] Correlation ID: c5fb85f, Job ID: 3a89d75c-4b92-4a8f-87d6-ca2bc619b3cf, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc was started by admin@internal (Host: DC-85.218). >2014-04-09 14:18:51,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 43bd83e5 >2014-04-09 14:18:51,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4f1e5221, log id: 43bd83e5 >2014-04-09 14:18:51,510 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-45) Received a memballoon Device without an address when processing VM 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc devices, skipping device: {specParams={model=virtio}, target=1048576, device=memballoon, type=balloon, deviceId=51a052a9-d1da-44ab-a493-41a81f5e9e0c} >2014-04-09 14:18:54,627 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from WaitForLaunch --> PoweringUp >2014-04-09 14:18:54,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-54) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 3828a9d0 >2014-04-09 14:18:54,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-54) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@7aaec6a4, log id: 3828a9d0 >2014-04-09 14:19:07,955 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-46) VM vm4 a3a055b8-512e-47e3-95ec-2a8cfd338eb4 moved from Up --> NotResponding >2014-04-09 14:19:07,984 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-46) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm4 is not responding. >2014-04-09 14:19:07,991 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-46) VM vm3 c9ccfdfe-0f0d-4c96-8bd7-47723067081a moved from Up --> NotResponding >2014-04-09 14:19:08,009 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-46) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm3 is not responding. >2014-04-09 14:19:19,291 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [49f7f75f] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:19:19,294 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [49f7f75f] Entered (VM vm3). >2014-04-09 14:19:19,295 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [49f7f75f] Cannot shutdown VM vm3, status is not up. Stopping instead. >2014-04-09 14:19:19,307 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-50) [24a667ba] Running command: StopVmCommand internal: true. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:19:19,314 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [24a667ba] START, DestroyVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: 51f9b5a2 >2014-04-09 14:19:19,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [24a667ba] START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: 1fdba068 >2014-04-09 14:19:23,615 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-48) [2a4a9f0f] Running command: ShutdownVmCommand internal: false. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM >2014-04-09 14:19:23,619 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-48) [2a4a9f0f] Entered (VM vm4). >2014-04-09 14:19:23,619 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-48) [2a4a9f0f] Cannot shutdown VM vm4, status is not up. Stopping instead. >2014-04-09 14:19:23,626 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-48) [5bf1a582] Running command: StopVmCommand internal: true. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM >2014-04-09 14:19:23,635 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-48) [5bf1a582] START, DestroyVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=a3a055b8-512e-47e3-95ec-2a8cfd338eb4, force=false, secondsToWait=0, gracefully=false), log id: 13b98948 >2014-04-09 14:19:34,972 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-35) [4715f554] Running command: StopVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:19:34,978 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-35) [4715f554] START, DestroyVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: 6b03a274 >2014-04-09 14:19:52,727 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from PoweringUp --> Up >2014-04-09 14:19:52,853 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-64) Correlation ID: c5fb85f, Job ID: 3a89d75c-4b92-4a8f-87d6-ca2bc619b3cf, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc started on Host DC-85.218 >2014-04-09 14:21:18,354 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-14) [4b16884b] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:21:18,361 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [4b16884b] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=+bpoxNhN0GS0, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 548d45ca >2014-04-09 14:21:18,435 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [4b16884b] FINISH, SetVmTicketVDSCommand, log id: 548d45ca >2014-04-09 14:21:18,475 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [4b16884b] Correlation ID: 4b16884b, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 14:21:48,813 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-8) [6813b9d1] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:21:48,955 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (pool-4-thread-46) [6813b9d1] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:21:49,002 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-46) [6813b9d1] START, MigrateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, srcHost=10.66.85.218, dstVdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, dstHost=10.66.85.215:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 5ace7b57 >2014-04-09 14:21:49,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-46) [6813b9d1] VdsBroker::migrate::Entered (vm_guid=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, srcHost=10.66.85.218, dstHost=10.66.85.215:54321, method=online >2014-04-09 14:21:49,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-46) [6813b9d1] START, MigrateBrokerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, srcHost=10.66.85.218, dstVdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, dstHost=10.66.85.215:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 77d7f900 >2014-04-09 14:21:49,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-46) [6813b9d1] FINISH, MigrateBrokerVDSCommand, log id: 77d7f900 >2014-04-09 14:21:49,030 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-46) [6813b9d1] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5ace7b57 >2014-04-09 14:21:49,049 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [6813b9d1] Correlation ID: 6813b9d1, Job ID: ae359826-1af6-4f75-87e0-105428aeee9b, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: vm_vnc, Source: DC-85.218, Destination: DC-85.215, User: admin@internal). >2014-04-09 14:21:51,265 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 14:21:54,319 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 14:21:55,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-55) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 70348e08 >2014-04-09 14:21:55,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-55) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@a58e8c5, log id: 70348e08 >2014-04-09 14:21:57,408 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-42) RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 14:22:00,439 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 14:22:03,477 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-37) RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 14:22:06,507 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-47) [1ad889f5] RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 14:22:09,748 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-99) START, FullListVdsCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 1cf2514c >2014-04-09 14:22:09,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-99) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@5fe07d29, log id: 1cf2514c >2014-04-09 14:22:09,863 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-99) Correlation ID: 6813b9d1, Job ID: ae359826-1af6-4f75-87e0-105428aeee9b, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: vm_vnc, Source: DC-85.218, Destination: DC-85.215, Duration: 20 sec). >2014-04-09 14:22:09,872 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (DefaultQuartzScheduler_Worker-99) Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:22:10,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-51) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=0, gracefully=false), log id: 110ff601 >2014-04-09 14:22:11,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, DestroyVDSCommand, log id: 110ff601 >2014-04-09 14:22:11,917 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-51) RefreshVmList vm id 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc status = Down on vds DC-85.218 ignoring it in the refresh until migration is done >2014-04-09 14:22:19,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [24a667ba] Command DestroyVDS execution failed. Exception: VDSNetworkException: java.util.concurrent.TimeoutException >2014-04-09 14:22:19,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [24a667ba] FINISH, DestroyVDSCommand, log id: 1fdba068 >2014-04-09 14:22:19,327 ERROR [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [24a667ba] VDS::destroy Failed destroying vm c9ccfdfe-0f0d-4c96-8bd7-47723067081a in vds = 539a81aa-3a8e-4454-b673-e6092c868b2c : 10.66.106.32, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException >2014-04-09 14:22:19,327 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [24a667ba] FINISH, DestroyVmVDSCommand, log id: 51f9b5a2 >2014-04-09 14:22:19,328 ERROR [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-50) [24a667ba] Command org.ovirt.engine.core.bll.StopVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-04-09 14:22:19,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: 1d8e88c4 >2014-04-09 14:22:19,370 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [24a667ba] Correlation ID: 24a667ba, Call Stack: null, Custom Event ID: -1, Message: Failed to power off VM vm3 (Host: 10.66.106.32, User: admin@internal). >2014-04-09 14:22:30,912 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] Failed in DestroyVDS method >2014-04-09 14:22:30,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] Error code noVM and error message VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2014-04-09 14:22:30,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] Command org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=1, mMessage=Virtual machine does not exist]] >2014-04-09 14:22:30,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] HostName = 10.66.106.32 >2014-04-09 14:22:30,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] Command DestroyVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2014-04-09 14:22:30,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-35) [4715f554] FINISH, DestroyVDSCommand, log id: 1d8e88c4 >2014-04-09 14:22:30,913 ERROR [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-35) [4715f554] VDS::destroy Failed destroying vm c9ccfdfe-0f0d-4c96-8bd7-47723067081a in vds = 539a81aa-3a8e-4454-b673-e6092c868b2c : 10.66.106.32, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist >2014-04-09 14:22:30,914 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-35) [4715f554] FINISH, DestroyVmVDSCommand, log id: 6b03a274 >2014-04-09 14:22:30,914 ERROR [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-35) [4715f554] Command org.ovirt.engine.core.bll.StopVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DestroyVDS, error = Virtual machine does not exist (Failed with error noVM and code 1) >2014-04-09 14:22:30,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-48) [5bf1a582] START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=a3a055b8-512e-47e3-95ec-2a8cfd338eb4, force=false, secondsToWait=0, gracefully=false), log id: 598473e7 >2014-04-09 14:22:30,935 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [4715f554] Correlation ID: 4715f554, Job ID: ec2723f6-f178-4817-a6ea-7562ff708e0e, Call Stack: null, Custom Event ID: -1, Message: Failed to power off VM vm3 (Host: 10.66.106.32, User: admin@internal). >2014-04-09 14:22:51,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) starting ProcessDomainRecovery for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 >2014-04-09 14:22:51,479 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) vds 10.66.106.32 reported domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 as in problem, attempting to move the vds to status NonOperational >2014-04-09 14:22:51,485 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 has recovered from problem. No active host in the DC is reporting it as poblematic, so clearing the domain recovery timer. >2014-04-09 14:22:51,516 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (pool-4-thread-50) [1dbb2ea8] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 14:22:51,519 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [1dbb2ea8] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=NonOperational, nonOperationalReason=STORAGE_DOMAIN_UNREACHABLE), log id: 16943248 >2014-04-09 14:23:30,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 6a2780e2 >2014-04-09 14:23:30,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetDeviceListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageType=ISCSI), log id: da2b41 >2014-04-09 14:23:35,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123, org.ovirt.engine.core.common.businessentities.LUNs@8f6fd83e], log id: 6a2780e2 >2014-04-09 14:23:38,408 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@24548aff], log id: da2b41 >2014-04-09 14:23:48,706 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp-/127.0.0.1:8702-14) START, DiscoverSendTargetsVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, connection={ id: null, connection: 10.66.90.100, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };), log id: 7195f7eb >2014-04-09 14:23:48,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp-/127.0.0.1:8702-14) FINISH, DiscoverSendTargetsVDSCommand, return: [{ id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-12a1f7d03-0daf49b25a84ee02-s3-kyla-131842, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-6eb1f7d03-30cf49b25f24f94d-libvirt-1-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-1661f7d03-5e9f49b2673503d8-s3-bcao-166669-81, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-18d1f7d03-a35f49b2675503d8-s3-bcao-166669-82, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-42a1f7d03-0a3f49b42065281e-s3-jiahu-265383-1, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], log id: 7195f7eb >2014-04-09 14:23:56,808 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp-/127.0.0.1:8702-15) [4716410] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:23:56,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-15) [4716410] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 124649b >2014-04-09 14:24:07,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-15) [4716410] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 124649b >2014-04-09 14:24:07,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetDeviceListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageType=ISCSI), log id: 53bb542 >2014-04-09 14:24:16,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@24548aff, org.ovirt.engine.core.common.businessentities.LUNs@aed12835], log id: 53bb542 >2014-04-09 14:24:36,311 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:24:36,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] START, CreateVGVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageDomainId=7cee4e2f-9997-4578-8396-c3aabb03d4c6, deviceList=[36090a038d0f7f1441e288520b4497f8e], force=true), log id: 5ac6b7df >2014-04-09 14:24:37,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] FINISH, CreateVGVDSCommand, return: yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B, log id: 5ac6b7df >2014-04-09 14:24:37,716 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] START, CreateStorageDomainVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@2a4ec1a0, args=yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B), log id: 46376399 >2014-04-09 14:24:53,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] FINISH, CreateStorageDomainVDSCommand, log id: 46376399 >2014-04-09 14:24:53,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] START, GetStorageDomainStatsVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageDomainId=7cee4e2f-9997-4578-8396-c3aabb03d4c6), log id: 4e58d426 >2014-04-09 14:24:53,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@ed6fbf79, log id: 4e58d426 >2014-04-09 14:24:53,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] START, GetVGInfoVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, VGID=yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B), log id: 27f8c3e8 >2014-04-09 14:24:53,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@ee83013a], log id: 27f8c3e8 >2014-04-09 14:24:54,042 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [1c8ca2b7] Correlation ID: 1c8ca2b7, Job ID: 27daa34f-6519-4978-9b08-2328315f427b, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_2 was added by admin@internal >2014-04-09 14:24:54,267 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-15) [1cb47a75] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:24:54,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [1cb47a75] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: bef1546e-0fbb-46d2-acf2-7ff7d2182d93, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 18859de2 >2014-04-09 14:24:54,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [1cb47a75] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: bef1546e-0fbb-46d2-acf2-7ff7d2182d93, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 295bb9e4 >2014-04-09 14:24:54,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [1cb47a75] FINISH, ConnectStorageServerVDSCommand, return: {bef1546e-0fbb-46d2-acf2-7ff7d2182d93=0}, log id: 18859de2 >2014-04-09 14:24:54,384 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-47) [324a299b] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:24:54,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-47) [324a299b] START, GetVGInfoVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, VGID=yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B), log id: 60bbdc0 >2014-04-09 14:24:54,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-47) [324a299b] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@ee83013a], log id: 60bbdc0 >2014-04-09 14:25:05,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [1cb47a75] FINISH, ConnectStorageServerVDSCommand, return: {bef1546e-0fbb-46d2-acf2-7ff7d2182d93=0}, log id: 295bb9e4 >2014-04-09 14:25:05,029 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-49) [bced591] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:25:05,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] START, GetVGInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, VGID=yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B), log id: 435dd59c >2014-04-09 14:25:05,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] Failed in GetVGInfoVDS method >2014-04-09 14:25:05,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] Error code VolumeGroupDoesNotExist and error message VDSGenericException: VDSErrorException: Failed to GetVGInfoVDS, error = Volume Group does not exist: ('vg_uuid: yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B',) >2014-04-09 14:25:05,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand return value > >OneVGReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=506, mMessage=Volume Group does not exist: ('vg_uuid: yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B',)]] > >2014-04-09 14:25:05,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] HostName = DC-85.218 >2014-04-09 14:25:05,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] Command GetVGInfoVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVGInfoVDS, error = Volume Group does not exist: ('vg_uuid: yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B',) >2014-04-09 14:25:05,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-49) [bced591] FINISH, GetVGInfoVDSCommand, log id: 435dd59c >2014-04-09 14:25:05,056 ERROR [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-49) [bced591] Command org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVGInfoVDS, error = Volume Group does not exist: ('vg_uuid: yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B',) (Failed with error VolumeGroupDoesNotExist and code 506) >2014-04-09 14:25:05,060 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-15) [1cb47a75] START, AttachStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6), log id: 55773f00 >2014-04-09 14:25:30,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-48) [5bf1a582] FINISH, DestroyVDSCommand, log id: 598473e7 >2014-04-09 14:25:30,786 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-48) [5bf1a582] FINISH, DestroyVmVDSCommand, return: Down, log id: 13b98948 >2014-04-09 14:25:30,805 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) vm vm3 running in db and not running in vds - add to rerun treatment. vds 10.66.106.32 >2014-04-09 14:25:30,812 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [5bf1a582] Correlation ID: 5bf1a582, Call Stack: null, Custom Event ID: -1, Message: VM vm4 was powered off ungracefully by admin@internal (Host: 10.66.106.32). >2014-04-09 14:25:30,938 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [1dbb2ea8] VDS 10.66.106.32 is spm and moved from up calling ResetIrs. >2014-04-09 14:25:30,940 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-50) [1dbb2ea8] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 539a81aa-3a8e-4454-b673-e6092c868b2c, ignoreStopFailed = false), log id: 4a97b03a >2014-04-09 14:25:30,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [1dbb2ea8] START, SpmStopVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 127d426d >2014-04-09 14:25:30,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [1dbb2ea8] FINISH, SpmStopVDSCommand, log id: 127d426d >2014-04-09 14:25:30,958 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-50) [1dbb2ea8] FINISH, ResetIrsVDSCommand, log id: 4a97b03a >2014-04-09 14:25:30,958 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [1dbb2ea8] FINISH, SetVdsStatusVDSCommand, log id: 16943248 >2014-04-09 14:25:30,980 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [1dbb2ea8] Correlation ID: 1dbb2ea8, Job ID: 2b498933-7023-46f6-9edf-8192b19533e5, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 cannot access one of the Storage Domains attached to the Data Center NFS_shyu. Setting Host state to Non-Operational. >2014-04-09 14:25:31,039 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-4-thread-48) [abd4278] Lock Acquired to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:25:31,113 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-4-thread-48) [abd4278] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-09 14:25:31,180 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-48) [abd4278] START, MigrateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, srcHost=10.66.106.32, dstVdsId=8b916f9f-d5e6-40a1-8e4b-58ef7df47820, dstHost=10.66.106.40:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 730dc57d >2014-04-09 14:25:31,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-48) [abd4278] VdsBroker::migrate::Entered (vm_guid=e7983b62-8992-42a8-afd7-f7b815d80bbb, srcHost=10.66.106.32, dstHost=10.66.106.40:54321, method=online >2014-04-09 14:25:31,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-48) [abd4278] START, MigrateBrokerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, srcHost=10.66.106.32, dstVdsId=8b916f9f-d5e6-40a1-8e4b-58ef7df47820, dstHost=10.66.106.40:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 30de828 >2014-04-09 14:25:31,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-48) [abd4278] FINISH, MigrateBrokerVDSCommand, log id: 30de828 >2014-04-09 14:25:31,212 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-48) [abd4278] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 730dc57d >2014-04-09 14:25:31,255 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-4-thread-48) [d3d8a54] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:25:31,256 WARN [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-4-thread-48) [d3d8a54] CanDoAction of action InternalMigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_DISK_IS_BEING_MIGRATED,$DiskName vm1_Disk1 >2014-04-09 14:25:31,271 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (pool-4-thread-48) [d3d8a54] ResourceManager::vdsMaintenance - Failed migrating desktop vm1 >2014-04-09 14:25:33,804 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) RefreshVmList vm id e7983b62-8992-42a8-afd7-f7b815d80bbb is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:25:34,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-8) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[e7983b62-8992-42a8-afd7-f7b815d80bbb]), log id: 2405ebe9 >2014-04-09 14:25:34,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-8) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@c32079, log id: 2405ebe9 >2014-04-09 14:25:34,070 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [696 MB] is under defined threshold [1024 MB]. >2014-04-09 14:25:36,760 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [49fed2b] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:25:36,778 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [49fed2b] START, SetVmTicketVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=PTv0JflyqVOO, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 67938220 >2014-04-09 14:25:36,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [49fed2b] FINISH, SetVmTicketVDSCommand, log id: 67938220 >2014-04-09 14:25:36,845 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) RefreshVmList vm id e7983b62-8992-42a8-afd7-f7b815d80bbb is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:25:36,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [49fed2b] Correlation ID: 49fed2b, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 14:25:38,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-15) [1cb47a75] FINISH, AttachStorageDomainVDSCommand, log id: 55773f00 >2014-04-09 14:25:38,796 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] Lock Acquired to object EngineLock [exclusiveLocks= key: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 value: STORAGE >, sharedLocks= ] >2014-04-09 14:25:38,812 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:25:38,820 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] Lock freed to object EngineLock [exclusiveLocks= key: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 value: STORAGE >, sharedLocks= ] >2014-04-09 14:25:38,820 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 2:25 PM >2014-04-09 14:25:38,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [37b748ca] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: bef1546e-0fbb-46d2-acf2-7ff7d2182d93, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 70a392ec >2014-04-09 14:25:38,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [37b748ca] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: bef1546e-0fbb-46d2-acf2-7ff7d2182d93, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 323e9b4d >2014-04-09 14:25:39,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [37b748ca] FINISH, ConnectStorageServerVDSCommand, return: {bef1546e-0fbb-46d2-acf2-7ff7d2182d93=0}, log id: 70a392ec >2014-04-09 14:25:39,338 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-46) [624c9eaf] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:25:39,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-46) [624c9eaf] START, GetVGInfoVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, VGID=yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B), log id: 28b5d1c9 >2014-04-09 14:25:39,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [37b748ca] FINISH, ConnectStorageServerVDSCommand, return: {bef1546e-0fbb-46d2-acf2-7ff7d2182d93=0}, log id: 323e9b4d >2014-04-09 14:25:39,537 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForIscsiStorageDomainCommand] (pool-4-thread-48) [442e1344] Running command: SyncLunsInfoForIscsiStorageDomainCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:25:39,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-48) [442e1344] START, GetVGInfoVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, VGID=yWg3FZ-qdFg-NnH5-d70y-4K0q-o709-4GIy2B), log id: 1119182a >2014-04-09 14:25:39,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-46) [624c9eaf] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@ee83013a], log id: 28b5d1c9 >2014-04-09 14:25:40,072 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (pool-4-thread-48) [442e1344] FINISH, GetVGInfoVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@599e4e79], log id: 1119182a >2014-04-09 14:25:40,081 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] START, ActivateStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6), log id: 40d7567 >2014-04-09 14:25:40,203 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-68) START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, force=false, secondsToWait=0, gracefully=false), log id: 7e5ad9dc >2014-04-09 14:25:40,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, DestroyVDSCommand, log id: 7e5ad9dc >2014-04-09 14:25:40,611 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) Handing over VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb to Host 8b916f9f-d5e6-40a1-8e4b-58ef7df47820. Setting VM to status MigratingTo >2014-04-09 14:25:40,611 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) vm vm2 running in db and not running in vds - add to rerun treatment. vds 10.66.106.32 >2014-04-09 14:25:41,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-51) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-04-09 14:25:41,923 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-51) Failed to refresh VDS , vds = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 : 10.66.106.40, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-04-09 14:25:45,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vds=Host[10.66.106.40]), log id: 6283c6cb >2014-04-09 14:25:45,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GetHardwareInfoVDSCommand, log id: 6283c6cb >2014-04-09 14:25:45,044 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.40. >2014-04-09 14:25:46,067 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) VM vm2 e7983b62-8992-42a8-afd7-f7b815d80bbb moved from MigratingTo --> Up >2014-04-09 14:25:46,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) START, FullListVdsCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vds=Host[10.66.106.40], vmIds=[e7983b62-8992-42a8-afd7-f7b815d80bbb]), log id: a665ec1 >2014-04-09 14:25:46,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@46d6d63c, log id: a665ec1 >2014-04-09 14:25:46,083 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-39) [62338171] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:25:46,093 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-39) [776ac15] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:25:46,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-39) [776ac15] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 364d63a3 >2014-04-09 14:25:46,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-39) [776ac15] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 364d63a3 >2014-04-09 14:25:46,161 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-39) [776ac15] Host 10.66.106.40 storage connection was succeeded >2014-04-09 14:25:46,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 4ec76466 >2014-04-09 14:25:48,374 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) FINISH, ConnectStoragePoolVDSCommand, log id: 4ec76466 >2014-04-09 14:25:48,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-39) [776ac15] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: 785979a8 >2014-04-09 14:25:48,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-39) [776ac15] FINISH, SetMOMPolicyParametersVDSCommand, log id: 785979a8 >2014-04-09 14:25:48,475 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) [776ac15] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-09 14:25:48,531 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-39) [1c054b03] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 14:25:48,542 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-39) [1e736b86] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 14:25:48,577 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) [1e736b86] Correlation ID: abd4278, Job ID: a81b4743-9b9c-4a3d-a931-211e3094050b, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: vm2, Source: 10.66.106.32, Destination: 10.66.106.40, Duration: 17 sec). >2014-04-09 14:25:48,586 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-39) [1e736b86] Lock freed to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-09 14:25:52,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] FINISH, ActivateStorageDomainVDSCommand, log id: 40d7567 >2014-04-09 14:25:52,879 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 2:25 PM >2014-04-09 14:25:52,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-46) [37b748ca] START, RefreshStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 3b39ac6a >2014-04-09 14:25:52,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [37b748ca] START, RefreshStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 1560f869 >2014-04-09 14:25:52,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-46) [37b748ca] FINISH, RefreshStoragePoolVDSCommand, log id: 3b39ac6a >2014-04-09 14:25:52,944 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-46) [37b748ca] Refreshed vds DC-85.215 in pool dc_iscsi >2014-04-09 14:26:09,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [37b748ca] FINISH, RefreshStoragePoolVDSCommand, log id: 1560f869 >2014-04-09 14:26:09,864 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-50) [37b748ca] Refreshed vds DC-85.218 in pool dc_iscsi >2014-04-09 14:26:09,891 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-15) [37b748ca] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 2:26 PM >2014-04-09 14:26:09,908 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [37b748ca] Correlation ID: 37b748ca, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_2 (Data Center dc_iscsi) was activated by admin@internal >2014-04-09 14:26:09,924 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [37b748ca] Correlation ID: 1cb47a75, Job ID: 68b9cbbd-15c0-452d-9744-21d20b225af3, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_2 was attached to Data Center dc_iscsi by admin@internal >2014-04-09 14:26:50,897 INFO [org.ovirt.engine.core.bll.MoveDisksCommand] (ajp-/127.0.0.1:8702-8) [d5f17dd] Running command: MoveDisksCommand internal: false. Entities affected : ID: 5d1d405b-6c8d-4973-8e80-c11555885cc5 Type: Disk >2014-04-09 14:26:50,966 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (ajp-/127.0.0.1:8702-8) [d5f17dd] Lock Acquired to object EngineLock [exclusiveLocks= key: 5d1d405b-6c8d-4973-8e80-c11555885cc5 value: DISK >, sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 14:26:51,108 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-50) [d5f17dd] Running command: LiveMigrateVmDisksCommand Task handler: LiveSnapshotTaskHandler internal: false. Entities affected : ID: 67516081-3b96-4d92-90be-c5eeb4c6ba88 Type: Disk, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:26:51,256 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-50) Running command: CreateAllSnapshotsFromVmCommand internal: true. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:26:51,283 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-50) [292246bb] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:26:51,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [292246bb] START, CreateSnapshotVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageSizeInBytes = 8589934592, volumeFormat = COW, newImageId = 496ee212-3fd7-4fd8-b42f-1642583603a0, newImageDescription = , imageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88, sourceImageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5), log id: 7dbdcc56 >2014-04-09 14:26:51,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [292246bb] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:26:51,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [292246bb] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > size=8,589,934,592 bytes > volFormat=COW > volType=Sparse > volUUID=496ee212-3fd7-4fd8-b42f-1642583603a0 > descr= > srcImgGUID=5d1d405b-6c8d-4973-8e80-c11555885cc5 > srcVolUUID=67516081-3b96-4d92-90be-c5eeb4c6ba88 > >2014-04-09 14:26:51,334 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (pool-4-thread-50) [292246bb] FINISH, CreateSnapshotVDSCommand, return: 496ee212-3fd7-4fd8-b42f-1642583603a0, log id: 7dbdcc56 >2014-04-09 14:26:51,343 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [292246bb] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command f7b60815-3518-45af-aed6-1c0fc24bf532 >2014-04-09 14:26:51,343 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [292246bb] CommandMultiAsyncTasks::AttachTask: Attaching task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 to command f7b60815-3518-45af-aed6-1c0fc24bf532. >2014-04-09 14:26:51,356 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [292246bb] Adding task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:26:51,423 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: 471e0bec, Job ID: 0f405dee-8784-446e-ae8c-783a4361f743, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'Auto-generated for Live Storage Migration' creation for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:26:51,440 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::StartPollingTask: Starting to poll task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8. >2014-04-09 14:26:56,761 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-42) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-04-09 14:26:56,787 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) SPMAsyncTask::PollTask: Polling task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:26:56,787 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-42) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:27:06,568 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-1) [31e72504] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:27:06,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [31e72504] START, SetVmTicketVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=pfjpltVYhGM5, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 69ba9188 >2014-04-09 14:27:06,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [31e72504] FINISH, SetVmTicketVDSCommand, log id: 69ba9188 >2014-04-09 14:27:06,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [31e72504] Correlation ID: 31e72504, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 14:27:37,380 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:27:37,414 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) BaseAsyncTask::OnTaskEndSuccess: Task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 (Parent Command LiveMigrateVmDisks, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:27:37,415 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-10) CommandAsyncTask::EndActionIfNecessary: All tasks of command f7b60815-3518-45af-aed6-1c0fc24bf532 has ended -> executing EndAction >2014-04-09 14:27:37,415 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-10) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: f7b60815-3518-45af-aed6-1c0fc24bf532): calling EndAction . >2014-04-09 14:27:37,416 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateVmDisks, executionIndex: 0 >2014-04-09 14:27:37,432 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-47) Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand >2014-04-09 14:27:37,481 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (pool-4-thread-47) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-04-09 14:27:37,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-47) START, SnapshotVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 3c5e3796 >2014-04-09 14:27:48,456 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (pool-4-thread-47) FINISH, SnapshotVDSCommand, log id: 3c5e3796 >2014-04-09 14:27:48,458 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-4-thread-47) [292246bb] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-04-09 14:27:48,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [292246bb] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 496ee212-3fd7-4fd8-b42f-1642583603a0), log id: 3974fe9d >2014-04-09 14:27:48,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [292246bb] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@635e3d2, log id: 3974fe9d >2014-04-09 14:27:48,884 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'Auto-generated for Live Storage Migration' creation for VM 'vm_vnc' has been completed. >2014-04-09 14:27:48,901 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-47) Running command: LiveMigrateVmDisksCommand Task handler: LiveMigrateDisksTaskHandler internal: false. Entities affected : ID: 67516081-3b96-4d92-90be-c5eeb4c6ba88 Type: Disk, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:27:49,020 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-47) [3f3a7f06] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 14:27:49,051 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-47) [3f3a7f06] Running command: LiveMigrateDiskCommand Task handler: CreateImagePlaceholderTaskHandler internal: true. Entities affected : ID: 5d1d405b-6c8d-4973-8e80-c11555885cc5 Type: Disk, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:27:49,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CloneImageGroupStructureVDSCommand] (pool-4-thread-47) [3f3a7f06] START, CloneImageGroupStructureVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, dstDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6), log id: 72112cc3 >2014-04-09 14:27:49,119 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CloneImageGroupStructureVDSCommand] (pool-4-thread-47) [3f3a7f06] FINISH, CloneImageGroupStructureVDSCommand, log id: 72112cc3 >2014-04-09 14:27:49,145 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) [3f3a7f06] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 87619e60-dbf4-45f8-baae-160d70658c89 >2014-04-09 14:27:49,145 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-47) [3f3a7f06] CommandMultiAsyncTasks::AttachTask: Attaching task fb2758da-e449-4589-978d-e068edca2971 to command 87619e60-dbf4-45f8-baae-160d70658c89. >2014-04-09 14:27:49,209 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-47) [3f3a7f06] Adding task fb2758da-e449-4589-978d-e068edca2971 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:27:49,226 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [3f3a7f06] Correlation ID: 3f3a7f06, Job ID: 5dc5eb4f-01ba-4893-8ebb-8db3f64dcb2a, Call Stack: null, Custom Event ID: -1, Message: User admin@internal moving disk vm_vnc_Disk1 to domain dc_ISCSI_2. >2014-04-09 14:27:49,226 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) [3f3a7f06] BaseAsyncTask::StartPollingTask: Starting to poll task fb2758da-e449-4589-978d-e068edca2971. >2014-04-09 14:27:49,227 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) [3f3a7f06] BaseAsyncTask::StartPollingTask: Starting to poll task fb2758da-e449-4589-978d-e068edca2971. >2014-04-09 14:27:49,228 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-4-thread-47) [3f3a7f06] Lock freed to object EngineLock [exclusiveLocks= key: 5d1d405b-6c8d-4973-8e80-c11555885cc5 value: DISK >, sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 14:27:49,229 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateVmDisks completed, handling the result. >2014-04-09 14:27:49,229 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateVmDisks succeeded, clearing tasks. >2014-04-09 14:27:49,234 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 >2014-04-09 14:27:49,235 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8), log id: 705c088b >2014-04-09 14:27:49,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8), log id: 2a35174e >2014-04-09 14:27:49,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 2a35174e >2014-04-09 14:27:49,247 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 705c088b >2014-04-09 14:27:49,251 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 53a08ccc-c7a4-4c0e-a2c3-a558f5ca9ef8 from DataBase >2014-04-09 14:27:49,251 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity f7b60815-3518-45af-aed6-1c0fc24bf532 >2014-04-09 14:27:51,415 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-24) START, FullListVdsCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 7af6ed87 >2014-04-09 14:27:51,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-24) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@69647922, log id: 7af6ed87 >2014-04-09 14:27:57,433 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-63) Polling and updating Async Tasks: 3 tasks, 2 tasks to poll now >2014-04-09 14:27:57,459 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-63) SPMAsyncTask::PollTask: Polling task fb2758da-e449-4589-978d-e068edca2971 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:27:57,460 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-63) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:28:45,404 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-5) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-04-09 14:28:45,422 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Failed to refresh VDS , vds = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 : 10.66.106.40, VDS Network Error, continuing. >java.net.SocketException: Connection reset >2014-04-09 14:28:48,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@533d76bc >2014-04-09 14:28:48,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) HostName = 10.66.106.40 >2014-04-09 14:28:48,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-04-09 14:28:48,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:42) > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:16) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >, Custom Event ID: -1, Message: Host 10.66.106.40 is initializing. Message: Recovering from crash or Initializing >2014-04-09 14:28:48,536 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-68) Failed to refresh VDS , vds = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 : 10.66.106.40, error = Recovering from crash or Initializing, continuing. >2014-04-09 14:28:51,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) [2adec5ff] START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vds=Host[10.66.106.40]), log id: 40e26e7c >2014-04-09 14:28:51,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-14) [2adec5ff] FINISH, GetHardwareInfoVDSCommand, log id: 40e26e7c >2014-04-09 14:28:51,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [2adec5ff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.40. >2014-04-09 14:28:51,753 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) [2adec5ff] Cancelling the recovery from crash timer for VDS 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 because vds started initializing >2014-04-09 14:28:51,754 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-14) [2695651e] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:28:51,758 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:28:51,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f6169f9 >2014-04-09 14:28:51,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 7f6169f9 >2014-04-09 14:28:51,904 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] Host 10.66.106.40 storage connection was succeeded >2014-04-09 14:28:51,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 607c12b >2014-04-09 14:28:55,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) FINISH, ConnectStoragePoolVDSCommand, log id: 607c12b >2014-04-09 14:28:55,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: 8c1a893 >2014-04-09 14:28:55,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] FINISH, SetMOMPolicyParametersVDSCommand, log id: 8c1a893 >2014-04-09 14:28:55,800 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [1b8aa2f2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-09 14:28:55,816 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-14) [664479bb] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 14:28:55,838 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-14) [cc3164a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-09 14:30:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) Autorecovering 1 hosts >2014-04-09 14:30:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) Autorecovering hosts id: 539a81aa-3a8e-4454-b673-e6092c868b2c, name : 10.66.106.32 >2014-04-09 14:30:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 14:30:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 14:30:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] Before acquiring lock in order to prevent monitoring for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 14:30:00,020 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:00,266 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:01,245 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:02,798 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:03,285 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:04,342 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:05,817 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:06,306 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:07,360 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:08,956 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:09,325 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:10,379 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [199fff46] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS_INIT >, sharedLocks= ] >2014-04-09 14:30:11,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-6) Command ListVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-04-09 14:30:11,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-15) Command SpmStatusVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-04-09 14:30:11,748 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:30:11,782 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Failed to refresh VDS , vds = 539a81aa-3a8e-4454-b673-e6092c868b2c : 10.66.106.32, VDS Network Error, continuing. >java.net.SocketException: Connection reset >2014-04-09 14:30:11,782 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] Lock acquired, from now a monitoring of host will be skipped for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 14:30:11,789 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=Unassigned, nonOperationalReason=NONE), log id: 71feccc8 >2014-04-09 14:30:11,800 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] VDS 10.66.106.32 is spm and moved from up calling ResetIrs. >2014-04-09 14:30:11,800 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 539a81aa-3a8e-4454-b673-e6092c868b2c, ignoreStopFailed = false), log id: 6e8ede65 >2014-04-09 14:30:11,805 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] START, SpmStopVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 6392ed38 >2014-04-09 14:30:11,808 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Correlation ID: 3c8c2c14, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting Data Center status to Non Responsive (On host 10.66.106.32, Error: Network error during communication with the Host.). >2014-04-09 14:30:11,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] Command HSMGetAllTasksStatusesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-04-09 14:30:11,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] SpmStopVDSCommand::Stopping SPM on vds 10.66.106.32, pool id f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-09 14:30:11,812 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] could not stop spm of pool f721168f-5edd-4f5f-8976-591eb93f960e on vds 539a81aa-3a8e-4454-b673-e6092c868b2c - reason: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-09 14:30:11,812 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] FINISH, SpmStopVDSCommand, log id: 6392ed38 >2014-04-09 14:30:11,812 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] FINISH, ResetIrsVDSCommand, log id: 6e8ede65 >2014-04-09 14:30:11,812 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] FINISH, SetVdsStatusVDSCommand, log id: 71feccc8 >2014-04-09 14:30:11,814 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2014-04-09 14:30:11,816 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] START, ActivateVdsVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 2de87cb9 >2014-04-09 14:30:11,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [199fff46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-04-09 14:30:11,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Command SpmStatusVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-04-09 14:30:11,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Irs placed on server 539a81aa-3a8e-4454-b673-e6092c868b2c failed. Proceed Failover >2014-04-09 14:30:11,853 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-86) [a92573f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 14:30:11,857 WARN [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-86) [127d87cf] CanDoAction of action HandleVdsVersion failed. Reasons:VDS_CANNOT_CHECK_VERSION_HOST_NON_RESPONSIVE >2014-04-09 14:30:11,858 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-86) [127d87cf] Failed to activate VDS = 539a81aa-3a8e-4454-b673-e6092c868b2c with error: java.net.ConnectException: Connection refused. >2014-04-09 14:30:11,858 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-86) [127d87cf] FINISH, ActivateVdsVDSCommand, return: Host[10.66.106.32], log id: 2de87cb9 >2014-04-09 14:30:11,867 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] hostFromVds::selectedVds - 10.66.106.40, spmStatus Free, storage pool NFS_shyu >2014-04-09 14:30:11,876 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] SPM Init: could not find reported vds or not up - pool:NFS_shyu vds_spm_id: 2 >2014-04-09 14:30:11,880 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] SPM selection - vds seems as spm 10.66.106.32 >2014-04-09 14:30:11,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] START, SpmStopVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 1730ec2 >2014-04-09 14:30:11,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] SpmStopVDSCommand:: vds 10.66.106.32 is in Connecting status - not performing spm stop, pool id f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-09 14:30:11,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] FINISH, SpmStopVDSCommand, log id: 1730ec2 >2014-04-09 14:30:11,885 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] spm stop on spm failed, stopping spm selection! >2014-04-09 14:30:11,901 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-34) hostFromVds::selectedVds - 10.66.106.40, spmStatus Free, storage pool NFS_shyu >2014-04-09 14:30:11,910 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-34) SPM Init: could not find reported vds or not up - pool:NFS_shyu vds_spm_id: 2 >2014-04-09 14:30:11,915 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-34) SPM selection - vds seems as spm 10.66.106.32 >2014-04-09 14:30:11,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-34) START, SpmStopVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: a561756 >2014-04-09 14:30:11,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-34) SpmStopVDSCommand:: vds 10.66.106.32 is in Connecting status - not performing spm stop, pool id f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-09 14:30:11,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, SpmStopVDSCommand, log id: a561756 >2014-04-09 14:30:11,919 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-34) spm stop on spm failed, stopping spm selection! >2014-04-09 14:30:11,925 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-86) [127d87cf] Activate finished. Lock released. Monitoring can run now for host 10.66.106.32 from data-center NFS_shyu >2014-04-09 14:30:11,927 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-86) [127d87cf] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-09 14:30:11,932 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-34) SPMAsyncTask::PollTask: Polling task fb2758da-e449-4589-978d-e068edca2971 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:30:11,950 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-34) BaseAsyncTask::OnTaskEndSuccess: Task fb2758da-e449-4589-978d-e068edca2971 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:30:11,950 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-34) CommandAsyncTask::EndActionIfNecessary: All tasks of command 87619e60-dbf4-45f8-baae-160d70658c89 has ended -> executing EndAction >2014-04-09 14:30:11,950 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-34) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 87619e60-dbf4-45f8-baae-160d70658c89): calling EndAction . >2014-04-09 14:30:11,950 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateDisk, executionIndex: 0 >2014-04-09 14:30:11,951 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Setting new tasks map. The map contains now 2 tasks >2014-04-09 14:30:12,061 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-50) [3f3a7f06] Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand >2014-04-09 14:30:12,062 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-50) [3f3a7f06] Running command: LiveMigrateDiskCommand Task handler: VmReplicateDiskStartTaskHandler internal: false. Entities affected : ID: 5d1d405b-6c8d-4973-8e80-c11555885cc5 Type: Disk, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:30:12,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskStartVDSCommand] (pool-4-thread-50) [3f3a7f06] START, VmReplicateDiskStartVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 7725ea92 >2014-04-09 14:30:13,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskStartVDSCommand] (pool-4-thread-50) [3f3a7f06] FINISH, VmReplicateDiskStartVDSCommand, log id: 7725ea92 >2014-04-09 14:30:13,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SyncImageGroupDataVDSCommand] (pool-4-thread-50) [3f3a7f06] START, SyncImageGroupDataVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, dstDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, syncType=INTERNAL), log id: 4a2934b2 >2014-04-09 14:30:13,807 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SyncImageGroupDataVDSCommand] (pool-4-thread-50) [3f3a7f06] FINISH, SyncImageGroupDataVDSCommand, log id: 4a2934b2 >2014-04-09 14:30:13,819 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [3f3a7f06] CommandMultiAsyncTasks::AttachTask: Attaching task db942761-9fec-490a-a0d6-0dcdebb6edb7 to command 87619e60-dbf4-45f8-baae-160d70658c89. >2014-04-09 14:30:13,833 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [3f3a7f06] Adding task db942761-9fec-490a-a0d6-0dcdebb6edb7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:30:13,841 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [3f3a7f06] BaseAsyncTask::StartPollingTask: Starting to poll task db942761-9fec-490a-a0d6-0dcdebb6edb7. >2014-04-09 14:30:13,842 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk completed, handling the result. >2014-04-09 14:30:13,842 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk succeeded, clearing tasks. >2014-04-09 14:30:13,842 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task fb2758da-e449-4589-978d-e068edca2971 >2014-04-09 14:30:13,842 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = fb2758da-e449-4589-978d-e068edca2971), log id: 4ad4eb46 >2014-04-09 14:30:13,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=fb2758da-e449-4589-978d-e068edca2971), log id: 60a2670b >2014-04-09 14:30:13,856 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 60a2670b >2014-04-09 14:30:13,856 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 4ad4eb46 >2014-04-09 14:30:13,866 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task fb2758da-e449-4589-978d-e068edca2971 from DataBase >2014-04-09 14:30:13,866 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [within thread]: Some of the tasks related to command id 87619e60-dbf4-45f8-baae-160d70658c89 were not cleared yet (Task id db942761-9fec-490a-a0d6-0dcdebb6edb7 is in state Polling). >2014-04-09 14:30:14,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@693b319b >2014-04-09 14:30:14,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) HostName = 10.66.106.32 >2014-04-09 14:30:14,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-04-09 14:30:14,899 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:42) > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:16) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >, Custom Event ID: -1, Message: Host 10.66.106.32 is initializing. Message: Recovering from crash or Initializing >2014-04-09 14:30:14,900 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-70) Failed to refresh VDS , vds = 539a81aa-3a8e-4454-b673-e6092c868b2c : 10.66.106.32, error = Recovering from crash or Initializing, continuing. >2014-04-09 14:30:18,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Network virbr0 is not attached to any interface on host 10.66.106.32. >2014-04-09 14:30:18,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32]), log id: 53f0ea2a >2014-04-09 14:30:18,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GetHardwareInfoVDSCommand, log id: 53f0ea2a >2014-04-09 14:30:18,274 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.32. >2014-04-09 14:30:18,283 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) Cancelling the recovery from crash timer for VDS 539a81aa-3a8e-4454-b673-e6092c868b2c because vds started initializing >2014-04-09 14:30:18,284 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-31) [43cbf6d9] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:30:18,290 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-31) [4272264a] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-09 14:30:18,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-31) [4272264a] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 39e82e8e >2014-04-09 14:30:18,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-31) [4272264a] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 39e82e8e >2014-04-09 14:30:18,455 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-31) [4272264a] Host 10.66.106.32 storage connection was succeeded >2014-04-09 14:30:18,462 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-46) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: a014ccd >2014-04-09 14:30:21,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) hostFromVds::selectedVds - 10.66.106.40, spmStatus Free, storage pool NFS_shyu >2014-04-09 14:30:21,917 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) SPM Init: could not find reported vds or not up - pool:NFS_shyu vds_spm_id: 2 >2014-04-09 14:30:21,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) SPM selection - vds seems as spm 10.66.106.32 >2014-04-09 14:30:21,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-20) START, SpmStopVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 37d61740 >2014-04-09 14:30:21,951 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-44) Polling and updating Async Tasks: 3 tasks, 2 tasks to poll now >2014-04-09 14:30:21,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-04-09 14:30:21,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-20) HostName = 10.66.106.32 >2014-04-09 14:30:21,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command HSMGetAllTasksStatusesVDS execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-04-09 14:30:21,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, SpmStopVDSCommand, log id: 37d61740 >2014-04-09 14:30:21,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) spm stop succeeded, continuing with spm selection >2014-04-09 14:30:21,974 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) starting spm on vds 10.66.106.40, storage pool NFS_shyu, prevId 2, LVER 0 >2014-04-09 14:30:21,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-20) START, SpmStartVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, prevId=2, prevLVER=0, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=true), log id: 7cf2940b >2014-04-09 14:30:21,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-20) spmStart polling started: taskId = e53cc008-d273-4dea-ab2e-a793d7667e97 >2014-04-09 14:30:22,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-20) spmStart polling ended: taskId = e53cc008-d273-4dea-ab2e-a793d7667e97 task status = finished >2014-04-09 14:30:23,005 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-20) spmStart polling ended, spm status: SPM >2014-04-09 14:30:23,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-20) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=e53cc008-d273-4dea-ab2e-a793d7667e97), log id: 4ae0b691 >2014-04-09 14:30:23,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, HSMClearTaskVDSCommand, log id: 4ae0b691 >2014-04-09 14:30:23,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@62497b63, log id: 7cf2940b >2014-04-09 14:30:23,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-20) Initialize Irs proxy from vds: 10.66.106.40 >2014-04-09 14:30:23,040 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-20) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.106.40 (Address: 10.66.106.40). >2014-04-09 14:30:23,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-48) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 664f3188 >2014-04-09 14:30:23,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-48) -- executeIrsBrokerCommand: Attempting on storage pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-09 14:30:23,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-48) START, HSMGetAllTasksInfoVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: 74ee8f6d >2014-04-09 14:30:23,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-48) FINISH, HSMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@7003d806], log id: 74ee8f6d >2014-04-09 14:30:23,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-48) FINISH, SPMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@7003d806], log id: 664f3188 >2014-04-09 14:30:23,282 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) SPMAsyncTask::PollTask: Polling task db942761-9fec-490a-a0d6-0dcdebb6edb7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:30:23,282 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) SPMAsyncTask::PollTask: Polling task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:30:23,290 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) BaseAsyncTask::OnTaskEndSuccess: Task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:30:23,290 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-44) CommandAsyncTask::EndActionIfNecessary: All tasks of command c3eb5d70-8501-4d7c-b44d-96af95a15a87 has ended -> executing EndAction >2014-04-09 14:30:23,290 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-44) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: c3eb5d70-8501-4d7c-b44d-96af95a15a87): calling EndAction . >2014-04-09 14:30:23,291 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-44) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:30:23,291 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateDisk, executionIndex: 1 >2014-04-09 14:30:23,294 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) Discovered 1 tasks on Storage Pool NFS_shyu, 0 added to manager. >2014-04-09 14:30:23,418 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [5eea5d24] Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand >2014-04-09 14:30:23,418 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [5eea5d24] Running command: LiveMigrateDiskCommand Task handler: VmReplicateDiskFinishTaskHandler internal: false. Entities affected : ID: d84232e1-e105-4c7e-8657-28d777960e4e Type: Disk, ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-09 14:30:23,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] START, VmReplicateDiskFinishVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 708f3e34 >2014-04-09 14:30:24,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-46) FINISH, ConnectStoragePoolVDSCommand, log id: a014ccd >2014-04-09 14:30:24,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-31) [4272264a] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 5763c854 >2014-04-09 14:30:24,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-31) [4272264a] FINISH, SetMOMPolicyParametersVDSCommand, log id: 5763c854 >2014-04-09 14:30:24,303 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) [4272264a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.32. >2014-04-09 14:30:24,320 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-31) [6012b140] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 14:30:24,326 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-31) [68dc1a40] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-09 14:30:27,347 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Up --> Paused >2014-04-09 14:30:29,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] Command org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=41, mMessage=Failed to change disk image]] >2014-04-09 14:30:29,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] HostName = 10.66.106.32 >2014-04-09 14:30:29,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] Command VmReplicateDiskFinishVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to VmReplicateDiskFinishVDS, error = Failed to change disk image >2014-04-09 14:30:29,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] FINISH, VmReplicateDiskFinishVDSCommand, log id: 708f3e34 >2014-04-09 14:30:29,223 ERROR [org.ovirt.engine.core.bll.lsm.VmReplicateDiskFinishTaskHandler] (pool-4-thread-35) [5eea5d24] Failed VmReplicateDiskFinish (Disk d84232e1-e105-4c7e-8657-28d777960e4e , VM 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f) >2014-04-09 14:30:29,223 ERROR [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [5eea5d24] Command org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to VmReplicateDiskFinishVDS, error = Failed to change disk image (Failed with error FAILED_CHANGE_CD_IS_MOUNTED and code 41) >2014-04-09 14:30:29,227 ERROR [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [5eea5d24] Reverting task unknown, handler: org.ovirt.engine.core.bll.lsm.VmReplicateDiskStartTaskHandler >2014-04-09 14:30:29,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] START, VmReplicateDiskFinishVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 24cb8bae >2014-04-09 14:30:29,243 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] Failed in VmReplicateDiskFinishVDS method >2014-04-09 14:30:29,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] Error code replicaErr and error message VDSGenericException: VDSErrorException: Failed to VmReplicateDiskFinishVDS, error = Drive replication error >2014-04-09 14:30:29,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] Command org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=55, mMessage=Drive replication error]] >2014-04-09 14:30:29,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] HostName = 10.66.106.32 >2014-04-09 14:30:29,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] Command VmReplicateDiskFinishVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to VmReplicateDiskFinishVDS, error = Drive replication error >2014-04-09 14:30:29,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [5eea5d24] FINISH, VmReplicateDiskFinishVDSCommand, log id: 24cb8bae >2014-04-09 14:30:29,258 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk completed, handling the result. >2014-04-09 14:30:29,258 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk hasnt succeeded, not clearing tasks, will attempt again next polling. >2014-04-09 14:30:30,388 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Paused --> Up >2014-04-09 14:30:33,527 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] BaseAsyncTask::OnTaskEndSuccess: Task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:30:33,528 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] CommandAsyncTask::EndActionIfNecessary: All tasks of command c3eb5d70-8501-4d7c-b44d-96af95a15a87 has ended -> executing EndAction >2014-04-09 14:30:33,528 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: c3eb5d70-8501-4d7c-b44d-96af95a15a87): calling EndAction . >2014-04-09 14:30:33,528 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) [1ad889f5] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateDisk, executionIndex: 0 >2014-04-09 14:30:33,565 ERROR [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [5eea5d24] Ending command with failure: org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand >2014-04-09 14:30:33,572 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [5eea5d24] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >] >2014-04-09 14:30:33,597 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [5eea5d24] Correlation ID: 5eea5d24, Job ID: 055e84e2-69d7-4c70-a2d4-b6ae77037586, Call Stack: null, Custom Event ID: -1, Message: User admin@internal have failed to move disk vm1_Disk1 to domain NFS_shyu_domain2. >2014-04-09 14:30:33,597 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk completed, handling the result. >2014-04-09 14:30:33,597 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk succeeded, clearing tasks. >2014-04-09 14:30:33,605 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 >2014-04-09 14:30:33,606 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 23701148-2ea0-4945-9393-0ceb1ddfb8f7), log id: 25408d95 >2014-04-09 14:30:33,607 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=23701148-2ea0-4945-9393-0ceb1ddfb8f7), log id: 310f444e >2014-04-09 14:30:33,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) FINISH, HSMClearTaskVDSCommand, log id: 310f444e >2014-04-09 14:30:33,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) FINISH, SPMClearTaskVDSCommand, log id: 25408d95 >2014-04-09 14:30:33,630 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::RemoveTaskFromDB: Removed task 23701148-2ea0-4945-9393-0ceb1ddfb8f7 from DataBase >2014-04-09 14:30:33,630 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity c3eb5d70-8501-4d7c-b44d-96af95a15a87 >2014-04-09 14:30:36,530 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Warning, Low disk space.dc_ISCSI_1 domain has 4 GB of free space >2014-04-09 14:31:02,548 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (ajp-/127.0.0.1:8702-16) [fc2683e] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:31:02,677 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) [fc2683e] Running command: HibernateVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:31:02,689 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [fc2683e] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@6229441a), log id: 1f982861 >2014-04-09 14:31:02,691 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [fc2683e] FINISH, UpdateVmDynamicDataVDSCommand, log id: 1f982861 >2014-04-09 14:31:02,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 8c27a580-9bf6-451e-8a24-d55e0bc31f88, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = de0d646c-533b-45e7-9ebe-d5dd798b9ce6, newImageDescription = ), log id: 698ae19d >2014-04-09 14:31:02,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:31:02,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] -- createVolume parameters: > sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=8c27a580-9bf6-451e-8a24-d55e0bc31f88 > size=1,350,565,888 bytes > volFormat=RAW > volType=Sparse > volUUID=de0d646c-533b-45e7-9ebe-d5dd798b9ce6 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:31:02,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] FINISH, CreateImageVDSCommand, return: de0d646c-533b-45e7-9ebe-d5dd798b9ce6, log id: 698ae19d >2014-04-09 14:31:02,754 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) [fc2683e] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 4370b223-0c87-4cc1-9f45-1accf61b8f93 >2014-04-09 14:31:02,754 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [fc2683e] CommandMultiAsyncTasks::AttachTask: Attaching task 179430d4-9a71-4622-9645-31a1f77d644c to command 4370b223-0c87-4cc1-9f45-1accf61b8f93. >2014-04-09 14:31:02,758 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [fc2683e] Adding task 179430d4-9a71-4622-9645-31a1f77d644c (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:31:02,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = e77b06fb-6d37-4136-9eaf-75314cfe7027, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 5d9b0626-9dd6-452a-a79c-1616df745aaf, newImageDescription = ), log id: 7c22017c >2014-04-09 14:31:02,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:31:02,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] -- createVolume parameters: > sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=e77b06fb-6d37-4136-9eaf-75314cfe7027 > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=5d9b0626-9dd6-452a-a79c-1616df745aaf > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:31:02,893 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [fc2683e] FINISH, CreateImageVDSCommand, return: 5d9b0626-9dd6-452a-a79c-1616df745aaf, log id: 7c22017c >2014-04-09 14:31:02,928 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [fc2683e] CommandMultiAsyncTasks::AttachTask: Attaching task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7 to command 4370b223-0c87-4cc1-9f45-1accf61b8f93. >2014-04-09 14:31:02,943 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [fc2683e] Adding task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:31:02,955 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [fc2683e] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@7b2305f3), log id: 6c956cec >2014-04-09 14:31:02,962 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [fc2683e] FINISH, UpdateVmDynamicDataVDSCommand, log id: 6c956cec >2014-04-09 14:31:02,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [fc2683e] Correlation ID: fc2683e, Job ID: ddc45261-99f9-426f-b6b4-b6f6da69e5f6, Call Stack: null, Custom Event ID: -1, Message: Suspending VM vm1 was initiated by User admin@internal (Host: 10.66.106.32). >2014-04-09 14:31:02,979 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [fc2683e] BaseAsyncTask::StartPollingTask: Starting to poll task 179430d4-9a71-4622-9645-31a1f77d644c. >2014-04-09 14:31:02,979 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [fc2683e] BaseAsyncTask::StartPollingTask: Starting to poll task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7. >2014-04-09 14:31:02,979 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) [fc2683e] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:31:03,555 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) Polling and updating Async Tasks: 5 tasks, 3 tasks to poll now >2014-04-09 14:31:03,581 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:31:03,603 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::OnTaskEndSuccess: Task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:31:03,603 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-22) Task with DB Task ID fe06b11c-7ecb-4bc0-85e0-753ca856d6f3 and VDSM Task ID 179430d4-9a71-4622-9645-31a1f77d644c is in state Polling. End action for command 4370b223-0c87-4cc1-9f45-1accf61b8f93 will proceed when all the entitys tasks are completed. >2014-04-09 14:31:03,604 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task 179430d4-9a71-4622-9645-31a1f77d644c (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:31:03,620 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::OnTaskEndSuccess: Task 179430d4-9a71-4622-9645-31a1f77d644c (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:31:03,620 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::EndActionIfNecessary: All tasks of command 4370b223-0c87-4cc1-9f45-1accf61b8f93 has ended -> executing EndAction >2014-04-09 14:31:03,620 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: 4370b223-0c87-4cc1-9f45-1accf61b8f93): calling EndAction . >2014-04-09 14:31:03,621 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:31:03,621 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction Unknown, executionIndex: 0 >2014-04-09 14:31:03,654 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.HibernateVmCommand >2014-04-09 14:31:03,657 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-48) START, HibernateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, hibernationVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,8c27a580-9bf6-451e-8a24-d55e0bc31f88,de0d646c-533b-45e7-9ebe-d5dd798b9ce6,e77b06fb-6d37-4136-9eaf-75314cfe7027,5d9b0626-9dd6-452a-a79c-1616df745aaf), log id: 995425f >2014-04-09 14:31:03,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-48) START, HibernateBrokerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, hibernationVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,8c27a580-9bf6-451e-8a24-d55e0bc31f88,de0d646c-533b-45e7-9ebe-d5dd798b9ce6,e77b06fb-6d37-4136-9eaf-75314cfe7027,5d9b0626-9dd6-452a-a79c-1616df745aaf), log id: 92987a2 >2014-04-09 14:31:03,670 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-48) FINISH, HibernateBrokerVDSCommand, log id: 92987a2 >2014-04-09 14:31:03,687 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-48) FINISH, HibernateVDSCommand, log id: 995425f >2014-04-09 14:31:03,688 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm completed, handling the result. >2014-04-09 14:31:03,688 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm succeeded, clearing tasks. >2014-04-09 14:31:03,703 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7 >2014-04-09 14:31:03,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 3e1c45fb-46b5-49b8-b5eb-b63060835ff7), log id: 7038a15c >2014-04-09 14:31:03,724 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=3e1c45fb-46b5-49b8-b5eb-b63060835ff7), log id: 46c1e2b8 >2014-04-09 14:31:03,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 46c1e2b8 >2014-04-09 14:31:03,737 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 7038a15c >2014-04-09 14:31:03,745 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 3e1c45fb-46b5-49b8-b5eb-b63060835ff7 from DataBase >2014-04-09 14:31:03,745 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 179430d4-9a71-4622-9645-31a1f77d644c >2014-04-09 14:31:03,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 179430d4-9a71-4622-9645-31a1f77d644c), log id: 45846a >2014-04-09 14:31:03,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=179430d4-9a71-4622-9645-31a1f77d644c), log id: 53f84b49 >2014-04-09 14:31:03,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 53f84b49 >2014-04-09 14:31:03,760 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 45846a >2014-04-09 14:31:03,770 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 179430d4-9a71-4622-9645-31a1f77d644c from DataBase >2014-04-09 14:31:03,770 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 4370b223-0c87-4cc1-9f45-1accf61b8f93 >2014-04-09 14:31:11,952 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) Setting new tasks map. The map contains now 4 tasks >2014-04-09 14:31:13,622 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-76) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-04-09 14:31:13,635 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-76) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:31:25,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=0, gracefully=false), log id: 30fc5d5d >2014-04-09 14:31:25,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] FINISH, DestroyVDSCommand, log id: 30fc5d5d >2014-04-09 14:31:25,675 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 on Host 10.66.106.32 is suspended. >2014-04-09 14:31:25,677 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.106.32 >2014-04-09 14:31:34,897 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-13) [564dbbbd] Lock Acquired to object EngineLock [exclusiveLocks= key: dc-vm-2 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:31:34,965 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-13) [564dbbbd] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 14:31:35,074 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [564dbbbd] Correlation ID: 564dbbbd, Job ID: 83926059-2e5a-46fc-a29f-538e53e03dda, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 was created by admin@internal. >2014-04-09 14:31:35,082 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-13) [564dbbbd] Lock freed to object EngineLock [exclusiveLocks= key: dc-vm-2 value: VM_NAME >, sharedLocks= ] >2014-04-09 14:31:35,140 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-48) [7e60d34d] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM, ID: 06b6a7c0-599a-4f36-8c3f-d66c7e741d47 Type: VnicProfile >2014-04-09 14:31:35,149 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-15) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 14:31:35,157 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-10) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 14:31:35,206 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-48) [2261467b] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:31:35,249 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [2261467b] Correlation ID: 2261467b, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM dc-vm-2. (User: admin@internal) >2014-04-09 14:31:35,274 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [2261467b] Correlation ID: 7e60d34d, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM dc-vm-2. (User: admin@internal) >2014-04-09 14:31:41,953 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Setting new tasks map. The map contains now 3 tasks >2014-04-09 14:31:43,671 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-04-09 14:31:43,683 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:31:53,372 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-9) [cc655db] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM_DISK_BOOT >, sharedLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >] >2014-04-09 14:31:53,402 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-7) [35e34315] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:31:53,417 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-9) [cc655db] Running command: AddDiskCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:31:53,424 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [35e34315] START, IsVmDuringInitiatingVDSCommand( vmId = 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 49944695 >2014-04-09 14:31:53,424 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [35e34315] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 49944695 >2014-04-09 14:31:53,532 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [35e34315] Running command: RunVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:31:53,574 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-9) [3d912bb9] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:31:53,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [35e34315] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: e31a332 >2014-04-09 14:31:53,607 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-9) [3d912bb9] Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM_DISK_BOOT >, sharedLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >] >2014-04-09 14:31:53,607 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [3d912bb9] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 89cb56a4-f024-444a-a531-9039cae8528a, imageSizeInBytes = 8589934592, volumeFormat = RAW, newImageId = 7442c985-2d87-41ac-a668-b09a8a297ff7, newImageDescription = ), log id: 25596d2b >2014-04-09 14:31:53,607 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [3d912bb9] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:31:53,607 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [3d912bb9] -- createVolume parameters: > sdUUID=7cee4e2f-9997-4578-8396-c3aabb03d4c6 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=89cb56a4-f024-444a-a531-9039cae8528a > size=8,589,934,592 bytes > volFormat=RAW > volType=Preallocated > volUUID=7442c985-2d87-41ac-a668-b09a8a297ff7 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:31:53,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [35e34315] FINISH, IsoPrefixVDSCommand, return: , log id: e31a332 >2014-04-09 14:31:53,625 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [35e34315] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 310f8142 >2014-04-09 14:31:53,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [35e34315] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 29d23089 >2014-04-09 14:31:53,726 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-9) [3d912bb9] FINISH, CreateImageVDSCommand, return: 7442c985-2d87-41ac-a668-b09a8a297ff7, log id: 25596d2b >2014-04-09 14:31:53,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [35e34315] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,hiberVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,8c27a580-9bf6-451e-8a24-d55e0bc31f88,de0d646c-533b-45e7-9ebe-d5dd798b9ce6,e77b06fb-6d37-4136-9eaf-75314cfe7027,5d9b0626-9dd6-452a-a79c-1616df745aaf,transparentHugePages=true,vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f,devices=[Ljava.util.HashMap;@b3e9e1d,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_39467e9e-cfa0-45d3-9296-d1cba061f2e8=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=39467e9e-cfa0-45d3-9296-d1cba061f2e8, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_39467e9e-cfa0-45d3-9296-d1cba061f2e8device_b05ede3a-ca1f-4106-9626-71f8c74c844fdevice_451c6208-f193-4b69-a136-263901266496device_b8c912be-691e-42b2-8972-4f7cdc517d54=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=b8c912be-691e-42b2-8972-4f7cdc517d54, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_39467e9e-cfa0-45d3-9296-d1cba061f2e8device_b05ede3a-ca1f-4106-9626-71f8c74c844f=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=b05ede3a-ca1f-4106-9626-71f8c74c844f, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_39467e9e-cfa0-45d3-9296-d1cba061f2e8device_b05ede3a-ca1f-4106-9626-71f8c74c844fdevice_451c6208-f193-4b69-a136-263901266496device_b8c912be-691e-42b2-8972-4f7cdc517d54device_85ea05bf-7c76-4e5a-8c6d-2db142231387=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=85ea05bf-7c76-4e5a-8c6d-2db142231387, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_39467e9e-cfa0-45d3-9296-d1cba061f2e8device_b05ede3a-ca1f-4106-9626-71f8c74c844fdevice_451c6208-f193-4b69-a136-263901266496=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=451c6208-f193-4b69-a136-263901266496, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_39467e9e-cfa0-45d3-9296-d1cba061f2e8device_b05ede3a-ca1f-4106-9626-71f8c74c844fdevice_451c6208-f193-4b69-a136-263901266496device_b8c912be-691e-42b2-8972-4f7cdc517d54device_85ea05bf-7c76-4e5a-8c6d-2db142231387device_63e37e45-187c-462a-a13f-b8abd42323ab=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=63e37e45-187c-462a-a13f-b8abd42323ab, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-04-09 14:31:53,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [35e34315] FINISH, CreateVDSCommand, log id: 29d23089 >2014-04-09 14:31:53,746 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-9) [3d912bb9] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command dbba51fb-94be-4134-b5bf-720c6175b041 >2014-04-09 14:31:53,746 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-9) [3d912bb9] CommandMultiAsyncTasks::AttachTask: Attaching task c800275d-cf57-4484-990c-3a514bc7c121 to command dbba51fb-94be-4134-b5bf-720c6175b041. >2014-04-09 14:31:53,757 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [35e34315] FINISH, CreateVmVDSCommand, return: RestoringState, log id: 310f8142 >2014-04-09 14:31:53,758 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [35e34315] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:31:53,766 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-9) [3d912bb9] Adding task c800275d-cf57-4484-990c-3a514bc7c121 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:31:53,775 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [35e34315] Correlation ID: 35e34315, Job ID: ebd9b781-96a8-40ad-8bc5-a77c1db3d897, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:31:53,816 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [3d912bb9] Correlation ID: cc655db, Job ID: 8aaaed1e-7bd7-47f7-bd57-d080edccd6b4, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of dc-vm-2_Disk1 was initiated on VM dc-vm-2 by admin@internal. >2014-04-09 14:31:53,817 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-9) [3d912bb9] BaseAsyncTask::StartPollingTask: Starting to poll task c800275d-cf57-4484-990c-3a514bc7c121. >2014-04-09 14:31:59,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-37) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 7381e327 >2014-04-09 14:31:59,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-37) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@546850af, log id: 7381e327 >2014-04-09 14:32:03,742 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-04-09 14:32:03,756 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] SPMAsyncTask::PollTask: Polling task c800275d-cf57-4484-990c-3a514bc7c121 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:32:03,774 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] BaseAsyncTask::OnTaskEndSuccess: Task c800275d-cf57-4484-990c-3a514bc7c121 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:32:03,774 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] CommandAsyncTask::EndActionIfNecessary: All tasks of command dbba51fb-94be-4134-b5bf-720c6175b041 has ended -> executing EndAction >2014-04-09 14:32:03,774 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) [1ad889f5] CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: dbba51fb-94be-4134-b5bf-720c6175b041): calling EndAction . >2014-04-09 14:32:03,774 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:32:03,775 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [1ad889f5] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-09 14:32:03,799 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-50) [cc655db] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-09 14:32:03,806 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-50) [3d912bb9] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-09 14:32:03,820 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [3d912bb9] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 89cb56a4-f024-444a-a531-9039cae8528a, imageId = 7442c985-2d87-41ac-a668-b09a8a297ff7), log id: 5d57ec4f >2014-04-09 14:32:04,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [3d912bb9] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@60b0ec1, log id: 5d57ec4f >2014-04-09 14:32:04,224 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: cc655db, Job ID: 8aaaed1e-7bd7-47f7-bd57-d080edccd6b4, Call Stack: null, Custom Event ID: -1, Message: The disk dc-vm-2_Disk1 was successfully added to VM dc-vm-2. >2014-04-09 14:32:04,224 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-09 14:32:04,224 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-09 14:32:04,240 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c800275d-cf57-4484-990c-3a514bc7c121 >2014-04-09 14:32:04,241 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = c800275d-cf57-4484-990c-3a514bc7c121), log id: 7abdf4e4 >2014-04-09 14:32:04,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=c800275d-cf57-4484-990c-3a514bc7c121), log id: 4d18e3b0 >2014-04-09 14:32:04,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 4d18e3b0 >2014-04-09 14:32:04,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 7abdf4e4 >2014-04-09 14:32:04,265 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task c800275d-cf57-4484-990c-3a514bc7c121 from DataBase >2014-04-09 14:32:04,265 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity dbba51fb-94be-4134-b5bf-720c6175b041 >2014-04-09 14:32:05,285 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from RestoringState --> Up >2014-04-09 14:32:05,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: e157a05 >2014-04-09 14:32:05,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@23fde57c, log id: e157a05 >2014-04-09 14:32:05,351 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) Correlation ID: 35e34315, Job ID: ebd9b781-96a8-40ad-8bc5-a77c1db3d897, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host 10.66.106.32 >2014-04-09 14:32:05,366 INFO [org.ovirt.engine.core.bll.RemoveVmHibernationVolumesCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] Running command: RemoveVmHibernationVolumesCommand internal: true. >2014-04-09 14:32:05,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 8c27a580-9bf6-451e-8a24-d55e0bc31f88, postZeros = false, forceDelete = false), log id: 41031c49 >2014-04-09 14:32:05,536 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] FINISH, DeleteImageGroupVDSCommand, log id: 41031c49 >2014-04-09 14:32:05,570 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) [29d39d31] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 7ac024cf-2971-459a-b418-0a9647978e66 >2014-04-09 14:32:05,570 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-5) [29d39d31] CommandMultiAsyncTasks::AttachTask: Attaching task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e to command 7ac024cf-2971-459a-b418-0a9647978e66. >2014-04-09 14:32:05,582 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) [29d39d31] Adding task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:32:05,599 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = e77b06fb-6d37-4136-9eaf-75314cfe7027, postZeros = false, forceDelete = false), log id: 47c08bea >2014-04-09 14:32:05,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] FINISH, DeleteImageGroupVDSCommand, log id: 47c08bea >2014-04-09 14:32:05,676 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-5) [29d39d31] CommandMultiAsyncTasks::AttachTask: Attaching task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe to command 7ac024cf-2971-459a-b418-0a9647978e66. >2014-04-09 14:32:05,682 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) [29d39d31] Adding task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:32:05,691 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [29d39d31] BaseAsyncTask::StartPollingTask: Starting to poll task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e. >2014-04-09 14:32:05,691 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [29d39d31] BaseAsyncTask::StartPollingTask: Starting to poll task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe. >2014-04-09 14:32:05,695 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@c68e8be1), log id: 196d8dae >2014-04-09 14:32:05,707 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-5) [29d39d31] FINISH, UpdateVmDynamicDataVDSCommand, log id: 196d8dae >2014-04-09 14:32:11,953 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-27) Setting new tasks map. The map contains now 4 tasks >2014-04-09 14:32:12,684 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-6) [6cbb67ae] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 14:32:12,699 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [6cbb67ae] START, IsVmDuringInitiatingVDSCommand( vmId = 70cb0dc5-8f43-499d-957d-124aebd3fd35), log id: 17ce7925 >2014-04-09 14:32:12,700 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [6cbb67ae] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 17ce7925 >2014-04-09 14:32:12,823 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [6cbb67ae] Running command: RunVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:32:12,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [6cbb67ae] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 5e0f6231 >2014-04-09 14:32:12,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [6cbb67ae] FINISH, IsoPrefixVDSCommand, return: , log id: 5e0f6231 >2014-04-09 14:32:12,905 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [6cbb67ae] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, vm=VM [dc-vm-2]), log id: 494746eb >2014-04-09 14:32:12,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [6cbb67ae] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, vm=VM [dc-vm-2]), log id: 17962a67 >2014-04-09 14:32:12,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [6cbb67ae] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35,devices=[Ljava.util.HashMap;@e489d2f,acpiEnable=true,vmName=dc-vm-2,cpuType=Conroe,custom={} >2014-04-09 14:32:12,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [6cbb67ae] FINISH, CreateVDSCommand, log id: 17962a67 >2014-04-09 14:32:12,989 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [6cbb67ae] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 494746eb >2014-04-09 14:32:12,990 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [6cbb67ae] Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 14:32:12,998 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [6cbb67ae] Correlation ID: 6cbb67ae, Job ID: 99b96811-023a-4e56-a6ec-1420198f6681, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 was started by admin@internal (Host: DC-85.218). >2014-04-09 14:32:13,775 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) Polling and updating Async Tasks: 4 tasks, 3 tasks to poll now >2014-04-09 14:32:13,799 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:32:13,823 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:32:13,823 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) Task with DB Task ID bfb14002-0696-4f6e-9716-dba6bfe41f92 and VDSM Task ID 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e is in state Polling. End action for command 7ac024cf-2971-459a-b418-0a9647978e66 will proceed when all the entitys tasks are completed. >2014-04-09 14:32:13,823 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:32:13,831 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:32:13,831 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-62) CommandAsyncTask::EndActionIfNecessary: All tasks of command 7ac024cf-2971-459a-b418-0a9647978e66 has ended -> executing EndAction >2014-04-09 14:32:13,831 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-62) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: 7ac024cf-2971-459a-b418-0a9647978e66): calling EndAction . >2014-04-09 14:32:13,832 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:32:13,832 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RunVm, executionIndex: 0 >2014-04-09 14:32:13,873 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.RunVmCommand >2014-04-09 14:32:13,874 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RunVm completed, handling the result. >2014-04-09 14:32:13,875 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RunVm succeeded, clearing tasks. >2014-04-09 14:32:13,881 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe >2014-04-09 14:32:13,881 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe), log id: 354e7de0 >2014-04-09 14:32:13,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=1d49845f-3fd5-48d9-bae0-c6f932f8a0fe), log id: 342a1877 >2014-04-09 14:32:13,895 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 342a1877 >2014-04-09 14:32:13,895 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 354e7de0 >2014-04-09 14:32:13,906 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 1d49845f-3fd5-48d9-bae0-c6f932f8a0fe from DataBase >2014-04-09 14:32:13,906 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e >2014-04-09 14:32:13,907 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e), log id: 23dde369 >2014-04-09 14:32:13,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=7809b18e-527d-4f1c-bea1-ebac9e1c1b6e), log id: 3c7d14e4 >2014-04-09 14:32:13,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 3c7d14e4 >2014-04-09 14:32:13,919 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 23dde369 >2014-04-09 14:32:13,923 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 7809b18e-527d-4f1c-bea1-ebac9e1c1b6e from DataBase >2014-04-09 14:32:13,923 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 7ac024cf-2971-459a-b418-0a9647978e66 >2014-04-09 14:32:14,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-58) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 21e97e78 >2014-04-09 14:32:14,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-58) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@686e09ac, log id: 21e97e78 >2014-04-09 14:32:18,530 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from WaitForLaunch --> PoweringUp >2014-04-09 14:32:18,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-43) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 6c758067 >2014-04-09 14:32:18,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-43) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@164121d2, log id: 6c758067 >2014-04-09 14:32:19,203 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [454388b1] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:32:19,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [454388b1] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, ticket=C+TUMNwKvuO3, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 31e98849 >2014-04-09 14:32:19,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [454388b1] FINISH, SetVmTicketVDSCommand, log id: 31e98849 >2014-04-09 14:32:19,314 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [454388b1] Correlation ID: 454388b1, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-2 >2014-04-09 14:32:31,443 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-12) [6993ba3f] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:32:31,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-12) [6993ba3f] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, ticket=MR3oieyHLaZ+, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 40bc6cf6 >2014-04-09 14:32:31,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-12) [6993ba3f] FINISH, SetVmTicketVDSCommand, log id: 40bc6cf6 >2014-04-09 14:32:31,537 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [6993ba3f] Correlation ID: 6993ba3f, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-2 >2014-04-09 14:32:34,414 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (ajp-/127.0.0.1:8702-17) [4c316f92] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:32:34,504 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) [4c316f92] Running command: HibernateVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:32:34,516 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [4c316f92] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@4816dcc1), log id: 452eea3f >2014-04-09 14:32:34,518 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [4c316f92] FINISH, UpdateVmDynamicDataVDSCommand, log id: 452eea3f >2014-04-09 14:32:34,532 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 31301729-ce2f-4dd4-962d-e95216250cfb, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = a7bf21ec-d1a5-4bf7-b54f-a818289c3126, newImageDescription = ), log id: 45266292 >2014-04-09 14:32:34,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:32:34,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] -- createVolume parameters: > sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=31301729-ce2f-4dd4-962d-e95216250cfb > size=1,350,565,888 bytes > volFormat=RAW > volType=Sparse > volUUID=a7bf21ec-d1a5-4bf7-b54f-a818289c3126 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:32:34,582 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] FINISH, CreateImageVDSCommand, return: a7bf21ec-d1a5-4bf7-b54f-a818289c3126, log id: 45266292 >2014-04-09 14:32:34,598 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) [4c316f92] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842 >2014-04-09 14:32:34,598 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [4c316f92] CommandMultiAsyncTasks::AttachTask: Attaching task 061af95c-c66f-4dd9-b12c-01fa825a0637 to command 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842. >2014-04-09 14:32:34,602 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [4c316f92] Adding task 061af95c-c66f-4dd9-b12c-01fa825a0637 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:32:34,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 7f5f7939-3d04-4789-b912-b7c2dc24f5c5, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 9b826232-a752-4905-9123-ec102f4ef7e9, newImageDescription = ), log id: 203923f >2014-04-09 14:32:34,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:32:34,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] -- createVolume parameters: > sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=7f5f7939-3d04-4789-b912-b7c2dc24f5c5 > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=9b826232-a752-4905-9123-ec102f4ef7e9 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:32:34,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-48) [4c316f92] FINISH, CreateImageVDSCommand, return: 9b826232-a752-4905-9123-ec102f4ef7e9, log id: 203923f >2014-04-09 14:32:34,698 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [4c316f92] CommandMultiAsyncTasks::AttachTask: Attaching task bb87bbeb-9ba9-4b54-a625-f55d44f45391 to command 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842. >2014-04-09 14:32:34,712 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [4c316f92] Adding task bb87bbeb-9ba9-4b54-a625-f55d44f45391 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:32:34,724 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [4c316f92] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@f16bcc9c), log id: a5669f9 >2014-04-09 14:32:34,729 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-48) [4c316f92] FINISH, UpdateVmDynamicDataVDSCommand, log id: a5669f9 >2014-04-09 14:32:34,746 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [4c316f92] Correlation ID: 4c316f92, Job ID: 07338eb8-7f2b-4fdf-8433-d595c85bb24b, Call Stack: null, Custom Event ID: -1, Message: Suspending VM vm1 was initiated by User admin@internal (Host: 10.66.106.32). >2014-04-09 14:32:34,746 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [4c316f92] BaseAsyncTask::StartPollingTask: Starting to poll task 061af95c-c66f-4dd9-b12c-01fa825a0637. >2014-04-09 14:32:34,746 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [4c316f92] BaseAsyncTask::StartPollingTask: Starting to poll task bb87bbeb-9ba9-4b54-a625-f55d44f45391. >2014-04-09 14:32:34,746 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) [4c316f92] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:32:43,857 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-76) Polling and updating Async Tasks: 6 tasks, 3 tasks to poll now >2014-04-09 14:32:43,879 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task bb87bbeb-9ba9-4b54-a625-f55d44f45391 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:32:43,911 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task bb87bbeb-9ba9-4b54-a625-f55d44f45391 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:32:43,911 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-76) Task with DB Task ID 7c5a4a17-a4cb-4b19-bbda-bcb4d54b8526 and VDSM Task ID 061af95c-c66f-4dd9-b12c-01fa825a0637 is in state Polling. End action for command 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842 will proceed when all the entitys tasks are completed. >2014-04-09 14:32:43,911 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task 061af95c-c66f-4dd9-b12c-01fa825a0637 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:32:43,919 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task 061af95c-c66f-4dd9-b12c-01fa825a0637 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:32:43,919 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::EndActionIfNecessary: All tasks of command 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842 has ended -> executing EndAction >2014-04-09 14:32:43,920 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842): calling EndAction . >2014-04-09 14:32:43,920 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-76) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:32:43,920 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction Unknown, executionIndex: 0 >2014-04-09 14:32:43,952 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.HibernateVmCommand >2014-04-09 14:32:43,956 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-48) START, HibernateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, hibernationVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,31301729-ce2f-4dd4-962d-e95216250cfb,a7bf21ec-d1a5-4bf7-b54f-a818289c3126,7f5f7939-3d04-4789-b912-b7c2dc24f5c5,9b826232-a752-4905-9123-ec102f4ef7e9), log id: 318b75a0 >2014-04-09 14:32:43,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-48) START, HibernateBrokerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, hibernationVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,31301729-ce2f-4dd4-962d-e95216250cfb,a7bf21ec-d1a5-4bf7-b54f-a818289c3126,7f5f7939-3d04-4789-b912-b7c2dc24f5c5,9b826232-a752-4905-9123-ec102f4ef7e9), log id: 2b3e1176 >2014-04-09 14:32:43,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-48) FINISH, HibernateBrokerVDSCommand, log id: 2b3e1176 >2014-04-09 14:32:43,977 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-48) FINISH, HibernateVDSCommand, log id: 318b75a0 >2014-04-09 14:32:43,979 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm completed, handling the result. >2014-04-09 14:32:43,979 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm succeeded, clearing tasks. >2014-04-09 14:32:43,986 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bb87bbeb-9ba9-4b54-a625-f55d44f45391 >2014-04-09 14:32:43,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = bb87bbeb-9ba9-4b54-a625-f55d44f45391), log id: 667db009 >2014-04-09 14:32:43,988 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=bb87bbeb-9ba9-4b54-a625-f55d44f45391), log id: 45b05370 >2014-04-09 14:32:44,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 45b05370 >2014-04-09 14:32:44,001 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 667db009 >2014-04-09 14:32:44,011 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task bb87bbeb-9ba9-4b54-a625-f55d44f45391 from DataBase >2014-04-09 14:32:44,011 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 061af95c-c66f-4dd9-b12c-01fa825a0637 >2014-04-09 14:32:44,011 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 061af95c-c66f-4dd9-b12c-01fa825a0637), log id: 5f85d111 >2014-04-09 14:32:44,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=061af95c-c66f-4dd9-b12c-01fa825a0637), log id: 4a60e415 >2014-04-09 14:32:44,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 4a60e415 >2014-04-09 14:32:44,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 5f85d111 >2014-04-09 14:32:44,036 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 061af95c-c66f-4dd9-b12c-01fa825a0637 from DataBase >2014-04-09 14:32:44,036 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 79f2d4cc-5edd-4477-8ef7-c4f0aef5a842 >2014-04-09 14:33:00,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-97) START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=0, gracefully=false), log id: 586a58d7 >2014-04-09 14:33:01,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, DestroyVDSCommand, log id: 586a58d7 >2014-04-09 14:33:01,335 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 on Host 10.66.106.32 is suspended. >2014-04-09 14:33:01,336 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.106.32 >2014-04-09 14:33:11,955 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Setting new tasks map. The map contains now 5 tasks >2014-04-09 14:33:13,964 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-77) Polling and updating Async Tasks: 5 tasks, 1 tasks to poll now >2014-04-09 14:33:13,977 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-77) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:33:14,156 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-71) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from PoweringUp --> Up >2014-04-09 14:33:14,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) Correlation ID: 6cbb67ae, Job ID: 99b96811-023a-4e56-a6ec-1420198f6681, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 started on Host DC-85.218 >2014-04-09 14:33:41,956 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-27) Setting new tasks map. The map contains now 3 tasks >2014-04-09 14:33:44,400 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-50) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-04-09 14:33:44,412 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-50) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:34:11,957 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-29) Setting new tasks map. The map contains now 1 tasks >2014-04-09 14:34:11,957 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-29) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-09 14:34:14,441 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 14:34:14,453 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:35:25,755 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-7) [5b834c1c] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:35:25,766 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [5b834c1c] START, IsVmDuringInitiatingVDSCommand( vmId = 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 4dab832e >2014-04-09 14:35:25,766 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [5b834c1c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4dab832e >2014-04-09 14:35:25,842 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-35) [5b834c1c] Running command: RunVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:35:25,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-35) [5b834c1c] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 7077b7bf >2014-04-09 14:35:25,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-35) [5b834c1c] FINISH, IsoPrefixVDSCommand, return: , log id: 7077b7bf >2014-04-09 14:35:25,943 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-35) [5b834c1c] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 3857ff92 >2014-04-09 14:35:25,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [5b834c1c] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 1ea82928 >2014-04-09 14:35:26,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [5b834c1c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,hiberVolHandle=55cb7668-7c5e-4553-b263-c6f3f86b358f,f721168f-5edd-4f5f-8976-591eb93f960e,31301729-ce2f-4dd4-962d-e95216250cfb,a7bf21ec-d1a5-4bf7-b54f-a818289c3126,7f5f7939-3d04-4789-b912-b7c2dc24f5c5,9b826232-a752-4905-9123-ec102f4ef7e9,transparentHugePages=true,vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f,devices=[Ljava.util.HashMap;@7417d38a,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_6390c96d-636e-4dbe-981a-6048f3ac8427device_90269031-84c1-47e5-a50f-fe00d10384a4device_edd3a33d-f7bf-41ff-9619-d9b6f682a0dddevice_30b6dc87-c6bd-43e7-97c4-9ecede1e4db0device_cb6d5afa-6938-4bf9-9a03-1a909a6ca034=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=cb6d5afa-6938-4bf9-9a03-1a909a6ca034, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_6390c96d-636e-4dbe-981a-6048f3ac8427device_90269031-84c1-47e5-a50f-fe00d10384a4device_edd3a33d-f7bf-41ff-9619-d9b6f682a0dddevice_30b6dc87-c6bd-43e7-97c4-9ecede1e4db0=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=30b6dc87-c6bd-43e7-97c4-9ecede1e4db0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_6390c96d-636e-4dbe-981a-6048f3ac8427=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=6390c96d-636e-4dbe-981a-6048f3ac8427, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_6390c96d-636e-4dbe-981a-6048f3ac8427device_90269031-84c1-47e5-a50f-fe00d10384a4device_edd3a33d-f7bf-41ff-9619-d9b6f682a0dddevice_30b6dc87-c6bd-43e7-97c4-9ecede1e4db0device_cb6d5afa-6938-4bf9-9a03-1a909a6ca034device_e252b477-5854-4169-a6f7-d30a5d7ae4aa=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=e252b477-5854-4169-a6f7-d30a5d7ae4aa, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_6390c96d-636e-4dbe-981a-6048f3ac8427device_90269031-84c1-47e5-a50f-fe00d10384a4device_edd3a33d-f7bf-41ff-9619-d9b6f682a0dd=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=edd3a33d-f7bf-41ff-9619-d9b6f682a0dd, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_6390c96d-636e-4dbe-981a-6048f3ac8427device_90269031-84c1-47e5-a50f-fe00d10384a4=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=90269031-84c1-47e5-a50f-fe00d10384a4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-04-09 14:35:26,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-35) [5b834c1c] FINISH, CreateVDSCommand, log id: 1ea82928 >2014-04-09 14:35:26,118 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-35) [5b834c1c] FINISH, CreateVmVDSCommand, return: RestoringState, log id: 3857ff92 >2014-04-09 14:35:26,118 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-35) [5b834c1c] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:35:26,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [5b834c1c] Correlation ID: 5b834c1c, Job ID: a8d9dd7f-a41d-46e6-aeae-2ec10c49f0cd, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:35:33,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-2) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 7776839e >2014-04-09 14:35:33,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-2) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@5bb3758, log id: 7776839e >2014-04-09 14:35:36,348 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from RestoringState --> Up >2014-04-09 14:35:36,348 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 48e74c18 >2014-04-09 14:35:36,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4934e10c, log id: 48e74c18 >2014-04-09 14:35:36,408 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-20) Correlation ID: 5b834c1c, Job ID: a8d9dd7f-a41d-46e6-aeae-2ec10c49f0cd, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host 10.66.106.32 >2014-04-09 14:35:36,418 INFO [org.ovirt.engine.core.bll.RemoveVmHibernationVolumesCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] Running command: RemoveVmHibernationVolumesCommand internal: true. >2014-04-09 14:35:36,458 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 31301729-ce2f-4dd4-962d-e95216250cfb, postZeros = false, forceDelete = false), log id: 7668c61c >2014-04-09 14:35:36,596 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] FINISH, DeleteImageGroupVDSCommand, log id: 7668c61c >2014-04-09 14:35:36,611 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command d2a2e279-8ebd-4257-927f-351a5a72682f >2014-04-09 14:35:36,611 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-20) [211fe558] CommandMultiAsyncTasks::AttachTask: Attaching task 197538eb-a2e0-4250-9778-ec3e7766fdb8 to command d2a2e279-8ebd-4257-927f-351a5a72682f. >2014-04-09 14:35:36,625 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) [211fe558] Adding task 197538eb-a2e0-4250-9778-ec3e7766fdb8 (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:35:36,642 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, imageGroupId = 7f5f7939-3d04-4789-b912-b7c2dc24f5c5, postZeros = false, forceDelete = false), log id: 5c116d0d >2014-04-09 14:35:36,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] FINISH, DeleteImageGroupVDSCommand, log id: 5c116d0d >2014-04-09 14:35:36,711 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-20) [211fe558] CommandMultiAsyncTasks::AttachTask: Attaching task 2995aa0e-64bd-4dd3-95e6-68b266218ffc to command d2a2e279-8ebd-4257-927f-351a5a72682f. >2014-04-09 14:35:36,725 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) [211fe558] Adding task 2995aa0e-64bd-4dd3-95e6-68b266218ffc (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:35:36,733 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] BaseAsyncTask::StartPollingTask: Starting to poll task 197538eb-a2e0-4250-9778-ec3e7766fdb8. >2014-04-09 14:35:36,734 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] BaseAsyncTask::StartPollingTask: Starting to poll task 2995aa0e-64bd-4dd3-95e6-68b266218ffc. >2014-04-09 14:35:36,737 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] START, UpdateVmDynamicDataVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@fb96da0e), log id: 15eb4302 >2014-04-09 14:35:36,741 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-20) [211fe558] FINISH, UpdateVmDynamicDataVDSCommand, log id: 15eb4302 >2014-04-09 14:35:42,562 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [5892ddc0] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:35:42,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [5892ddc0] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=cSJDIOGISAP2, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 77d82687 >2014-04-09 14:35:42,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [5892ddc0] FINISH, SetVmTicketVDSCommand, log id: 77d82687 >2014-04-09 14:35:42,682 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [5892ddc0] Correlation ID: 5892ddc0, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 14:35:44,569 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-04-09 14:35:44,590 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) SPMAsyncTask::PollTask: Polling task 2995aa0e-64bd-4dd3-95e6-68b266218ffc (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:35:44,615 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) BaseAsyncTask::OnTaskEndSuccess: Task 2995aa0e-64bd-4dd3-95e6-68b266218ffc (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:35:44,616 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) Task with DB Task ID 6fdcbcd8-f6e1-4e0a-8091-748b8f34b461 and VDSM Task ID 197538eb-a2e0-4250-9778-ec3e7766fdb8 is in state Polling. End action for command d2a2e279-8ebd-4257-927f-351a5a72682f will proceed when all the entitys tasks are completed. >2014-04-09 14:35:44,616 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) SPMAsyncTask::PollTask: Polling task 197538eb-a2e0-4250-9778-ec3e7766fdb8 (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:35:44,624 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) BaseAsyncTask::OnTaskEndSuccess: Task 197538eb-a2e0-4250-9778-ec3e7766fdb8 (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:35:44,624 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-35) CommandAsyncTask::EndActionIfNecessary: All tasks of command d2a2e279-8ebd-4257-927f-351a5a72682f has ended -> executing EndAction >2014-04-09 14:35:44,624 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-35) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: d2a2e279-8ebd-4257-927f-351a5a72682f): calling EndAction . >2014-04-09 14:35:44,625 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:35:44,625 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RunVm, executionIndex: 0 >2014-04-09 14:35:44,657 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.RunVmCommand >2014-04-09 14:35:44,658 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RunVm completed, handling the result. >2014-04-09 14:35:44,658 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RunVm succeeded, clearing tasks. >2014-04-09 14:35:44,665 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 197538eb-a2e0-4250-9778-ec3e7766fdb8 >2014-04-09 14:35:44,666 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 197538eb-a2e0-4250-9778-ec3e7766fdb8), log id: 629a605a >2014-04-09 14:35:44,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=197538eb-a2e0-4250-9778-ec3e7766fdb8), log id: 52be749 >2014-04-09 14:35:44,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 52be749 >2014-04-09 14:35:44,680 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 629a605a >2014-04-09 14:35:44,690 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 197538eb-a2e0-4250-9778-ec3e7766fdb8 from DataBase >2014-04-09 14:35:44,690 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2995aa0e-64bd-4dd3-95e6-68b266218ffc >2014-04-09 14:35:44,691 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 2995aa0e-64bd-4dd3-95e6-68b266218ffc), log id: 7200ebeb >2014-04-09 14:35:44,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=2995aa0e-64bd-4dd3-95e6-68b266218ffc), log id: 1a80cbc6 >2014-04-09 14:35:44,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 1a80cbc6 >2014-04-09 14:35:44,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 7200ebeb >2014-04-09 14:35:44,715 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 2995aa0e-64bd-4dd3-95e6-68b266218ffc from DataBase >2014-04-09 14:35:44,715 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity d2a2e279-8ebd-4257-927f-351a5a72682f >2014-04-09 14:36:42,659 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [cc3164a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.218 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 14:36:45,162 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-15) [251cd2d] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:36:45,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-15) [251cd2d] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=xHl6e5Rn9YtP, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 815c5f3 >2014-04-09 14:36:45,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-15) [251cd2d] FINISH, SetVmTicketVDSCommand, log id: 815c5f3 >2014-04-09 14:36:45,243 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [251cd2d] Correlation ID: 251cd2d, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 14:37:09,896 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-67) Start refreshing all users data >2014-04-09 14:37:10,242 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-04-09 14:37:10,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center dc_iscsi >2014-04-09 14:37:10,307 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-29) START, UpdateVMVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 2ee1cd8d >2014-04-09 14:37:10,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, UpdateVMVDSCommand, log id: 2ee1cd8d >2014-04-09 14:37:10,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center dc_iscsi >2014-04-09 14:37:10,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center dc_iscsi >2014-04-09 14:37:10,361 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center dc_iscsi >2014-04-09 14:37:10,361 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center dc_iscsi >2014-04-09 14:37:10,363 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center dc_iscsi >2014-04-09 14:37:10,363 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 14:37:10,541 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-29) START, UpdateVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 4), log id: 62277544 >2014-04-09 14:37:10,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, UpdateVMVDSCommand, log id: 62277544 >2014-04-09 14:37:10,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 14:37:10,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 14:37:10,720 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 14:37:10,720 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 14:37:10,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 14:37:11,961 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Setting new tasks map. The map contains now 1 tasks >2014-04-09 14:37:11,961 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-09 14:37:12,072 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-10) [1ace5578] Running command: LogoutUserCommand internal: false. >2014-04-09 14:37:12,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [1ace5578] Correlation ID: 1ace5578, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-09 14:37:14,959 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 14:37:14,970 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:37:17,848 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.215 [953 MB] is under defined threshold [1024 MB]. >2014-04-09 14:37:37,344 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-17) [69a43aed] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:37:37,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-17) [69a43aed] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=O1v/mZZAm54V, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5422f600 >2014-04-09 14:37:37,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-17) [69a43aed] FINISH, SetVmTicketVDSCommand, log id: 5422f600 >2014-04-09 14:37:37,445 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-17) [69a43aed] Correlation ID: 69a43aed, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 14:37:55,021 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task db942761-9fec-490a-a0d6-0dcdebb6edb7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:37:55,043 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) BaseAsyncTask::OnTaskEndSuccess: Task db942761-9fec-490a-a0d6-0dcdebb6edb7 (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:37:55,044 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::EndActionIfNecessary: All tasks of command 87619e60-dbf4-45f8-baae-160d70658c89 has ended -> executing EndAction >2014-04-09 14:37:55,044 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 87619e60-dbf4-45f8-baae-160d70658c89): calling EndAction . >2014-04-09 14:37:55,044 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateDisk, executionIndex: 1 >2014-04-09 14:37:55,164 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [3f3a7f06] Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand >2014-04-09 14:37:55,164 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [3f3a7f06] Running command: LiveMigrateDiskCommand Task handler: VmReplicateDiskFinishTaskHandler internal: false. Entities affected : ID: 5d1d405b-6c8d-4973-8e80-c11555885cc5 Type: Disk, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 14:37:55,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [3f3a7f06] START, VmReplicateDiskFinishVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: ca03355 >2014-04-09 14:37:57,415 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Up --> Paused >2014-04-09 14:37:59,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.VmReplicateDiskFinishVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, VmReplicateDiskFinishVDSCommand, log id: ca03355 >2014-04-09 14:37:59,024 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = a7592631-638d-427c-af5e-58b92e75e40b), log id: 2b47fb02 >2014-04-09 14:37:59,287 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7a068e01, log id: 2b47fb02 >2014-04-09 14:37:59,301 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 23abee19-f5d5-45cb-91ff-99d44660d5db), log id: 670a2690 >2014-04-09 14:37:59,597 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@5746b9e4, log id: 670a2690 >2014-04-09 14:37:59,610 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 075b984c-9cb0-4d70-bcc6-ff1cc52f2672), log id: 19ee470d >2014-04-09 14:37:59,894 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@6feb3ed, log id: 19ee470d >2014-04-09 14:37:59,924 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88), log id: 3eee748b >2014-04-09 14:38:00,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fa6f82df, log id: 3eee748b >2014-04-09 14:38:00,210 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 496ee212-3fd7-4fd8-b42f-1642583603a0), log id: 69845849 >2014-04-09 14:38:00,474 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from Paused --> Up >2014-04-09 14:38:00,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-24) START, FullListVdsCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: 5c16f3f >2014-04-09 14:38:00,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@c7d3de6f, log id: 69845849 >2014-04-09 14:38:00,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-24) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@38972e75, log id: 5c16f3f >2014-04-09 14:38:00,543 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-35) [3f3a7f06] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, postZeros = false, forceDelete = false), log id: 23ccd649 >2014-04-09 14:38:03,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-35) [3f3a7f06] FINISH, DeleteImageGroupVDSCommand, log id: 23ccd649 >2014-04-09 14:38:03,349 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-35) [3f3a7f06] CommandMultiAsyncTasks::AttachTask: Attaching task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee to command 87619e60-dbf4-45f8-baae-160d70658c89. >2014-04-09 14:38:03,359 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-35) [3f3a7f06] Adding task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:38:03,368 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) [3f3a7f06] BaseAsyncTask::StartPollingTask: Starting to poll task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee. >2014-04-09 14:38:03,368 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk completed, handling the result. >2014-04-09 14:38:03,368 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk succeeded, clearing tasks. >2014-04-09 14:38:03,368 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) SPMAsyncTask::ClearAsyncTask: Attempting to clear task db942761-9fec-490a-a0d6-0dcdebb6edb7 >2014-04-09 14:38:03,368 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = db942761-9fec-490a-a0d6-0dcdebb6edb7), log id: 2a941338 >2014-04-09 14:38:03,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=db942761-9fec-490a-a0d6-0dcdebb6edb7), log id: 1bab0ec >2014-04-09 14:38:03,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) FINISH, HSMClearTaskVDSCommand, log id: 1bab0ec >2014-04-09 14:38:03,642 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) FINISH, SPMClearTaskVDSCommand, log id: 2a941338 >2014-04-09 14:38:03,653 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::RemoveTaskFromDB: Removed task db942761-9fec-490a-a0d6-0dcdebb6edb7 from DataBase >2014-04-09 14:38:03,653 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-35) [within thread]: Some of the tasks related to command id 87619e60-dbf4-45f8-baae-160d70658c89 were not cleared yet (Task id e50131f1-7f9c-4210-a0f7-3d5bc0d723ee is in state Polling). >2014-04-09 14:38:05,044 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-80) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-09 14:38:05,056 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) SPMAsyncTask::PollTask: Polling task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:38:05,078 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) BaseAsyncTask::OnTaskEndSuccess: Task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee (Parent Command LiveMigrateDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:38:05,078 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-80) CommandAsyncTask::EndActionIfNecessary: All tasks of command 87619e60-dbf4-45f8-baae-160d70658c89 has ended -> executing EndAction >2014-04-09 14:38:05,078 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-80) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 87619e60-dbf4-45f8-baae-160d70658c89): calling EndAction . >2014-04-09 14:38:05,078 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction LiveMigrateDisk, executionIndex: 2 >2014-04-09 14:38:05,183 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [3f3a7f06] Ending command successfully: org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand >2014-04-09 14:38:05,183 INFO [org.ovirt.engine.core.bll.lsm.LiveMigrateDiskCommand] (pool-4-thread-35) [3f3a7f06] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 14:38:05,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) [3f3a7f06] Correlation ID: 3f3a7f06, Job ID: 5dc5eb4f-01ba-4893-8ebb-8db3f64dcb2a, Call Stack: null, Custom Event ID: -1, Message: User admin@internal finished moving disk vm_vnc_Disk1 to domain dc_ISCSI_2. >2014-04-09 14:38:05,211 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk completed, handling the result. >2014-04-09 14:38:05,211 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type LiveMigrateDisk succeeded, clearing tasks. >2014-04-09 14:38:05,219 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee >2014-04-09 14:38:05,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = e50131f1-7f9c-4210-a0f7-3d5bc0d723ee), log id: 23f2451f >2014-04-09 14:38:05,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=e50131f1-7f9c-4210-a0f7-3d5bc0d723ee), log id: 769808a8 >2014-04-09 14:38:05,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-35) FINISH, HSMClearTaskVDSCommand, log id: 769808a8 >2014-04-09 14:38:05,232 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-35) FINISH, SPMClearTaskVDSCommand, log id: 23f2451f >2014-04-09 14:38:05,236 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-35) BaseAsyncTask::RemoveTaskFromDB: Removed task e50131f1-7f9c-4210-a0f7-3d5bc0d723ee from DataBase >2014-04-09 14:38:05,236 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-35) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 87619e60-dbf4-45f8-baae-160d70658c89 >2014-04-09 14:39:04,880 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-50) [3bf6eae0] Running command: StopVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:39:04,886 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [3bf6eae0] START, DestroyVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=0, gracefully=false), log id: 50de92e8 >2014-04-09 14:39:04,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [3bf6eae0] START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=0, gracefully=false), log id: 26b66884 >2014-04-09 14:39:05,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [3bf6eae0] FINISH, DestroyVDSCommand, log id: 26b66884 >2014-04-09 14:39:05,800 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [3bf6eae0] FINISH, DestroyVmVDSCommand, return: Down, log id: 50de92e8 >2014-04-09 14:39:05,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [3bf6eae0] Correlation ID: 3bf6eae0, Job ID: 7108a2d6-a346-43e9-a6ca-38c1ec351659, Call Stack: null, Custom Event ID: -1, Message: VM vm1 powered off by admin@internal (Host: 10.66.106.32). >2014-04-09 14:39:11,963 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) Setting new tasks map. The map contains now 0 tasks >2014-04-09 14:39:11,963 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 14:39:28,654 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (pool-4-thread-50) [258ba033] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b Type: Storage >2014-04-09 14:39:28,668 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-48) [60d504fc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:39:28,669 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-35) [29c41e07] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:39:28,673 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [29c41e07] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 20f1a7f6-1f33-44df-ada0-893459d6362c, connection: rhevm3.3-shyu.nay.redhat.com:/var/lib/exports/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 18a5a976 >2014-04-09 14:39:28,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [60d504fc] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 20f1a7f6-1f33-44df-ada0-893459d6362c, connection: rhevm3.3-shyu.nay.redhat.com:/var/lib/exports/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e9272ca >2014-04-09 14:39:28,776 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [60d504fc] FINISH, ConnectStorageServerVDSCommand, return: {20f1a7f6-1f33-44df-ada0-893459d6362c=0}, log id: 2e9272ca >2014-04-09 14:39:28,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [29c41e07] FINISH, ConnectStorageServerVDSCommand, return: {20f1a7f6-1f33-44df-ada0-893459d6362c=0}, log id: 18a5a976 >2014-04-09 14:39:28,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (pool-4-thread-50) [258ba033] START, AttachStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b), log id: 466037c5 >2014-04-09 14:39:45,389 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (pool-4-thread-50) [258ba033] FINISH, AttachStorageDomainVDSCommand, log id: 466037c5 >2014-04-09 14:39:45,394 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [ed77a74] Lock Acquired to object EngineLock [exclusiveLocks= key: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b value: STORAGE >, sharedLocks= ] >2014-04-09 14:39:45,440 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [ed77a74] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b Type: Storage >2014-04-09 14:39:45,469 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [ed77a74] Lock freed to object EngineLock [exclusiveLocks= key: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b value: STORAGE >, sharedLocks= ] >2014-04-09 14:39:45,469 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [ed77a74] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 2:39 PM >2014-04-09 14:39:45,480 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-47) [820c35f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:39:45,481 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-35) [2d53bba] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:39:45,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [820c35f] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 20f1a7f6-1f33-44df-ada0-893459d6362c, connection: rhevm3.3-shyu.nay.redhat.com:/var/lib/exports/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1c6aae94 >2014-04-09 14:39:45,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [2d53bba] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 20f1a7f6-1f33-44df-ada0-893459d6362c, connection: rhevm3.3-shyu.nay.redhat.com:/var/lib/exports/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d5c1cf1 >2014-04-09 14:39:45,502 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [820c35f] FINISH, ConnectStorageServerVDSCommand, return: {20f1a7f6-1f33-44df-ada0-893459d6362c=0}, log id: 1c6aae94 >2014-04-09 14:39:45,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [2d53bba] FINISH, ConnectStorageServerVDSCommand, return: {20f1a7f6-1f33-44df-ada0-893459d6362c=0}, log id: 2d5c1cf1 >2014-04-09 14:39:45,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-4-thread-50) [ed77a74] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b), log id: 640c8168 >2014-04-09 14:39:48,736 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-4-thread-50) [ed77a74] FINISH, ActivateStorageDomainVDSCommand, log id: 640c8168 >2014-04-09 14:39:48,736 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [ed77a74] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 2:39 PM >2014-04-09 14:39:48,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-48) [ed77a74] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 1e5d2e10 >2014-04-09 14:39:48,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-35) [ed77a74] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 287c1fcc >2014-04-09 14:39:48,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-35) [ed77a74] FINISH, RefreshStoragePoolVDSCommand, log id: 287c1fcc >2014-04-09 14:39:48,769 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-35) [ed77a74] Refreshed vds 10.66.106.40 in pool NFS_shyu >2014-04-09 14:39:53,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-48) [ed77a74] FINISH, RefreshStoragePoolVDSCommand, log id: 1e5d2e10 >2014-04-09 14:39:53,315 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-48) [ed77a74] Refreshed vds 10.66.106.32 in pool NFS_shyu >2014-04-09 14:39:53,326 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [ed77a74] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 2:39 PM >2014-04-09 14:39:53,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) [ed77a74] START, GetIsoListVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 55ef8cc7 >2014-04-09 14:39:53,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) [ed77a74] START, HsmGetIsoListVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 289ad7e9 >2014-04-09 14:39:53,342 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [ed77a74] Correlation ID: ed77a74, Call Stack: null, Custom Event ID: -1, Message: Storage Domain ISO_DOMAIN (Data Center NFS_shyu) was activated by admin@internal >2014-04-09 14:39:53,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) [ed77a74] FINISH, HsmGetIsoListVDSCommand, return: [rhev-tools-setup.iso, virtio-win.iso], log id: 289ad7e9 >2014-04-09 14:39:53,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) [ed77a74] FINISH, GetIsoListVDSCommand, return: [rhev-tools-setup.iso, virtio-win.iso], log id: 55ef8cc7 >2014-04-09 14:39:53,359 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [ed77a74] Correlation ID: 258ba033, Job ID: 015012c1-6746-4f26-9bdf-f2b602aa1290, Call Stack: null, Custom Event ID: -1, Message: Storage Domain ISO_DOMAIN was attached to Data Center NFS_shyu by admin@internal >2014-04-09 14:39:53,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-4-thread-48) [ed77a74] START, GetFloppyListVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: b735399 >2014-04-09 14:39:53,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-4-thread-48) [ed77a74] FINISH, GetFloppyListVDSCommand, return: [virtio-win_x86.vfd, virtio-win_amd64.vfd], log id: b735399 >2014-04-09 14:40:21,780 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-48) [1cbc1ec4] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:40:21,783 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-48) [1cbc1ec4] Entered (VM vm_vnc). >2014-04-09 14:40:21,784 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-48) [1cbc1ec4] Sending shutdown command for VM vm_vnc. >2014-04-09 14:40:21,787 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-48) [1cbc1ec4] START, DestroyVmVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=30, gracefully=true), log id: 27563c2e >2014-04-09 14:40:21,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-48) [1cbc1ec4] START, DestroyVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=30, gracefully=true), log id: 421d6598 >2014-04-09 14:40:21,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-48) [1cbc1ec4] FINISH, DestroyVDSCommand, log id: 421d6598 >2014-04-09 14:40:21,814 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-48) [1cbc1ec4] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 27563c2e >2014-04-09 14:40:21,830 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [1cbc1ec4] Correlation ID: 1cbc1ec4, Job ID: 5df78630-d815-4e50-a467-a6b2b9b064a2, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin@internal on VM vm_vnc (Host: DC-85.215). >2014-04-09 14:40:25,022 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-50) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 14:41:12,864 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2014-04-09 14:41:12,908 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 14:41:13,071 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-17) Running command: LoginUserCommand internal: false. >2014-04-09 14:41:13,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-17) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-09 14:41:26,006 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-6) Failed in GetAllVmStatsVDS method >2014-04-09 14:41:26,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-6) Error code noVM and error message VDSGenericException: VDSErrorException: Failed to GetAllVmStatsVDS, error = Virtual machine does not exist >2014-04-09 14:41:26,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-6) Command GetAllVmStatsVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetAllVmStatsVDS, error = Virtual machine does not exist >2014-04-09 14:41:26,007 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Failed vds listing, vds = 6c442434-1073-4f29-a3bd-c20b77a28d91 : DC-85.215, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetAllVmStatsVDS, error = Virtual machine does not exist >2014-04-09 14:41:26,052 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Failed to refresh VDS , vds = 6c442434-1073-4f29-a3bd-c20b77a28d91 : DC-85.215, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetAllVmStatsVDS, error = Virtual machine does not exist, continuing.: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetAllVmStatsVDS, error = Virtual machine does not exist > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createDefaultConcreteException(VdsBrokerCommand.java:61) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.createException(BrokerCommandBase.java:199) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:185) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand.executeVdsBrokerCommand(GetAllVmStatsVDSCommand.java:21) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) [vdsbroker.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) [dal.jar:] > at org.ovirt.engine.core.dal.VdcCommandBase.executeWithReturnValue(VdcCommandBase.java:47) [dal.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:913) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:495) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) [vdsbroker.jar:] > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-04-09 14:41:29,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-32) START, DestroyVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=0, gracefully=false), log id: 2ed26ed4 >2014-04-09 14:41:29,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, DestroyVDSCommand, log id: 2ed26ed4 >2014-04-09 14:41:29,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc is down. Exit message: User shut down >2014-04-09 14:41:29,135 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-32) vm vm_vnc running in db and not running in vds - add to rerun treatment. vds DC-85.215 >2014-04-09 14:41:42,932 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-11) [6d030a0a] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:41:42,950 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-11) [6d030a0a] START, IsVmDuringInitiatingVDSCommand( vmId = 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 229c866b >2014-04-09 14:41:42,950 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-11) [6d030a0a] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 229c866b >2014-04-09 14:41:43,031 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [6d030a0a] Running command: RunVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:41:43,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [6d030a0a] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 64366696 >2014-04-09 14:41:43,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [6d030a0a] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 64366696 >2014-04-09 14:41:43,137 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [6d030a0a] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 54ba9108 >2014-04-09 14:41:43,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [6d030a0a] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, vm=VM [vm1]), log id: 34113d58 >2014-04-09 14:41:43,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [6d030a0a] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f,devices=[Ljava.util.HashMap;@765d4543,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_582a69d1-bb07-404c-a314-566d5ab18280device_5cf7df1a-324f-4252-ad86-905e90e7fd60device_3e5f9888-5202-4afd-926e-876bd63d0c17device_518fadcc-4471-41dd-9a89-181e2f861d03device_121c8837-366b-4ddf-a37c-084122a5da34=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=121c8837-366b-4ddf-a37c-084122a5da34, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_582a69d1-bb07-404c-a314-566d5ab18280device_5cf7df1a-324f-4252-ad86-905e90e7fd60=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=5cf7df1a-324f-4252-ad86-905e90e7fd60, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_582a69d1-bb07-404c-a314-566d5ab18280device_5cf7df1a-324f-4252-ad86-905e90e7fd60device_3e5f9888-5202-4afd-926e-876bd63d0c17=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=3e5f9888-5202-4afd-926e-876bd63d0c17, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_582a69d1-bb07-404c-a314-566d5ab18280device_5cf7df1a-324f-4252-ad86-905e90e7fd60device_3e5f9888-5202-4afd-926e-876bd63d0c17device_518fadcc-4471-41dd-9a89-181e2f861d03=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=518fadcc-4471-41dd-9a89-181e2f861d03, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_582a69d1-bb07-404c-a314-566d5ab18280device_5cf7df1a-324f-4252-ad86-905e90e7fd60device_3e5f9888-5202-4afd-926e-876bd63d0c17device_518fadcc-4471-41dd-9a89-181e2f861d03device_121c8837-366b-4ddf-a37c-084122a5da34device_692f8f68-9e53-4c7a-9e3a-adb4f4f7fc9e=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=692f8f68-9e53-4c7a-9e3a-adb4f4f7fc9e, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_582a69d1-bb07-404c-a314-566d5ab18280=VmDevice {vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, deviceId=582a69d1-bb07-404c-a314-566d5ab18280, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}} >2014-04-09 14:41:43,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [6d030a0a] FINISH, CreateVDSCommand, log id: 34113d58 >2014-04-09 14:41:43,257 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [6d030a0a] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 54ba9108 >2014-04-09 14:41:43,257 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [6d030a0a] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-09 14:41:43,274 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [6d030a0a] Correlation ID: 6d030a0a, Job ID: 650b1a4d-719e-407a-9d04-e130c4178dc8, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:41:45,322 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from WaitForLaunch --> PoweringUp >2014-04-09 14:41:45,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-83) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f]), log id: 60c23b78 >2014-04-09 14:41:45,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-83) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@6fce74e8, log id: 60c23b78 >2014-04-09 14:41:50,496 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [5983970d] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:41:50,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [5983970d] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=mKzBxq5hwJ5R, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 69d70776 >2014-04-09 14:41:50,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [5983970d] FINISH, SetVmTicketVDSCommand, log id: 69d70776 >2014-04-09 14:41:50,574 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [5983970d] Correlation ID: 5983970d, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 14:41:58,748 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-12) [f6a1fd3] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-09 14:41:58,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-12) [f6a1fd3] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, ticket=O/Ewi0HSqpr5, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 42d29fc5 >2014-04-09 14:41:58,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-12) [f6a1fd3] FINISH, SetVmTicketVDSCommand, log id: 42d29fc5 >2014-04-09 14:41:58,824 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) [f6a1fd3] Correlation ID: f6a1fd3, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm1 >2014-04-09 14:42:08,948 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-15) [24783b13] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:42:09,131 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-15) [24783b13] Running command: RemoveSnapshotCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:42:09,156 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-15) [24783b13] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:42:09,179 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] Running command: RemoveSnapshotSingleDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:42:09,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] START, MergeSnapshotsVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 075b984c-9cb0-4d70-bcc6-ff1cc52f2672, imageId2 = 67516081-3b96-4d92-90be-c5eeb4c6ba88, vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, postZero = false), log id: b15dea7 >2014-04-09 14:42:09,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] FINISH, MergeSnapshotsVDSCommand, log id: b15dea7 >2014-04-09 14:42:09,267 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-15) [7d7c12b7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command aba31844-d75e-4c07-94f1-fde20b27648d >2014-04-09 14:42:09,267 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-15) [7d7c12b7] CommandMultiAsyncTasks::AttachTask: Attaching task 36f541b0-fe10-4f20-b438-65f57a6d014b to command aba31844-d75e-4c07-94f1-fde20b27648d. >2014-04-09 14:42:09,272 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-15) [7d7c12b7] Adding task 36f541b0-fe10-4f20-b438-65f57a6d014b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:42:09,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 943affa0-5d18-4fe7-a029-c5fef2e67cae, postZeros = false, forceDelete = false), log id: 2588afa7 >2014-04-09 14:42:10,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] FINISH, DeleteImageGroupVDSCommand, log id: 2588afa7 >2014-04-09 14:42:10,758 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-15) [7d7c12b7] CommandMultiAsyncTasks::AttachTask: Attaching task fa781746-e012-4846-b216-84602d4b03a6 to command aba31844-d75e-4c07-94f1-fde20b27648d. >2014-04-09 14:42:10,764 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-15) [7d7c12b7] Adding task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:42:10,781 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = b4dc902a-fa9d-4087-be6f-d205e1d06ab5, postZeros = false, forceDelete = false), log id: c5b0695 >2014-04-09 14:42:12,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-15) [7d7c12b7] FINISH, DeleteImageGroupVDSCommand, log id: c5b0695 >2014-04-09 14:42:12,259 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-15) [7d7c12b7] CommandMultiAsyncTasks::AttachTask: Attaching task 48a6f364-ece9-46d0-87b0-42291c0435ec to command aba31844-d75e-4c07-94f1-fde20b27648d. >2014-04-09 14:42:12,272 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-15) [7d7c12b7] Adding task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:42:12,306 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [7d7c12b7] Correlation ID: 24783b13, Job ID: 92e80b19-c599-4cef-a33e-37445016ad0f, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's3' deletion for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:42:12,306 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-15) [7d7c12b7] BaseAsyncTask::StartPollingTask: Starting to poll task 36f541b0-fe10-4f20-b438-65f57a6d014b. >2014-04-09 14:42:12,307 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-15) [7d7c12b7] BaseAsyncTask::StartPollingTask: Starting to poll task fa781746-e012-4846-b216-84602d4b03a6. >2014-04-09 14:42:12,307 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-15) [7d7c12b7] BaseAsyncTask::StartPollingTask: Starting to poll task 48a6f364-ece9-46d0-87b0-42291c0435ec. >2014-04-09 14:42:13,193 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-7) [3e1ddd7f] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:42:13,196 WARN [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-7) [3e1ddd7f] CanDoAction of action RemoveSnapshot failed. Reasons:VAR__TYPE__SNAPSHOT,VAR__ACTION__REMOVE,ACTION_TYPE_FAILED_VM_IS_DURING_SNAPSHOT >2014-04-09 14:42:13,196 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-7) [3e1ddd7f] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:42:15,171 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-04-09 14:42:15,214 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task 36f541b0-fe10-4f20-b438-65f57a6d014b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:42:15,214 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:42:15,239 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:15,239 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-10) Task with DB Task ID a8876128-24fd-4b40-9d69-33e2d8450ce2 and VDSM Task ID fa781746-e012-4846-b216-84602d4b03a6 is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:15,240 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:42:15,247 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:15,248 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-10) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:15,248 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:42:25,288 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-37) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:25,288 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-37) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:25,304 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-37) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:25,305 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-37) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:35,345 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-63) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:35,345 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-63) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:35,353 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-63) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:35,353 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-63) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:43,865 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) VM vm1 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f moved from PoweringUp --> Up >2014-04-09 14:42:43,903 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) Correlation ID: 6d030a0a, Job ID: 650b1a4d-719e-407a-9d04-e130c4178dc8, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host 10.66.106.32 >2014-04-09 14:42:45,394 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-94) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:45,394 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-94) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:45,402 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-94) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:45,403 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-94) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:55,434 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:55,435 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-21) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:42:55,443 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:42:55,443 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-21) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:05,491 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:05,492 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-36) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:05,500 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:05,500 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-36) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:15,549 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [29d39d31] BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:15,549 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-5) [29d39d31] Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:15,557 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [29d39d31] BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:15,557 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-5) [29d39d31] Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:25,597 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:25,598 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-54) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:25,614 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-54) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:25,614 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-54) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:35,638 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-93) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:35,638 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-93) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:35,646 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-93) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:35,646 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-93) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:45,678 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-3) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:45,678 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-3) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:45,695 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-3) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:45,695 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-3) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:55,718 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-53) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:55,719 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-53) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:43:55,735 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-53) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:43:55,735 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-53) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:05,759 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-28) [2610ec1f] BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:05,759 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:05,767 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-28) [2610ec1f] BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:05,767 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:15,799 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-64) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:15,800 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-64) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:15,807 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-64) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:15,808 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-64) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:25,840 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-6) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:25,840 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-6) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:25,848 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-6) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:25,848 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-6) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:35,872 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-67) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:35,872 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-67) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:35,880 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-67) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:35,880 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-67) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:45,912 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-11) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:45,912 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-11) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:45,920 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-11) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:45,920 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-11) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:55,944 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-97) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:55,944 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-97) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:44:55,952 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-97) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:44:55,952 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-97) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:06,010 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-34) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:06,010 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-34) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:06,034 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-34) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:06,034 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-34) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:16,066 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-52) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:16,066 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-52) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:16,074 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-52) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:16,075 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-52) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:26,106 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:26,106 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-7) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:26,115 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:26,115 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-7) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:36,138 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-45) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:36,139 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-45) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:36,147 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-45) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:36,147 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-45) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:46,187 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-13) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:46,187 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-13) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:46,195 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-13) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:46,196 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-13) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:51,391 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] START, IsVmDuringInitiatingVDSCommand( vmId = c9ccfdfe-0f0d-4c96-8bd7-47723067081a), log id: f44efcb >2014-04-09 14:45:51,392 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: f44efcb >2014-04-09 14:45:51,436 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] Running command: RunVmOnceCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:45:51,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] START, IsoPrefixVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 556650e8 >2014-04-09 14:45:51,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 556650e8 >2014-04-09 14:45:51,522 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] START, CreateVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, vm=VM [vm3]), log id: 20e36297 >2014-04-09 14:45:51,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] START, CreateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, vm=VM [vm3]), log id: 6a688d84 >2014-04-09 14:45:51,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a,devices=[Ljava.util.HashMap;@22b9a375,acpiEnable=true,vmName=vm3,cpuType=Conroe,custom={device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39device_87f9a9ab-6f66-499e-b511-54bc31d2c5e5device_07bda9a0-705c-4958-a74c-71b23efde600=VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=07bda9a0-705c-4958-a74c-71b23efde600, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39=VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=9ea104df-d190-4ee8-90c0-4396974f2d39, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39device_87f9a9ab-6f66-499e-b511-54bc31d2c5e5=VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=87f9a9ab-6f66-499e-b511-54bc31d2c5e5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0c6bf43b-a8a5-4d74-aeaa-b122450e445c=VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=0c6bf43b-a8a5-4d74-aeaa-b122450e445c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39device_87f9a9ab-6f66-499e-b511-54bc31d2c5e5device_07bda9a0-705c-4958-a74c-71b23efde600device_d04ac436-bc13-4e3a-a526-e3d7e21156ff=VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=d04ac436-bc13-4e3a-a526-e3d7e21156ff, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-04-09 14:45:51,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] FINISH, CreateVDSCommand, log id: 6a688d84 >2014-04-09 14:45:51,628 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 20e36297 >2014-04-09 14:45:51,636 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [2bfe3b6e] Correlation ID: 2bfe3b6e, Job ID: a4de796e-fb8a-4de5-89b0-f0053bdc9426, Call Stack: null, Custom Event ID: -1, Message: VM vm3 was started by admin@internal (Host: 10.66.106.32). >2014-04-09 14:45:53,250 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM vm3 c9ccfdfe-0f0d-4c96-8bd7-47723067081a moved from WaitForLaunch --> PoweringUp >2014-04-09 14:45:53,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[c9ccfdfe-0f0d-4c96-8bd7-47723067081a]), log id: 3e1a2565 >2014-04-09 14:45:53,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@268d29bd, log id: 3e1a2565 >2014-04-09 14:45:56,236 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:56,236 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-65) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:45:56,244 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:45:56,244 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-65) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:02,761 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [70961460] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:46:02,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [70961460] START, SetVmTicketVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, ticket=6aFhdoUdEvnA, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 38ec0f1e >2014-04-09 14:46:02,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [70961460] FINISH, SetVmTicketVDSCommand, log id: 38ec0f1e >2014-04-09 14:46:02,845 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [70961460] Correlation ID: 70961460, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm3 >2014-04-09 14:46:06,287 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:06,287 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-56) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:06,303 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:06,304 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-56) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:16,327 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:16,327 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-51) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:16,335 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:16,335 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-51) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:26,375 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-66) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:26,376 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-66) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:26,384 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-66) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:26,384 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-66) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:36,441 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-1) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:36,441 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-1) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:36,449 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-1) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:36,449 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-1) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:46,474 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-52) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:46,475 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-52) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:46,483 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-52) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:46,483 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-52) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:54,422 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) VM vm3 c9ccfdfe-0f0d-4c96-8bd7-47723067081a moved from PoweringUp --> Up >2014-04-09 14:46:54,441 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) Correlation ID: 2bfe3b6e, Job ID: a4de796e-fb8a-4de5-89b0-f0053bdc9426, Call Stack: null, Custom Event ID: -1, Message: VM vm3 started on Host 10.66.106.32 >2014-04-09 14:46:56,507 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-59) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:56,507 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-59) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:56,515 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-59) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:46:56,516 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-59) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:46:57,958 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [478d7c94] Lock Acquired to object EngineLock [exclusiveLocks= key: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b value: STORAGE >, sharedLocks= ] >2014-04-09 14:46:58,057 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-48) [478d7c94] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b Type: Storage >2014-04-09 14:46:58,076 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (pool-4-thread-48) [478d7c94] START, DeactivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 5375c7ca >2014-04-09 14:46:58,098 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (pool-4-thread-48) [478d7c94] FINISH, DeactivateStorageDomainVDSCommand, log id: 5375c7ca >2014-04-09 14:46:58,098 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-48) [478d7c94] Lock freed to object EngineLock [exclusiveLocks= key: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b value: STORAGE >, sharedLocks= ] >2014-04-09 14:46:58,110 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-4-thread-47) [478d7c94] After deactivate treatment vds: 10.66.106.40,pool NFS_shyu >2014-04-09 14:46:58,110 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-4-thread-50) [478d7c94] After deactivate treatment vds: 10.66.106.32,pool NFS_shyu >2014-04-09 14:46:58,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [478d7c94] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 57772587 >2014-04-09 14:46:58,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [478d7c94] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion=1), log id: 4fc4d47f >2014-04-09 14:46:58,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [478d7c94] FINISH, RefreshStoragePoolVDSCommand, log id: 4fc4d47f >2014-04-09 14:47:06,540 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-82) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:06,540 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-82) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:47:06,548 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-82) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:06,548 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-82) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:47:09,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [478d7c94] FINISH, RefreshStoragePoolVDSCommand, log id: 57772587 >2014-04-09 14:47:09,083 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (pool-4-thread-50) [248a9d7e] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:47:09,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-50) [248a9d7e] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 20f1a7f6-1f33-44df-ada0-893459d6362c, connection: rhevm3.3-shyu.nay.redhat.com:/var/lib/exports/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5a4f4be0 >2014-04-09 14:47:16,622 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 48a6f364-ece9-46d0-87b0-42291c0435ec (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:16,622 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-98) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:47:16,630 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task fa781746-e012-4846-b216-84602d4b03a6 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:16,631 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-98) Task with DB Task ID 9f2e0aae-98d8-483c-8a67-c0afac828b43 and VDSM Task ID 36f541b0-fe10-4f20-b438-65f57a6d014b is in state Polling. End action for command aba31844-d75e-4c07-94f1-fde20b27648d will proceed when all the entitys tasks are completed. >2014-04-09 14:47:17,167 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-16) [2787931d] Lock Acquired to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-09 14:47:17,256 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (pool-4-thread-47) [2787931d] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:47:17,290 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-47) [2787931d] START, MigrateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, srcHost=10.66.106.32, dstVdsId=8b916f9f-d5e6-40a1-8e4b-58ef7df47820, dstHost=10.66.106.40:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 4f0a8099 >2014-04-09 14:47:17,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-47) [2787931d] VdsBroker::migrate::Entered (vm_guid=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, srcHost=10.66.106.32, dstHost=10.66.106.40:54321, method=online >2014-04-09 14:47:17,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-47) [2787931d] START, MigrateBrokerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, srcHost=10.66.106.32, dstVdsId=8b916f9f-d5e6-40a1-8e4b-58ef7df47820, dstHost=10.66.106.40:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 302dd3bc >2014-04-09 14:47:17,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-47) [2787931d] FINISH, MigrateBrokerVDSCommand, log id: 302dd3bc >2014-04-09 14:47:17,314 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-47) [2787931d] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 4f0a8099 >2014-04-09 14:47:17,330 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [2787931d] Correlation ID: 2787931d, Job ID: d308e4b3-4c33-479a-a906-a4d8ace3c27b, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: vm3, Source: 10.66.106.32, Destination: 10.66.106.40, User: admin@internal). >2014-04-09 14:47:17,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-50) [248a9d7e] FINISH, DisconnectStorageServerVDSCommand, return: {20f1a7f6-1f33-44df-ada0-893459d6362c=0}, log id: 5a4f4be0 >2014-04-09 14:47:17,862 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (pool-4-thread-48) [3b6b2b8e] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:47:17,864 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-48) [3b6b2b8e] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 20f1a7f6-1f33-44df-ada0-893459d6362c, connection: rhevm3.3-shyu.nay.redhat.com:/var/lib/exports/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 84704a9 >2014-04-09 14:47:18,321 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) RefreshVmList vm id c9ccfdfe-0f0d-4c96-8bd7-47723067081a is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:47:19,321 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) VM vm3 c9ccfdfe-0f0d-4c96-8bd7-47723067081a moved from MigratingFrom --> Up >2014-04-09 14:47:19,321 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) Adding VM c9ccfdfe-0f0d-4c96-8bd7-47723067081a to re-run list >2014-04-09 14:47:19,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-30) START, FullListVdsCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vds=Host[10.66.106.32], vmIds=[c9ccfdfe-0f0d-4c96-8bd7-47723067081a]), log id: 6e6d3724 >2014-04-09 14:47:19,336 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-30) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@443f551f, log id: 6e6d3724 >2014-04-09 14:47:19,406 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) Rerun vm c9ccfdfe-0f0d-4c96-8bd7-47723067081a. Called from vds 10.66.106.32 >2014-04-09 14:47:19,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) START, MigrateStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a), log id: 6729c6c7 >2014-04-09 14:47:19,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) Failed in MigrateStatusVDS method >2014-04-09 14:47:19,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) Error code migrateErr and error message VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2014-04-09 14:47:19,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-04-09 14:47:19,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) HostName = 10.66.106.32 >2014-04-09 14:47:19,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) Command MigrateStatusVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2014-04-09 14:47:19,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-4-thread-35) FINISH, MigrateStatusVDSCommand, log id: 6729c6c7 >2014-04-09 14:47:19,430 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-35) Correlation ID: 2787931d, Job ID: d308e4b3-4c33-479a-a906-a4d8ace3c27b, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration (VM: vm3, Source: 10.66.106.32, Destination: 10.66.106.40). >2014-04-09 14:47:19,431 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (pool-4-thread-35) Lock freed to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-09 14:47:20,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-48) [3b6b2b8e] FINISH, DisconnectStorageServerVDSCommand, return: {20f1a7f6-1f33-44df-ada0-893459d6362c=0}, log id: 84704a9 >2014-04-09 14:47:20,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [3b6b2b8e] Correlation ID: 478d7c94, Job ID: fa700260-77c3-4144-926a-3b4c523fbdec, Call Stack: null, Custom Event ID: -1, Message: Storage Domain ISO_DOMAIN (Data Center NFS_shyu) was deactivated by admin@internal >2014-04-09 14:47:26,644 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-79) [6079cede] SPMAsyncTask::PollTask: Polling task 36f541b0-fe10-4f20-b438-65f57a6d014b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:47:26,671 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-79) [6079cede] BaseAsyncTask::OnTaskEndSuccess: Task 36f541b0-fe10-4f20-b438-65f57a6d014b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:26,672 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-79) [6079cede] CommandAsyncTask::EndActionIfNecessary: All tasks of command aba31844-d75e-4c07-94f1-fde20b27648d has ended -> executing EndAction >2014-04-09 14:47:26,672 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-79) [6079cede] CommandAsyncTask::EndAction: Ending action for 3 tasks (command ID: aba31844-d75e-4c07-94f1-fde20b27648d): calling EndAction . >2014-04-09 14:47:26,672 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) [6079cede] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveSnapshot, executionIndex: 0 >2014-04-09 14:47:26,688 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (pool-4-thread-48) [24783b13] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotCommand >2014-04-09 14:47:26,718 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (pool-4-thread-48) [7d7c12b7] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand >2014-04-09 14:47:26,741 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [7d7c12b7] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88), log id: 11de38c2 >2014-04-09 14:47:27,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [7d7c12b7] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9db1b1aa, log id: 11de38c2 >2014-04-09 14:47:27,296 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 24783b13, Job ID: 92e80b19-c599-4cef-a33e-37445016ad0f, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's3' deletion for VM 'vm_vnc' has been completed. >2014-04-09 14:47:27,296 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot completed, handling the result. >2014-04-09 14:47:27,297 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot succeeded, clearing tasks. >2014-04-09 14:47:27,305 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task fa781746-e012-4846-b216-84602d4b03a6 >2014-04-09 14:47:27,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = fa781746-e012-4846-b216-84602d4b03a6), log id: 220c7a04 >2014-04-09 14:47:27,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=fa781746-e012-4846-b216-84602d4b03a6), log id: 611eae12 >2014-04-09 14:47:27,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 611eae12 >2014-04-09 14:47:27,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 220c7a04 >2014-04-09 14:47:27,355 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task fa781746-e012-4846-b216-84602d4b03a6 from DataBase >2014-04-09 14:47:27,355 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 36f541b0-fe10-4f20-b438-65f57a6d014b >2014-04-09 14:47:27,355 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 36f541b0-fe10-4f20-b438-65f57a6d014b), log id: 4d5c82ed >2014-04-09 14:47:27,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=36f541b0-fe10-4f20-b438-65f57a6d014b), log id: 7497bd48 >2014-04-09 14:47:27,367 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 7497bd48 >2014-04-09 14:47:27,367 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 4d5c82ed >2014-04-09 14:47:27,371 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 36f541b0-fe10-4f20-b438-65f57a6d014b from DataBase >2014-04-09 14:47:27,371 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 48a6f364-ece9-46d0-87b0-42291c0435ec >2014-04-09 14:47:27,372 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 48a6f364-ece9-46d0-87b0-42291c0435ec), log id: 72e9d1a9 >2014-04-09 14:47:27,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=48a6f364-ece9-46d0-87b0-42291c0435ec), log id: 54c3e92f >2014-04-09 14:47:27,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 54c3e92f >2014-04-09 14:47:27,387 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 72e9d1a9 >2014-04-09 14:47:27,396 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 48a6f364-ece9-46d0-87b0-42291c0435ec from DataBase >2014-04-09 14:47:27,397 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity aba31844-d75e-4c07-94f1-fde20b27648d >2014-04-09 14:47:35,825 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-4) [3b667acf] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:47:35,929 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-4) [3b667acf] Running command: RemoveSnapshotCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:47:35,946 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-4) [3b667acf] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:47:35,973 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] Running command: RemoveSnapshotSingleDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:47:35,983 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] START, MergeSnapshotsVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 23abee19-f5d5-45cb-91ff-99d44660d5db, imageId2 = 67516081-3b96-4d92-90be-c5eeb4c6ba88, vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, postZero = false), log id: 53f4a8f9 >2014-04-09 14:47:36,021 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] FINISH, MergeSnapshotsVDSCommand, log id: 53f4a8f9 >2014-04-09 14:47:36,032 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-4) [4ebcfb58] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command c722a75c-d292-4727-8ffd-846b32fc56ce >2014-04-09 14:47:36,032 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-4) [4ebcfb58] CommandMultiAsyncTasks::AttachTask: Attaching task c3547a35-4464-4037-8fc2-f7d8b6be6219 to command c722a75c-d292-4727-8ffd-846b32fc56ce. >2014-04-09 14:47:36,045 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-4) [4ebcfb58] Adding task c3547a35-4464-4037-8fc2-f7d8b6be6219 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:47:36,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = c47d93e6-d757-4fc0-88e2-c3511ff8ac3b, postZeros = false, forceDelete = false), log id: 52ff5762 >2014-04-09 14:47:37,713 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] FINISH, DeleteImageGroupVDSCommand, log id: 52ff5762 >2014-04-09 14:47:37,739 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-4) [4ebcfb58] CommandMultiAsyncTasks::AttachTask: Attaching task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 to command c722a75c-d292-4727-8ffd-846b32fc56ce. >2014-04-09 14:47:37,754 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-4) [4ebcfb58] Adding task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:47:37,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 8842ce60-85b6-4192-9d0f-8896df2bf936, postZeros = false, forceDelete = false), log id: 69d64c0c >2014-04-09 14:47:39,351 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-4) [4ebcfb58] FINISH, DeleteImageGroupVDSCommand, log id: 69d64c0c >2014-04-09 14:47:39,364 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-4) [4ebcfb58] CommandMultiAsyncTasks::AttachTask: Attaching task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b to command c722a75c-d292-4727-8ffd-846b32fc56ce. >2014-04-09 14:47:39,379 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-4) [4ebcfb58] Adding task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:47:39,420 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [4ebcfb58] Correlation ID: 3b667acf, Job ID: 8b8e38dd-c73e-4f0b-9419-8048c699de5c, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's2' deletion for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:47:39,420 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-4) [4ebcfb58] BaseAsyncTask::StartPollingTask: Starting to poll task c3547a35-4464-4037-8fc2-f7d8b6be6219. >2014-04-09 14:47:39,421 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-4) [4ebcfb58] BaseAsyncTask::StartPollingTask: Starting to poll task d9df35da-2a7c-48c8-ac3f-6ba5593ce347. >2014-04-09 14:47:39,421 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-4) [4ebcfb58] BaseAsyncTask::StartPollingTask: Starting to poll task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b. >2014-04-09 14:47:46,824 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-80) Polling and updating Async Tasks: 6 tasks, 3 tasks to poll now >2014-04-09 14:47:46,838 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) SPMAsyncTask::PollTask: Polling task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:47:46,844 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:46,844 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-80) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:47:46,845 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) SPMAsyncTask::PollTask: Polling task c3547a35-4464-4037-8fc2-f7d8b6be6219 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:47:46,845 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) SPMAsyncTask::PollTask: Polling task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:47:46,853 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:46,853 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-80) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:47:46,853 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-80) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:47:56,884 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-43) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:56,885 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-43) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:47:56,893 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-43) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:47:56,893 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-43) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:05,585 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-9) [796272bf] Lock Acquired to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-09 14:48:05,684 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-4-thread-50) [796272bf] Running command: MigrateVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-09 14:48:05,713 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-50) [796272bf] START, MigrateVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, srcHost=10.66.106.32, dstVdsId=8b916f9f-d5e6-40a1-8e4b-58ef7df47820, dstHost=10.66.106.40:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 24065c78 >2014-04-09 14:48:05,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-50) [796272bf] VdsBroker::migrate::Entered (vm_guid=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, srcHost=10.66.106.32, dstHost=10.66.106.40:54321, method=online >2014-04-09 14:48:05,714 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-50) [796272bf] START, MigrateBrokerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, srcHost=10.66.106.32, dstVdsId=8b916f9f-d5e6-40a1-8e4b-58ef7df47820, dstHost=10.66.106.40:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 56bea201 >2014-04-09 14:48:05,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-50) [796272bf] FINISH, MigrateBrokerVDSCommand, log id: 56bea201 >2014-04-09 14:48:05,742 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-50) [796272bf] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 24065c78 >2014-04-09 14:48:05,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [796272bf] Correlation ID: 796272bf, Job ID: 913db1c5-928b-4013-bae4-19c3da9f742f, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: vm3, Source: 10.66.106.32, Destination: 10.66.106.40, User: admin@internal). >2014-04-09 14:48:06,934 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-71) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:06,934 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-71) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:06,942 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-71) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:06,942 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-71) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:07,234 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) RefreshVmList vm id c9ccfdfe-0f0d-4c96-8bd7-47723067081a is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:48:10,387 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) RefreshVmList vm id c9ccfdfe-0f0d-4c96-8bd7-47723067081a is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:48:13,417 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-38) RefreshVmList vm id c9ccfdfe-0f0d-4c96-8bd7-47723067081a is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:48:16,448 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) RefreshVmList vm id c9ccfdfe-0f0d-4c96-8bd7-47723067081a is migrating to vds 10.66.106.40 ignoring it in the refresh until migration is done >2014-04-09 14:48:16,974 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) [68dc1a40] BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:16,974 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-31) [68dc1a40] Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:16,982 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-31) [68dc1a40] BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:16,982 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-31) [68dc1a40] Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:19,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) START, FullListVdsCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vds=Host[10.66.106.40], vmIds=[c9ccfdfe-0f0d-4c96-8bd7-47723067081a]), log id: 32259bfb >2014-04-09 14:48:19,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@746b0f61, log id: 32259bfb >2014-04-09 14:48:19,699 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) Correlation ID: 796272bf, Job ID: 913db1c5-928b-4013-bae4-19c3da9f742f, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: vm3, Source: 10.66.106.32, Destination: 10.66.106.40, Duration: 13 sec). >2014-04-09 14:48:19,707 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-17) Lock freed to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-09 14:48:20,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-75) START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: 42053936 >2014-04-09 14:48:21,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, DestroyVDSCommand, log id: 42053936 >2014-04-09 14:48:21,201 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) RefreshVmList vm id c9ccfdfe-0f0d-4c96-8bd7-47723067081a status = Down on vds 10.66.106.32 ignoring it in the refresh until migration is done >2014-04-09 14:48:27,072 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-24) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:27,072 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-24) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:27,098 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-24) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:27,098 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-24) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:37,130 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:37,130 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-50) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:37,138 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:37,138 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-50) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:41,970 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-94) Setting new tasks map. The map contains now 3 tasks >2014-04-09 14:48:47,139 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-91) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-04-09 14:48:47,162 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-91) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:47,162 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-91) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:47,170 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-91) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:47,170 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-91) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:47,170 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-91) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:48:57,202 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:57,203 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-92) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:48:57,219 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:48:57,219 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-92) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:07,251 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-88) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:07,251 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-88) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:07,259 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-88) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:07,259 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-88) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:17,283 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:17,283 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:17,291 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:17,291 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-41) [1a9b4afc] Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:27,315 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:27,315 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:27,333 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:27,333 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:37,357 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-6) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:37,357 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-6) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:37,365 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-6) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:37,365 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-6) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:47,389 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:47,389 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-36) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:47,397 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:47,397 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-36) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:56,651 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from Up --> RebootInProgress >2014-04-09 14:49:56,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-12) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 478ab007 >2014-04-09 14:49:56,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-12) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@622ac042, log id: 478ab007 >2014-04-09 14:49:57,443 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-99) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:57,443 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-99) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:49:57,463 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-99) BaseAsyncTask::OnTaskEndSuccess: Task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:49:57,463 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-99) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:50:07,486 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:07,486 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-26) Task with DB Task ID 2a46ad07-0880-4285-89b9-95cefc91152f and VDSM Task ID c3547a35-4464-4037-8fc2-f7d8b6be6219 is in state Polling. End action for command c722a75c-d292-4727-8ffd-846b32fc56ce will proceed when all the entitys tasks are completed. >2014-04-09 14:50:07,487 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) SPMAsyncTask::PollTask: Polling task c3547a35-4464-4037-8fc2-f7d8b6be6219 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:50:07,495 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task c3547a35-4464-4037-8fc2-f7d8b6be6219 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:07,495 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-26) CommandAsyncTask::EndActionIfNecessary: All tasks of command c722a75c-d292-4727-8ffd-846b32fc56ce has ended -> executing EndAction >2014-04-09 14:50:07,495 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-26) CommandAsyncTask::EndAction: Ending action for 3 tasks (command ID: c722a75c-d292-4727-8ffd-846b32fc56ce): calling EndAction . >2014-04-09 14:50:07,495 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveSnapshot, executionIndex: 0 >2014-04-09 14:50:07,511 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (pool-4-thread-48) [3b667acf] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotCommand >2014-04-09 14:50:07,523 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (pool-4-thread-48) [4ebcfb58] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand >2014-04-09 14:50:07,536 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [4ebcfb58] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88), log id: 3d77f138 >2014-04-09 14:50:08,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [4ebcfb58] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@53365e4c, log id: 3d77f138 >2014-04-09 14:50:08,186 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 3b667acf, Job ID: 8b8e38dd-c73e-4f0b-9419-8048c699de5c, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's2' deletion for VM 'vm_vnc' has been completed. >2014-04-09 14:50:08,186 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot completed, handling the result. >2014-04-09 14:50:08,186 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot succeeded, clearing tasks. >2014-04-09 14:50:08,195 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c3547a35-4464-4037-8fc2-f7d8b6be6219 >2014-04-09 14:50:08,195 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = c3547a35-4464-4037-8fc2-f7d8b6be6219), log id: 3eea8d5 >2014-04-09 14:50:08,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=c3547a35-4464-4037-8fc2-f7d8b6be6219), log id: 298e39f7 >2014-04-09 14:50:08,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 298e39f7 >2014-04-09 14:50:08,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 3eea8d5 >2014-04-09 14:50:08,219 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task c3547a35-4464-4037-8fc2-f7d8b6be6219 from DataBase >2014-04-09 14:50:08,220 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 >2014-04-09 14:50:08,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = d9df35da-2a7c-48c8-ac3f-6ba5593ce347), log id: 2b501cb6 >2014-04-09 14:50:08,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=d9df35da-2a7c-48c8-ac3f-6ba5593ce347), log id: 188d06f1 >2014-04-09 14:50:08,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 188d06f1 >2014-04-09 14:50:08,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 2b501cb6 >2014-04-09 14:50:08,244 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task d9df35da-2a7c-48c8-ac3f-6ba5593ce347 from DataBase >2014-04-09 14:50:08,245 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b >2014-04-09 14:50:08,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b), log id: 3ab43693 >2014-04-09 14:50:08,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=6bd07744-e3f1-4bde-bcee-5a65cb2fd17b), log id: d6b0b01 >2014-04-09 14:50:08,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: d6b0b01 >2014-04-09 14:50:08,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 3ab43693 >2014-04-09 14:50:08,269 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 6bd07744-e3f1-4bde-bcee-5a65cb2fd17b from DataBase >2014-04-09 14:50:08,270 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity c722a75c-d292-4727-8ffd-846b32fc56ce >2014-04-09 14:50:22,696 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-17) [1bd19] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:50:22,751 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-17) [1bd19] Running command: RemoveSnapshotCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 14:50:22,768 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-17) [1bd19] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 14:50:22,783 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (ajp-/127.0.0.1:8702-17) [1a953136] Running command: RemoveSnapshotSingleDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 14:50:22,796 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-17) [1a953136] START, MergeSnapshotsVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = a7592631-638d-427c-af5e-58b92e75e40b, imageId2 = 67516081-3b96-4d92-90be-c5eeb4c6ba88, vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, postZero = false), log id: 11f0d14d >2014-04-09 14:50:22,875 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-17) [1a953136] FINISH, MergeSnapshotsVDSCommand, log id: 11f0d14d >2014-04-09 14:50:22,893 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-17) [1a953136] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 5ce3a805-3855-4b25-8018-45eee22d8033 >2014-04-09 14:50:22,893 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-17) [1a953136] CommandMultiAsyncTasks::AttachTask: Attaching task d3c2d81b-86f5-466c-bc84-32ea17260162 to command 5ce3a805-3855-4b25-8018-45eee22d8033. >2014-04-09 14:50:22,901 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-17) [1a953136] Adding task d3c2d81b-86f5-466c-bc84-32ea17260162 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:50:22,926 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-17) [1a953136] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 7d81046a-1238-4b5d-b312-ebc24ac08300, postZeros = false, forceDelete = false), log id: 1b8324b6 >2014-04-09 14:50:24,101 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-17) [1a953136] FINISH, DeleteImageGroupVDSCommand, log id: 1b8324b6 >2014-04-09 14:50:24,112 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-17) [1a953136] CommandMultiAsyncTasks::AttachTask: Attaching task 71e1d25d-1452-43f5-b09e-78024900a77d to command 5ce3a805-3855-4b25-8018-45eee22d8033. >2014-04-09 14:50:24,126 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-17) [1a953136] Adding task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:50:24,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-17) [1a953136] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 0f33259d-58db-4ad1-a97e-12c73b0491ba, postZeros = false, forceDelete = false), log id: 4474c44d >2014-04-09 14:50:25,317 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (ajp-/127.0.0.1:8702-17) [1a953136] FINISH, DeleteImageGroupVDSCommand, log id: 4474c44d >2014-04-09 14:50:25,352 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-17) [1a953136] CommandMultiAsyncTasks::AttachTask: Attaching task 70908c80-d760-42bf-8896-035a3d80fad9 to command 5ce3a805-3855-4b25-8018-45eee22d8033. >2014-04-09 14:50:25,359 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-17) [1a953136] Adding task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:50:25,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-17) [1a953136] Correlation ID: 1bd19, Job ID: 6a96454a-b204-4836-894a-5b0693638ce6, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's1' deletion for VM 'vm_vnc' was initiated by admin@internal. >2014-04-09 14:50:25,384 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-17) [1a953136] BaseAsyncTask::StartPollingTask: Starting to poll task d3c2d81b-86f5-466c-bc84-32ea17260162. >2014-04-09 14:50:25,384 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-17) [1a953136] BaseAsyncTask::StartPollingTask: Starting to poll task 71e1d25d-1452-43f5-b09e-78024900a77d. >2014-04-09 14:50:25,385 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-17) [1a953136] BaseAsyncTask::StartPollingTask: Starting to poll task 70908c80-d760-42bf-8896-035a3d80fad9. >2014-04-09 14:50:27,496 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) Polling and updating Async Tasks: 6 tasks, 3 tasks to poll now >2014-04-09 14:50:27,517 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:50:27,542 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:27,542 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-10) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:27,543 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:50:27,550 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:27,551 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-10) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:27,551 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-10) SPMAsyncTask::PollTask: Polling task d3c2d81b-86f5-466c-bc84-32ea17260162 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-04-09 14:50:27,551 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:50:37,599 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-53) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:37,599 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-53) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:37,607 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-53) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:37,608 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-53) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:47,631 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:47,631 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-89) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:47,639 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-89) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:47,640 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-89) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:54,688 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from RebootInProgress --> Up >2014-04-09 14:50:57,663 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:57,663 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-19) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:50:57,671 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-19) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:50:57,672 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-19) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:07,695 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:07,695 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-65) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:07,703 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:07,704 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-65) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:11,973 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-40) Setting new tasks map. The map contains now 3 tasks >2014-04-09 14:51:17,704 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-49) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-04-09 14:51:17,727 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-49) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:17,727 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-49) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:17,735 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-49) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:17,736 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-49) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:17,744 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-49) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:51:27,776 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-99) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:27,776 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-99) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:27,784 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-99) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:27,784 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-99) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:37,899 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:37,900 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-26) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:37,908 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:37,908 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-26) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:47,932 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-86) [127d87cf] BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:47,932 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-86) [127d87cf] Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:47,940 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-86) [127d87cf] BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:47,941 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-86) [127d87cf] Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:58,007 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:58,007 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-44) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:51:58,023 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:51:58,024 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-44) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:08,055 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-8) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:08,056 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-8) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:08,072 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-8) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:08,072 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-8) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:18,096 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-27) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:18,096 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-27) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:18,104 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-27) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:18,104 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-27) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:28,158 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-25) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:28,158 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-25) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:28,178 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-25) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:28,178 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-25) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:38,210 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:38,210 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-65) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:38,218 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:38,218 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-65) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:38,342 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (ajp-/127.0.0.1:8702-1) [aedbd31] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 14:52:38,536 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-50) [aedbd31] Running command: HibernateVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:52:38,549 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-50) [aedbd31] START, UpdateVmDynamicDataVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@258b9ebb), log id: 66b763ab >2014-04-09 14:52:38,550 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-50) [aedbd31] FINISH, UpdateVmDynamicDataVDSCommand, log id: 66b763ab >2014-04-09 14:52:38,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = c708bed2-82a7-41f6-bd4a-929e275dd761, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = ffb5f117-e2ff-46e6-8112-28e4abfa0626, newImageDescription = ), log id: 75e17edd >2014-04-09 14:52:38,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:52:38,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=c708bed2-82a7-41f6-bd4a-929e275dd761 > size=1,350,565,888 bytes > volFormat=RAW > volType=Preallocated > volUUID=ffb5f117-e2ff-46e6-8112-28e4abfa0626 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:52:38,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] FINISH, CreateImageVDSCommand, return: ffb5f117-e2ff-46e6-8112-28e4abfa0626, log id: 75e17edd >2014-04-09 14:52:38,638 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [aedbd31] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command d57ac19e-cd64-4377-9a53-588b9d702d2c >2014-04-09 14:52:38,638 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [aedbd31] CommandMultiAsyncTasks::AttachTask: Attaching task bba75302-15e5-486b-b3e8-2dc2c743f5cb to command d57ac19e-cd64-4377-9a53-588b9d702d2c. >2014-04-09 14:52:38,645 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [aedbd31] Adding task bba75302-15e5-486b-b3e8-2dc2c743f5cb (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:52:38,661 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 22ba9fcf-eba6-4a50-b585-57b386b2459f, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = f408a14b-ff2a-4383-8394-331eed713958, newImageDescription = ), log id: 11dbabf >2014-04-09 14:52:38,662 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 14:52:38,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=22ba9fcf-eba6-4a50-b585-57b386b2459f > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=f408a14b-ff2a-4383-8394-331eed713958 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 14:52:38,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-50) [aedbd31] FINISH, CreateImageVDSCommand, return: f408a14b-ff2a-4383-8394-331eed713958, log id: 11dbabf >2014-04-09 14:52:38,731 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [aedbd31] CommandMultiAsyncTasks::AttachTask: Attaching task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59 to command d57ac19e-cd64-4377-9a53-588b9d702d2c. >2014-04-09 14:52:38,736 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [aedbd31] Adding task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:52:38,748 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-50) [aedbd31] START, UpdateVmDynamicDataVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@b5e7745e), log id: 4b2b074c >2014-04-09 14:52:38,753 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-50) [aedbd31] FINISH, UpdateVmDynamicDataVDSCommand, log id: 4b2b074c >2014-04-09 14:52:38,770 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [aedbd31] Correlation ID: aedbd31, Job ID: a289c145-b272-4435-ab34-0102e9e94de0, Call Stack: null, Custom Event ID: -1, Message: Suspending VM dc-vm-2 was initiated by User admin@internal (Host: DC-85.218). >2014-04-09 14:52:38,771 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [aedbd31] BaseAsyncTask::StartPollingTask: Starting to poll task bba75302-15e5-486b-b3e8-2dc2c743f5cb. >2014-04-09 14:52:38,771 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [aedbd31] BaseAsyncTask::StartPollingTask: Starting to poll task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59. >2014-04-09 14:52:38,771 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-50) [aedbd31] Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 14:52:45,354 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-31) [68dc1a40] VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from PreparingForHibernate --> Up >2014-04-09 14:52:48,219 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-29) Polling and updating Async Tasks: 5 tasks, 5 tasks to poll now >2014-04-09 14:52:48,235 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-29) SPMAsyncTask::PollTask: Polling task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:52:48,252 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-29) BaseAsyncTask::OnTaskEndSuccess: Task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:48,252 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-29) Task with DB Task ID 7f74e0bb-466d-41e9-acf0-fea76ebd0cd0 and VDSM Task ID bba75302-15e5-486b-b3e8-2dc2c743f5cb is in state Polling. End action for command d57ac19e-cd64-4377-9a53-588b9d702d2c will proceed when all the entitys tasks are completed. >2014-04-09 14:52:48,253 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-29) SPMAsyncTask::PollTask: Polling task bba75302-15e5-486b-b3e8-2dc2c743f5cb (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:52:48,260 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-29) BaseAsyncTask::OnTaskEndSuccess: Task bba75302-15e5-486b-b3e8-2dc2c743f5cb (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:48,261 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-29) CommandAsyncTask::EndActionIfNecessary: All tasks of command d57ac19e-cd64-4377-9a53-588b9d702d2c has ended -> executing EndAction >2014-04-09 14:52:48,261 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-29) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: d57ac19e-cd64-4377-9a53-588b9d702d2c): calling EndAction . >2014-04-09 14:52:48,261 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction Unknown, executionIndex: 0 >2014-04-09 14:52:48,269 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-29) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:48,271 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-29) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:48,277 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.HibernateVmCommand >2014-04-09 14:52:48,280 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-48) START, HibernateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, hibernationVolHandle=e5613c67-ce49-4a35-b8f2-2df469d0fc78,0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f,c708bed2-82a7-41f6-bd4a-929e275dd761,ffb5f117-e2ff-46e6-8112-28e4abfa0626,22ba9fcf-eba6-4a50-b585-57b386b2459f,f408a14b-ff2a-4383-8394-331eed713958), log id: 14ac007 >2014-04-09 14:52:48,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-48) START, HibernateBrokerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, hibernationVolHandle=e5613c67-ce49-4a35-b8f2-2df469d0fc78,0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f,c708bed2-82a7-41f6-bd4a-929e275dd761,ffb5f117-e2ff-46e6-8112-28e4abfa0626,22ba9fcf-eba6-4a50-b585-57b386b2459f,f408a14b-ff2a-4383-8394-331eed713958), log id: 12ce87fc >2014-04-09 14:52:48,285 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-29) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:48,286 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-29) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:48,286 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-29) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:52:48,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-48) FINISH, HibernateBrokerVDSCommand, log id: 12ce87fc >2014-04-09 14:52:48,302 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-48) FINISH, HibernateVDSCommand, log id: 14ac007 >2014-04-09 14:52:48,303 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm completed, handling the result. >2014-04-09 14:52:48,304 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm succeeded, clearing tasks. >2014-04-09 14:52:48,311 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59 >2014-04-09 14:52:48,311 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59), log id: 571fa913 >2014-04-09 14:52:48,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59), log id: 5f954b14 >2014-04-09 14:52:48,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 5f954b14 >2014-04-09 14:52:48,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 571fa913 >2014-04-09 14:52:48,327 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task ab23c4e5-3f7b-4d5d-8a8f-58a470b9ca59 from DataBase >2014-04-09 14:52:48,327 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bba75302-15e5-486b-b3e8-2dc2c743f5cb >2014-04-09 14:52:48,328 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = bba75302-15e5-486b-b3e8-2dc2c743f5cb), log id: 697f96e4 >2014-04-09 14:52:48,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=bba75302-15e5-486b-b3e8-2dc2c743f5cb), log id: 378b88d8 >2014-04-09 14:52:48,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 378b88d8 >2014-04-09 14:52:48,342 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 697f96e4 >2014-04-09 14:52:48,352 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task bba75302-15e5-486b-b3e8-2dc2c743f5cb from DataBase >2014-04-09 14:52:48,353 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity d57ac19e-cd64-4377-9a53-588b9d702d2c >2014-04-09 14:52:58,309 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:58,310 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-68) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:52:58,318 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:52:58,318 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-68) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:08,341 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-66) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:08,342 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-66) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:08,350 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-66) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:08,350 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-66) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:12,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-85) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=0, gracefully=false), log id: 1ac0bef1 >2014-04-09 14:53:13,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, DestroyVDSCommand, log id: 1ac0bef1 >2014-04-09 14:53:13,741 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-85) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 on Host DC-85.218 is suspended. >2014-04-09 14:53:13,742 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-85) vm dc-vm-2 running in db and not running in vds - add to rerun treatment. vds DC-85.218 >2014-04-09 14:53:18,399 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-86) [127d87cf] BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:18,399 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-86) [127d87cf] Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:18,407 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-86) [127d87cf] BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:18,407 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-86) [127d87cf] Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:28,480 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-52) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:28,481 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-52) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:28,489 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-52) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:28,489 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-52) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:38,512 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-59) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:38,513 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-59) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:38,521 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-59) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:38,521 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-59) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:42,706 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-13) [13c49c2] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 14:53:42,720 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-13) [13c49c2] START, IsVmDuringInitiatingVDSCommand( vmId = 70cb0dc5-8f43-499d-957d-124aebd3fd35), log id: 53208bf5 >2014-04-09 14:53:42,720 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-13) [13c49c2] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 53208bf5 >2014-04-09 14:53:42,795 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [13c49c2] Running command: RunVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:53:42,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [13c49c2] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 4daf66cd >2014-04-09 14:53:42,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [13c49c2] FINISH, IsoPrefixVDSCommand, return: , log id: 4daf66cd >2014-04-09 14:53:42,870 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [13c49c2] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, vm=VM [dc-vm-2]), log id: 4c2d5ff0 >2014-04-09 14:53:42,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [13c49c2] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, vm=VM [dc-vm-2]), log id: 77be47d6 >2014-04-09 14:53:44,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [13c49c2] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-2,hiberVolHandle=e5613c67-ce49-4a35-b8f2-2df469d0fc78,0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f,c708bed2-82a7-41f6-bd4a-929e275dd761,ffb5f117-e2ff-46e6-8112-28e4abfa0626,22ba9fcf-eba6-4a50-b585-57b386b2459f,f408a14b-ff2a-4383-8394-331eed713958,transparentHugePages=true,vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35,devices=[Ljava.util.HashMap;@7e42aff5,acpiEnable=true,vmName=dc-vm-2,cpuType=Conroe,custom={device_74f5afba-11ac-4ace-8a41-1a3b1910ebd6device_04cab49d-ae1a-4898-ac2d-9b8040a05505device_9dccd342-826c-4f47-b6d0-5c39a294173cdevice_7a4242c7-5c88-4742-a976-1767f39fa334device_a9fbc26c-1666-493d-b88e-765101a84cef=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=a9fbc26c-1666-493d-b88e-765101a84cef, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_74f5afba-11ac-4ace-8a41-1a3b1910ebd6device_04cab49d-ae1a-4898-ac2d-9b8040a05505device_9dccd342-826c-4f47-b6d0-5c39a294173c=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=9dccd342-826c-4f47-b6d0-5c39a294173c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_74f5afba-11ac-4ace-8a41-1a3b1910ebd6device_04cab49d-ae1a-4898-ac2d-9b8040a05505device_9dccd342-826c-4f47-b6d0-5c39a294173cdevice_7a4242c7-5c88-4742-a976-1767f39fa334=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=7a4242c7-5c88-4742-a976-1767f39fa334, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_74f5afba-11ac-4ace-8a41-1a3b1910ebd6=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=74f5afba-11ac-4ace-8a41-1a3b1910ebd6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_74f5afba-11ac-4ace-8a41-1a3b1910ebd6device_04cab49d-ae1a-4898-ac2d-9b8040a05505=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=04cab49d-ae1a-4898-ac2d-9b8040a05505, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}} >2014-04-09 14:53:44,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [13c49c2] FINISH, CreateVDSCommand, log id: 77be47d6 >2014-04-09 14:53:44,662 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [13c49c2] FINISH, CreateVmVDSCommand, return: RestoringState, log id: 4c2d5ff0 >2014-04-09 14:53:44,662 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [13c49c2] Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 14:53:44,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [13c49c2] Correlation ID: 13c49c2, Job ID: 5c29aa44-7aaf-47f7-b723-d34699dfc199, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 was started by admin@internal (Host: DC-85.218). >2014-04-09 14:53:47,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-89) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 2cda2c1a >2014-04-09 14:53:47,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-89) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@278575f7, log id: 2cda2c1a >2014-04-09 14:53:48,546 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-39) [1e736b86] BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:48,547 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-39) [1e736b86] Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:48,555 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-39) [1e736b86] BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:48,555 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-39) [1e736b86] Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:56,972 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from RestoringState --> Up >2014-04-09 14:53:56,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-62) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 43725300 >2014-04-09 14:53:56,988 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-62) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@6a74798, log id: 43725300 >2014-04-09 14:53:57,054 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-62) Correlation ID: 13c49c2, Job ID: 5c29aa44-7aaf-47f7-b723-d34699dfc199, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 started on Host DC-85.218 >2014-04-09 14:53:57,063 INFO [org.ovirt.engine.core.bll.RemoveVmHibernationVolumesCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] Running command: RemoveVmHibernationVolumesCommand internal: true. >2014-04-09 14:53:57,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = c708bed2-82a7-41f6-bd4a-929e275dd761, postZeros = false, forceDelete = false), log id: 4c5e38f6 >2014-04-09 14:53:58,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] FINISH, DeleteImageGroupVDSCommand, log id: 4c5e38f6 >2014-04-09 14:53:58,216 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-62) [4f32795c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 283a7835-496b-480d-a6ab-fb1ae62e8537 >2014-04-09 14:53:58,217 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) [4f32795c] CommandMultiAsyncTasks::AttachTask: Attaching task 938b2c10-e623-4d4c-b558-e8db8eca3f2e to command 283a7835-496b-480d-a6ab-fb1ae62e8537. >2014-04-09 14:53:58,229 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) [4f32795c] Adding task 938b2c10-e623-4d4c-b558-e8db8eca3f2e (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:53:58,246 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 22ba9fcf-eba6-4a50-b585-57b386b2459f, postZeros = false, forceDelete = false), log id: fec64b2 >2014-04-09 14:53:58,556 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-13) Polling and updating Async Tasks: 6 tasks, 3 tasks to poll now >2014-04-09 14:53:59,544 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] FINISH, DeleteImageGroupVDSCommand, log id: fec64b2 >2014-04-09 14:53:59,571 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) [4f32795c] CommandMultiAsyncTasks::AttachTask: Attaching task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f to command 283a7835-496b-480d-a6ab-fb1ae62e8537. >2014-04-09 14:53:59,587 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-13) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:59,587 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-13) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:59,595 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-13) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:53:59,595 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-13) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:53:59,596 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-13) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:53:59,596 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) [4f32795c] Adding task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 14:53:59,604 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) [4f32795c] BaseAsyncTask::StartPollingTask: Starting to poll task 938b2c10-e623-4d4c-b558-e8db8eca3f2e. >2014-04-09 14:53:59,604 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) [4f32795c] BaseAsyncTask::StartPollingTask: Starting to poll task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f. >2014-04-09 14:53:59,606 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] START, UpdateVmDynamicDataVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@6d0d670d), log id: 4156e947 >2014-04-09 14:53:59,612 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-62) [4f32795c] FINISH, UpdateVmDynamicDataVDSCommand, log id: 4156e947 >2014-04-09 14:54:05,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-77) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 12ec25e8 >2014-04-09 14:54:05,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-77) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4dacac0c, log id: 12ec25e8 >2014-04-09 14:54:09,597 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) Polling and updating Async Tasks: 7 tasks, 5 tasks to poll now >2014-04-09 14:54:09,661 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:09,661 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-22) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:09,669 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:09,669 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-22) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:09,670 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task 938b2c10-e623-4d4c-b558-e8db8eca3f2e (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:54:09,677 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::OnTaskEndSuccess: Task 938b2c10-e623-4d4c-b558-e8db8eca3f2e (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:09,678 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-22) Task with DB Task ID cb2fc9ba-cfba-4e66-b4c3-daa61c9ad460 and VDSM Task ID 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f is in state Polling. End action for command 283a7835-496b-480d-a6ab-fb1ae62e8537 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:09,678 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:54:09,694 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::OnTaskEndSuccess: Task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f (Parent Command RunVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:09,694 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::EndActionIfNecessary: All tasks of command 283a7835-496b-480d-a6ab-fb1ae62e8537 has ended -> executing EndAction >2014-04-09 14:54:09,695 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: 283a7835-496b-480d-a6ab-fb1ae62e8537): calling EndAction . >2014-04-09 14:54:09,695 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:54:09,695 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RunVm, executionIndex: 0 >2014-04-09 14:54:09,752 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RunVmCommand >2014-04-09 14:54:09,753 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RunVm completed, handling the result. >2014-04-09 14:54:09,753 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RunVm succeeded, clearing tasks. >2014-04-09 14:54:09,761 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f >2014-04-09 14:54:09,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f), log id: 6b38e44d >2014-04-09 14:54:09,762 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f), log id: 6414b239 >2014-04-09 14:54:09,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 6414b239 >2014-04-09 14:54:09,772 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 6b38e44d >2014-04-09 14:54:09,777 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 3da7cd0d-90c2-45ad-bf55-4b7e8c37c51f from DataBase >2014-04-09 14:54:09,777 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 938b2c10-e623-4d4c-b558-e8db8eca3f2e >2014-04-09 14:54:09,778 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 938b2c10-e623-4d4c-b558-e8db8eca3f2e), log id: 5dbad223 >2014-04-09 14:54:09,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=938b2c10-e623-4d4c-b558-e8db8eca3f2e), log id: 7611fab7 >2014-04-09 14:54:09,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 7611fab7 >2014-04-09 14:54:09,791 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 5dbad223 >2014-04-09 14:54:09,802 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 938b2c10-e623-4d4c-b558-e8db8eca3f2e from DataBase >2014-04-09 14:54:09,803 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 283a7835-496b-480d-a6ab-fb1ae62e8537 >2014-04-09 14:54:11,976 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) Setting new tasks map. The map contains now 5 tasks >2014-04-09 14:54:19,696 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Polling and updating Async Tasks: 5 tasks, 3 tasks to poll now >2014-04-09 14:54:19,815 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:19,815 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:19,835 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:19,835 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:19,835 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Finished polling Tasks, will poll again in 10 seconds. >2014-04-09 14:54:29,914 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:29,914 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-80) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:29,933 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-80) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:29,933 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-80) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:40,005 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-94) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:40,005 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-94) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:40,024 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-94) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:40,024 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-94) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:50,072 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-90) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:50,072 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-90) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:54:50,080 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-90) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:54:50,081 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-90) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:55:00,113 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-18) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:55:00,113 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-18) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:55:00,121 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-18) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:55:00,121 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-18) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:55:10,161 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-24) BaseAsyncTask::OnTaskEndSuccess: Task 71e1d25d-1452-43f5-b09e-78024900a77d (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:55:10,162 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-24) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:55:10,170 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-24) BaseAsyncTask::OnTaskEndSuccess: Task 70908c80-d760-42bf-8896-035a3d80fad9 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:55:10,170 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-24) Task with DB Task ID d674be2b-f438-4679-8c22-c1272a561458 and VDSM Task ID d3c2d81b-86f5-466c-bc84-32ea17260162 is in state Polling. End action for command 5ce3a805-3855-4b25-8018-45eee22d8033 will proceed when all the entitys tasks are completed. >2014-04-09 14:55:10,170 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-24) SPMAsyncTask::PollTask: Polling task d3c2d81b-86f5-466c-bc84-32ea17260162 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 14:55:10,178 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-24) BaseAsyncTask::OnTaskEndSuccess: Task d3c2d81b-86f5-466c-bc84-32ea17260162 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 14:55:10,178 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-24) CommandAsyncTask::EndActionIfNecessary: All tasks of command 5ce3a805-3855-4b25-8018-45eee22d8033 has ended -> executing EndAction >2014-04-09 14:55:10,178 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-24) CommandAsyncTask::EndAction: Ending action for 3 tasks (command ID: 5ce3a805-3855-4b25-8018-45eee22d8033): calling EndAction . >2014-04-09 14:55:10,179 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveSnapshot, executionIndex: 0 >2014-04-09 14:55:10,195 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (pool-4-thread-48) [1bd19] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotCommand >2014-04-09 14:55:10,219 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (pool-4-thread-48) [1a953136] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand >2014-04-09 14:55:10,229 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [1a953136] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, imageId = 67516081-3b96-4d92-90be-c5eeb4c6ba88), log id: 279f881f >2014-04-09 14:55:10,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [1a953136] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fb80ba4b, log id: 279f881f >2014-04-09 14:55:10,595 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 1bd19, Job ID: 6a96454a-b204-4836-894a-5b0693638ce6, Call Stack: null, Custom Event ID: -1, Message: Snapshot 's1' deletion for VM 'vm_vnc' has been completed. >2014-04-09 14:55:10,595 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot completed, handling the result. >2014-04-09 14:55:10,595 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot succeeded, clearing tasks. >2014-04-09 14:55:10,603 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 71e1d25d-1452-43f5-b09e-78024900a77d >2014-04-09 14:55:10,603 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 71e1d25d-1452-43f5-b09e-78024900a77d), log id: 59a64cfc >2014-04-09 14:55:10,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=71e1d25d-1452-43f5-b09e-78024900a77d), log id: 3508625f >2014-04-09 14:55:10,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 3508625f >2014-04-09 14:55:10,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 59a64cfc >2014-04-09 14:55:10,628 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 71e1d25d-1452-43f5-b09e-78024900a77d from DataBase >2014-04-09 14:55:10,628 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d3c2d81b-86f5-466c-bc84-32ea17260162 >2014-04-09 14:55:10,629 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = d3c2d81b-86f5-466c-bc84-32ea17260162), log id: dfd6447 >2014-04-09 14:55:10,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=d3c2d81b-86f5-466c-bc84-32ea17260162), log id: 76c2787d >2014-04-09 14:55:10,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 76c2787d >2014-04-09 14:55:10,644 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: dfd6447 >2014-04-09 14:55:10,653 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task d3c2d81b-86f5-466c-bc84-32ea17260162 from DataBase >2014-04-09 14:55:10,653 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 70908c80-d760-42bf-8896-035a3d80fad9 >2014-04-09 14:55:10,653 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 70908c80-d760-42bf-8896-035a3d80fad9), log id: 60f2453e >2014-04-09 14:55:10,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=70908c80-d760-42bf-8896-035a3d80fad9), log id: 41a01b2b >2014-04-09 14:55:10,666 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 41a01b2b >2014-04-09 14:55:10,666 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 60f2453e >2014-04-09 14:55:10,670 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 70908c80-d760-42bf-8896-035a3d80fad9 from DataBase >2014-04-09 14:55:10,670 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 5ce3a805-3855-4b25-8018-45eee22d8033 >2014-04-09 14:55:11,977 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-78) Setting new tasks map. The map contains now 3 tasks >2014-04-09 14:55:15,358 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [13004ec] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 14:55:15,366 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [13004ec] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, ticket=2O0NUeGZL14P, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 523b40f3 >2014-04-09 14:55:15,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [13004ec] FINISH, SetVmTicketVDSCommand, log id: 523b40f3 >2014-04-09 14:55:15,461 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [13004ec] Correlation ID: 13004ec, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-2 >2014-04-09 14:55:41,307 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-92) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 14:56:11,977 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-85) Setting new tasks map. The map contains now 0 tasks >2014-04-09 14:56:11,978 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-85) Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 14:56:24,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetDeviceListVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storageType=ISCSI), log id: 5f8faa33 >2014-04-09 14:56:24,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetDeviceListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageType=ISCSI), log id: 542bfcb9 >2014-04-09 14:56:33,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@24548aff, org.ovirt.engine.core.common.businessentities.LUNs@b60dd719], log id: 542bfcb9 >2014-04-09 14:56:36,669 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetDeviceListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.LUNs@f74b4123, org.ovirt.engine.core.common.businessentities.LUNs@8f6fd83e, org.ovirt.engine.core.common.businessentities.LUNs@21292458], log id: 5f8faa33 >2014-04-09 14:57:54,294 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [6375486e] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.85.218:/NFS value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 14:57:54,316 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [6375486e] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 14:57:54,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [6375486e] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 61aa4e05 >2014-04-09 15:00:03,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [6375486e] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=477}, log id: 61aa4e05 >2014-04-09 15:00:03,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [6375486e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection 10.66.85.218:/NFS returned by VDSM was: Problem while trying to mount target >2014-04-09 15:00:03,667 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (ajp-/127.0.0.1:8702-6) [6375486e] The connection with details 10.66.85.218:/NFS failed because of error code 477 and error message is: problem while trying to mount target >2014-04-09 15:00:03,671 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [6375486e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand. >2014-04-09 15:00:03,704 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [6375486e] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.85.218:/NFS value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 15:00:20,871 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [62c96c2d] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.66.85.218:/NFS value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 15:00:20,893 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [62c96c2d] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:00:20,895 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-10) [62c96c2d] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3934507e >2014-04-09 15:00:21,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-10) [62c96c2d] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 3934507e >2014-04-09 15:00:21,168 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-10) [62c96c2d] Lock freed to object EngineLock [exclusiveLocks= key: 10.66.85.218:/NFS value: STORAGE_CONNECTION >, sharedLocks= ] >2014-04-09 15:00:21,235 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:00:21,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 329ab562 >2014-04-09 15:00:21,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] FINISH, ConnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 329ab562 >2014-04-09 15:00:21,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] START, CreateStorageDomainVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@68fbf459, args=10.66.85.218:/NFS), log id: 49a214ca >2014-04-09 15:00:26,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] FINISH, CreateStorageDomainVDSCommand, log id: 49a214ca >2014-04-09 15:00:26,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] START, GetStorageDomainStatsVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storageDomainId=7a3c7740-81a1-4969-ad72-791dd92cbcb3), log id: 70802528 >2014-04-09 15:00:26,449 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-3) [2deb2aff] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@cc2ea327, log id: 70802528 >2014-04-09 15:00:26,484 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [2deb2aff] Correlation ID: 2deb2aff, Job ID: f069e6bb-9bd9-4a07-ab1e-0e0eb7b25a60, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISO was added by admin@internal >2014-04-09 15:00:26,551 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [4ef5c2c4] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:00:26,553 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [4ef5c2c4] START, DisconnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 20c5c754 >2014-04-09 15:00:34,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [4ef5c2c4] FINISH, DisconnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 20c5c754 >2014-04-09 15:00:34,309 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-5) [154870fa] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 Type: Storage >2014-04-09 15:00:34,337 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-48) [3a52d4b5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:00:34,337 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-35) [53253852] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:00:34,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [3a52d4b5] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5265c4a9 >2014-04-09 15:00:34,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [53253852] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b76cf83 >2014-04-09 15:00:34,417 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [3a52d4b5] FINISH, ConnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 5265c4a9 >2014-04-09 15:00:34,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-35) [53253852] FINISH, ConnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 6b76cf83 >2014-04-09 15:00:34,590 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [154870fa] START, AttachStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7a3c7740-81a1-4969-ad72-791dd92cbcb3), log id: 24eb44d6 >2014-04-09 15:01:05,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [154870fa] FINISH, AttachStorageDomainVDSCommand, log id: 24eb44d6 >2014-04-09 15:01:05,815 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] Lock Acquired to object EngineLock [exclusiveLocks= key: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 value: STORAGE >, sharedLocks= ] >2014-04-09 15:01:05,865 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 Type: Storage >2014-04-09 15:01:05,880 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] Lock freed to object EngineLock [exclusiveLocks= key: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 value: STORAGE >, sharedLocks= ] >2014-04-09 15:01:05,880 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/9/14 3:01 PM >2014-04-09 15:01:05,887 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-48) [120a0eae] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:01:05,887 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-47) [4232c0b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:01:05,892 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [120a0eae] START, ConnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: bed128 >2014-04-09 15:01:05,892 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [4232c0b6] START, ConnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f959979 >2014-04-09 15:01:05,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-47) [4232c0b6] FINISH, ConnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 6f959979 >2014-04-09 15:01:05,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [120a0eae] FINISH, ConnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: bed128 >2014-04-09 15:01:05,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] START, ActivateStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7a3c7740-81a1-4969-ad72-791dd92cbcb3), log id: 6c7dca4f >2014-04-09 15:01:16,552 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] FINISH, ActivateStorageDomainVDSCommand, log id: 6c7dca4f >2014-04-09 15:01:16,552 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] ActivateStorage Domain. After Connect all hosts to pool. Time:4/9/14 3:01 PM >2014-04-09 15:01:16,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-48) [39a9a393] START, RefreshStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 3306dbc2 >2014-04-09 15:01:16,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [39a9a393] START, RefreshStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 1cfe6df4 >2014-04-09 15:01:16,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [39a9a393] FINISH, RefreshStoragePoolVDSCommand, log id: 1cfe6df4 >2014-04-09 15:01:16,619 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-47) [39a9a393] Refreshed vds DC-85.215 in pool dc_iscsi >2014-04-09 15:01:29,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-48) [39a9a393] FINISH, RefreshStoragePoolVDSCommand, log id: 3306dbc2 >2014-04-09 15:01:29,231 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-48) [39a9a393] Refreshed vds DC-85.218 in pool dc_iscsi >2014-04-09 15:01:29,243 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-5) [39a9a393] ActivateStorage Domain. After change storage pool status in vds. Time:4/9/14 3:01 PM >2014-04-09 15:01:29,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) [39a9a393] START, GetIsoListVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false), log id: 42a26d5e >2014-04-09 15:01:29,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) [39a9a393] START, HsmGetIsoListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 35ba587f >2014-04-09 15:01:29,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [39a9a393] Correlation ID: 39a9a393, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISO (Data Center dc_iscsi) was activated by admin@internal >2014-04-09 15:01:29,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-4-thread-48) [39a9a393] FINISH, HsmGetIsoListVDSCommand, return: [], log id: 35ba587f >2014-04-09 15:01:29,263 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-4-thread-48) [39a9a393] FINISH, GetIsoListVDSCommand, return: [], log id: 42a26d5e >2014-04-09 15:01:29,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-4-thread-48) [39a9a393] START, GetFloppyListVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false), log id: 2ba64968 >2014-04-09 15:01:29,277 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [39a9a393] Correlation ID: 154870fa, Job ID: 8a6340b4-d043-48e7-8e4f-2f413e035959, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISO was attached to Data Center dc_iscsi by admin@internal >2014-04-09 15:01:29,283 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-4-thread-48) [39a9a393] FINISH, GetFloppyListVDSCommand, return: [], log id: 2ba64968 >2014-04-09 15:06:50,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.218 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 15:07:05,712 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetIsoListVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false), log id: 220bf55b >2014-04-09 15:07:05,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (ajp-/127.0.0.1:8702-13) START, HsmGetIsoListVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 11651302 >2014-04-09 15:07:05,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, HsmGetIsoListVDSCommand, return: [en_windows_xp_professional_with_service_pack_3_x86_cd_x14-80428.iso], log id: 11651302 >2014-04-09 15:07:05,734 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetIsoListVDSCommand, return: [en_windows_xp_professional_with_service_pack_3_x86_cd_x14-80428.iso], log id: 220bf55b >2014-04-09 15:07:05,742 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetFloppyListVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false), log id: 62243c92 >2014-04-09 15:07:05,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetFloppyListVDSCommand, return: [], log id: 62243c92 >2014-04-09 15:07:05,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): dc_ISO (All file type) >2014-04-09 15:07:18,691 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.215 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 15:07:31,024 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-10) [2fe8894d] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:07:31,031 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-10) [2fe8894d] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, ticket=LrGX6EV7wzas, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 56af7355 >2014-04-09 15:07:31,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-10) [2fe8894d] FINISH, SetVmTicketVDSCommand, log id: 56af7355 >2014-04-09 15:07:31,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [2fe8894d] Correlation ID: 2fe8894d, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-2 >2014-04-09 15:08:05,244 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-47) [d95ac58] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:08:05,247 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-47) [d95ac58] Entered (VM dc-vm-2). >2014-04-09 15:08:05,247 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-47) [d95ac58] Sending shutdown command for VM dc-vm-2. >2014-04-09 15:08:05,250 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-47) [d95ac58] START, DestroyVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=30, gracefully=true), log id: 513d3da8 >2014-04-09 15:08:05,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-47) [d95ac58] START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=30, gracefully=true), log id: 47f1340c >2014-04-09 15:08:05,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-47) [d95ac58] FINISH, DestroyVDSCommand, log id: 47f1340c >2014-04-09 15:08:05,277 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-47) [d95ac58] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 513d3da8 >2014-04-09 15:08:05,294 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [d95ac58] Correlation ID: d95ac58, Job ID: f78fecd8-d117-4567-a742-0661c557ce4f, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin@internal on VM dc-vm-2 (Host: DC-85.218). >2014-04-09 15:08:08,144 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-2) [5feffdba] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:08:08,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-2) [5feffdba] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, ticket=mYDAcnYoMJjX, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 585a03ca >2014-04-09 15:08:08,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-2) [5feffdba] FINISH, SetVmTicketVDSCommand, log id: 585a03ca >2014-04-09 15:08:08,243 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [5feffdba] Correlation ID: 5feffdba, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-2 >2014-04-09 15:08:25,756 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-16) Failed in GetVmStatsVDS method >2014-04-09 15:08:25,757 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-16) Error code noVM and error message VDSGenericException: VDSErrorException: Failed to GetVmStatsVDS, error = Virtual machine does not exist >2014-04-09 15:08:25,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-16) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VMInfoListReturnForXmlRpc@5ac281a1 >2014-04-09 15:08:25,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-16) HostName = DC-85.218 >2014-04-09 15:08:25,757 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-16) Command GetVmStatsVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmStatsVDS, error = Virtual machine does not exist >2014-04-09 15:08:25,760 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-16) vm dc-vm-2 running in db and not running in vds - add to rerun treatment. vds DC-85.218 >2014-04-09 15:08:28,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-67) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=0, gracefully=false), log id: 7e48efbe >2014-04-09 15:08:28,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, DestroyVDSCommand, log id: 7e48efbe >2014-04-09 15:09:08,008 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-15) [d687dd5] Lock Acquired to object EngineLock [exclusiveLocks= key: dc-vm-2 value: VM_NAME >, sharedLocks= ] >2014-04-09 15:09:08,027 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-15) [d687dd5] Running command: UpdateVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:09:08,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [d687dd5] Correlation ID: d687dd5, Job ID: dae36e89-a893-4a5c-9612-9a535b8d887e, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 configuration was updated by admin@internal. >2014-04-09 15:09:08,102 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-15) [d687dd5] Lock freed to object EngineLock [exclusiveLocks= key: dc-vm-2 value: VM_NAME >, sharedLocks= ] >2014-04-09 15:09:08,262 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-1) MultipleActionsRunner of type AddVmInterface invoked with no actions >2014-04-09 15:09:08,270 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-6) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 15:09:08,278 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-2) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 15:09:20,735 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [82579e4] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 15:09:20,810 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [82579e4] START, IsVmDuringInitiatingVDSCommand( vmId = 70cb0dc5-8f43-499d-957d-124aebd3fd35), log id: 7fa55fc2 >2014-04-09 15:09:20,810 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [82579e4] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7fa55fc2 >2014-04-09 15:09:20,901 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [82579e4] Running command: RunVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:09:20,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [82579e4] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 236b94f4 >2014-04-09 15:09:20,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [82579e4] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/10.66.85.218:_NFS/7a3c7740-81a1-4969-ad72-791dd92cbcb3/images/11111111-1111-1111-1111-111111111111, log id: 236b94f4 >2014-04-09 15:09:20,969 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [82579e4] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, vm=VM [dc-vm-2]), log id: 31617616 >2014-04-09 15:09:20,974 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [82579e4] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, vm=VM [dc-vm-2]), log id: 6e68beee >2014-04-09 15:09:21,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [82579e4] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-2,transparentHugePages=true,vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35,devices=[Ljava.util.HashMap;@46a91a32,acpiEnable=true,vmName=dc-vm-2,cpuType=Conroe,custom={device_1f709017-a450-4dcc-8980-5a0599b881e6device_5b02d666-5a9e-4b73-a6f0-2799c1d79ec3device_72888609-aa50-4965-9adf-7f9c6b9777cf=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=72888609-aa50-4965-9adf-7f9c6b9777cf, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1f709017-a450-4dcc-8980-5a0599b881e6device_5b02d666-5a9e-4b73-a6f0-2799c1d79ec3device_72888609-aa50-4965-9adf-7f9c6b9777cfdevice_a61d048f-2c4a-433d-87cd-b269ad6981b9device_e6b919af-7338-4295-8e3c-293abcdff0b5=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=e6b919af-7338-4295-8e3c-293abcdff0b5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_1f709017-a450-4dcc-8980-5a0599b881e6device_5b02d666-5a9e-4b73-a6f0-2799c1d79ec3=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=5b02d666-5a9e-4b73-a6f0-2799c1d79ec3, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1f709017-a450-4dcc-8980-5a0599b881e6device_5b02d666-5a9e-4b73-a6f0-2799c1d79ec3device_72888609-aa50-4965-9adf-7f9c6b9777cfdevice_a61d048f-2c4a-433d-87cd-b269ad6981b9=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=a61d048f-2c4a-433d-87cd-b269ad6981b9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1f709017-a450-4dcc-8980-5a0599b881e6=VmDevice {vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, deviceId=1f709017-a450-4dcc-8980-5a0599b881e6, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}} >2014-04-09 15:09:21,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [82579e4] FINISH, CreateVDSCommand, log id: 6e68beee >2014-04-09 15:09:21,084 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [82579e4] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 31617616 >2014-04-09 15:09:21,084 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [82579e4] Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 15:09:21,092 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [82579e4] Correlation ID: 82579e4, Job ID: 421232b9-8967-4e3e-af27-179f523390da, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 was started by admin@internal (Host: DC-85.218). >2014-04-09 15:09:23,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-80) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 1309a17c >2014-04-09 15:09:23,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-80) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@5d48dda7, log id: 1309a17c >2014-04-09 15:09:26,819 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-27) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from WaitForLaunch --> PoweringUp >2014-04-09 15:09:29,208 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-1) [75b1607a] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:09:29,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [75b1607a] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, ticket=mnng1lYO2PiL, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 4ed95ae2 >2014-04-09 15:09:29,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [75b1607a] FINISH, SetVmTicketVDSCommand, log id: 4ed95ae2 >2014-04-09 15:09:29,291 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [75b1607a] Correlation ID: 75b1607a, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-2 >2014-04-09 15:09:49,673 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-12) [547257f5] Lock Acquired to object EngineLock [exclusiveLocks= key: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 value: STORAGE >, sharedLocks= ] >2014-04-09 15:09:49,772 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-47) [547257f5] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 Type: Storage >2014-04-09 15:09:49,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (pool-4-thread-47) [547257f5] START, DeactivateStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7a3c7740-81a1-4969-ad72-791dd92cbcb3, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 6d4afdf0 >2014-04-09 15:09:50,425 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (pool-4-thread-47) [547257f5] FINISH, DeactivateStorageDomainVDSCommand, log id: 6d4afdf0 >2014-04-09 15:09:50,426 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-47) [547257f5] Lock freed to object EngineLock [exclusiveLocks= key: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 value: STORAGE >, sharedLocks= ] >2014-04-09 15:09:50,434 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-4-thread-48) [547257f5] After deactivate treatment vds: DC-85.218,pool dc_iscsi >2014-04-09 15:09:50,434 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-4-thread-35) [547257f5] After deactivate treatment vds: DC-85.215,pool dc_iscsi >2014-04-09 15:09:50,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-48) [547257f5] START, RefreshStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 1ebe4c21 >2014-04-09 15:09:50,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-35) [547257f5] START, RefreshStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 714db98d >2014-04-09 15:09:50,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-35) [547257f5] FINISH, RefreshStoragePoolVDSCommand, log id: 714db98d >2014-04-09 15:10:10,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-48) [547257f5] FINISH, RefreshStoragePoolVDSCommand, log id: 1ebe4c21 >2014-04-09 15:10:10,803 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (pool-4-thread-48) [519d2b19] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:10:10,805 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-48) [519d2b19] START, DisconnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 125b7a45 >2014-04-09 15:10:21,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-48) [519d2b19] FINISH, DisconnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 125b7a45 >2014-04-09 15:10:21,410 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (pool-4-thread-47) [60a0c2a7] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-09 15:10:21,412 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-47) [60a0c2a7] START, DisconnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 448fe22d-d864-4c08-b01f-0b8c43b5fd17, connection: 10.66.85.218:/NFS, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17c0e6d0 >2014-04-09 15:10:21,829 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-85) VM dc-vm-2 70cb0dc5-8f43-499d-957d-124aebd3fd35 moved from PoweringUp --> Up >2014-04-09 15:10:21,870 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-85) Correlation ID: 82579e4, Job ID: 421232b9-8967-4e3e-af27-179f523390da, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 started on Host DC-85.218 >2014-04-09 15:10:26,778 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 15:10:29,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-47) [60a0c2a7] FINISH, DisconnectStorageServerVDSCommand, return: {448fe22d-d864-4c08-b01f-0b8c43b5fd17=0}, log id: 17c0e6d0 >2014-04-09 15:10:29,994 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [60a0c2a7] Correlation ID: 547257f5, Job ID: 7ada2add-cd89-4504-ac94-36abe77b8617, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISO (Data Center dc_iscsi) was deactivated by admin@internal >2014-04-09 15:10:37,504 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-6) [a5b2233] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 15:10:37,652 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (pool-4-thread-47) [a5b2233] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:10:37,691 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-47) [a5b2233] START, MigrateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, srcHost=10.66.85.218, dstVdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, dstHost=10.66.85.215:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 7b45e9fe >2014-04-09 15:10:37,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-47) [a5b2233] VdsBroker::migrate::Entered (vm_guid=70cb0dc5-8f43-499d-957d-124aebd3fd35, srcHost=10.66.85.218, dstHost=10.66.85.215:54321, method=online >2014-04-09 15:10:37,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-47) [a5b2233] START, MigrateBrokerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, srcHost=10.66.85.218, dstVdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, dstHost=10.66.85.215:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 35905647 >2014-04-09 15:10:37,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-47) [a5b2233] FINISH, MigrateBrokerVDSCommand, log id: 35905647 >2014-04-09 15:10:37,710 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-47) [a5b2233] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 7b45e9fe >2014-04-09 15:10:37,727 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [a5b2233] Correlation ID: a5b2233, Job ID: da435bbe-12c7-402d-a0dc-041070da5ef9, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: dc-vm-2, Source: DC-85.218, Destination: DC-85.215, User: admin@internal). >2014-04-09 15:10:39,544 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-100) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:10:40,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-36) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 43e54df6 >2014-04-09 15:10:40,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-36) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@361744d, log id: 43e54df6 >2014-04-09 15:10:42,574 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:10:45,606 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:10:48,637 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:10:51,681 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:10:54,761 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:10:57,803 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-82) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:11:00,834 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:11:03,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-19) START, FullListVdsCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215], vmIds=[70cb0dc5-8f43-499d-957d-124aebd3fd35]), log id: 2f833272 >2014-04-09 15:11:03,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-19) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4e64f2bc, log id: 2f833272 >2014-04-09 15:11:03,958 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) Correlation ID: a5b2233, Job ID: da435bbe-12c7-402d-a0dc-041070da5ef9, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dc-vm-2, Source: DC-85.218, Destination: DC-85.215, Duration: 26 sec). >2014-04-09 15:11:03,967 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (DefaultQuartzScheduler_Worker-19) Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 15:11:04,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-64) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=0, gracefully=false), log id: 2e68c82d >2014-04-09 15:11:05,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, DestroyVDSCommand, log id: 2e68c82d >2014-04-09 15:11:05,625 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) RefreshVmList vm id 70cb0dc5-8f43-499d-957d-124aebd3fd35 status = Down on vds DC-85.218 ignoring it in the refresh until migration is done >2014-04-09 15:15:26,818 INFO [org.ovirt.engine.core.bll.HotUnPlugDiskFromVmCommand] (ajp-/127.0.0.1:8702-17) [10752c40] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM_DISK_BOOT >key: 5d1d405b-6c8d-4973-8e80-c11555885cc5 value: DISK >, sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 15:15:26,885 INFO [org.ovirt.engine.core.bll.HotUnPlugDiskFromVmCommand] (pool-4-thread-47) [10752c40] Running command: HotUnPlugDiskFromVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 15:15:26,999 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [10752c40] Correlation ID: 10752c40, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc disk vm_vnc_Disk1 was unplugged by admin@internal. >2014-04-09 15:15:27,000 INFO [org.ovirt.engine.core.bll.HotUnPlugDiskFromVmCommand] (pool-4-thread-47) [10752c40] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM_DISK_BOOT >key: 5d1d405b-6c8d-4973-8e80-c11555885cc5 value: DISK >, sharedLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >] >2014-04-09 15:15:32,109 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-16) [12515cb4] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 15:15:32,209 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-16) [12515cb4] START, IsVmDuringInitiatingVDSCommand( vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc), log id: 3217a7a5 >2014-04-09 15:15:32,209 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-16) [12515cb4] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3217a7a5 >2014-04-09 15:15:32,265 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-47) [12515cb4] Running command: RunVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 15:15:32,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-47) [12515cb4] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 41d7d8f6 >2014-04-09 15:15:32,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-47) [12515cb4] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/10.66.85.218:_NFS/7a3c7740-81a1-4969-ad72-791dd92cbcb3/images/11111111-1111-1111-1111-111111111111, log id: 41d7d8f6 >2014-04-09 15:15:32,335 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-47) [12515cb4] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, vm=VM [vm_vnc]), log id: 13609292 >2014-04-09 15:15:32,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-47) [12515cb4] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, vm=VM [vm_vnc]), log id: 2bfafa90 >2014-04-09 15:15:32,429 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-47) [12515cb4] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=vnc,smartcardEnable=false,tabletEnable=true,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-2,transparentHugePages=true,vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc,devices=[Ljava.util.HashMap;@51283eac,acpiEnable=true,vmName=vm_vnc,cpuType=Conroe,custom={device_0a497927-b374-478b-bf3b-5a0041a201c2=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=0a497927-b374-478b-bf3b-5a0041a201c2, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_0a497927-b374-478b-bf3b-5a0041a201c2device_1fdf84ee-6aef-4cb0-a876-6d887ae0d943device_346c0085-3040-4aa3-ab7b-b61a0f2e8f83=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=346c0085-3040-4aa3-ab7b-b61a0f2e8f83, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_0a497927-b374-478b-bf3b-5a0041a201c2device_1fdf84ee-6aef-4cb0-a876-6d887ae0d943device_346c0085-3040-4aa3-ab7b-b61a0f2e8f83device_3cd33604-97f2-4d32-a078-cb42dd588b1b=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=3cd33604-97f2-4d32-a078-cb42dd588b1b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_0a497927-b374-478b-bf3b-5a0041a201c2device_1fdf84ee-6aef-4cb0-a876-6d887ae0d943=VmDevice {vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, deviceId=1fdf84ee-6aef-4cb0-a876-6d887ae0d943, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-04-09 15:15:32,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-47) [12515cb4] FINISH, CreateVDSCommand, log id: 2bfafa90 >2014-04-09 15:15:32,449 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-47) [12515cb4] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 13609292 >2014-04-09 15:15:32,449 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-47) [12515cb4] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 15:15:32,457 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [12515cb4] Correlation ID: 12515cb4, Job ID: c1b6b47b-7b5a-4046-b142-ec65690bf419, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc was started by admin@internal (Host: DC-85.218). >2014-04-09 15:15:36,519 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from WaitForLaunch --> PoweringUp >2014-04-09 15:15:36,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-73) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc]), log id: b3174c7 >2014-04-09 15:15:36,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-73) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@5be9ba8e, log id: b3174c7 >2014-04-09 15:15:47,978 ERROR [org.ovirt.engine.core.bll.DetachDiskFromVmCommand] (ajp-/127.0.0.1:8702-11) [48bf1f6f] Error during CanDoActionFailure.: java.lang.NullPointerException > at org.ovirt.engine.core.bll.DetachDiskFromVmCommand.canDoAction(DetachDiskFromVmCommand.java:54) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.canDoActionOnly(CommandBase.java:336) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.Execute(MultipleActionsRunner.java:75) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runMultipleActionsImpl(Backend.java:544) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runMultipleActionsImpl(Backend.java:559) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunMultipleActions(Backend.java:516) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunMultipleActions(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunMultipleActions(GenericApiGWTServiceImpl.java:112) > at sun.reflect.GeneratedMethodAccessor155.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-09 15:15:55,775 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [1a4cb243] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 15:15:55,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [1a4cb243] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, ticket=iebNhcEDhTYZ, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7aeba046 >2014-04-09 15:15:55,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [1a4cb243] FINISH, SetVmTicketVDSCommand, log id: 7aeba046 >2014-04-09 15:15:55,871 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [1a4cb243] Correlation ID: 1a4cb243, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_vnc >2014-04-09 15:16:34,567 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) VM vm_vnc 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc moved from PoweringUp --> Up >2014-04-09 15:16:34,583 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-44) Correlation ID: 12515cb4, Job ID: c1b6b47b-7b5a-4046-b142-ec65690bf419, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc started on Host DC-85.218 >2014-04-09 15:18:18,779 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-15) [1e5b41e9] Lock Acquired to object EngineLock [exclusiveLocks= key: vm_dl value: VM_NAME >, sharedLocks= ] >2014-04-09 15:18:18,823 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-15) [1e5b41e9] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 15:18:18,926 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [1e5b41e9] Correlation ID: 1e5b41e9, Job ID: c2a62cc2-260b-4af5-b487-ab75843852ab, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl was created by admin@internal. >2014-04-09 15:18:18,935 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-15) [1e5b41e9] Lock freed to object EngineLock [exclusiveLocks= key: vm_dl value: VM_NAME >, sharedLocks= ] >2014-04-09 15:18:18,987 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-46) [260a969a] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM, ID: 06b6a7c0-599a-4f36-8c3f-d66c7e741d47 Type: VnicProfile >2014-04-09 15:18:18,996 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-10) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 15:18:19,005 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-3) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 15:18:19,045 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-46) [5ed61312] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:18:19,089 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [5ed61312] Correlation ID: 5ed61312, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm_dl. (User: admin@internal) >2014-04-09 15:18:19,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [5ed61312] Correlation ID: 260a969a, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm_dl. (User: admin@internal) >2014-04-09 15:18:23,342 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-1) [761509c1] Lock Acquired to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:18:23,351 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [761509c1] START, IsVmDuringInitiatingVDSCommand( vmId = 14a1d5e6-7bf8-49cd-beef-9509b0f2af82), log id: 4ebf6de >2014-04-09 15:18:23,351 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [761509c1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4ebf6de >2014-04-09 15:18:23,530 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [761509c1] Running command: RunVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:18:23,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [761509c1] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 3acc3378 >2014-04-09 15:18:23,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [761509c1] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/10.66.85.218:_NFS/7a3c7740-81a1-4969-ad72-791dd92cbcb3/images/11111111-1111-1111-1111-111111111111, log id: 3acc3378 >2014-04-09 15:18:23,618 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [761509c1] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, vm=VM [vm_dl]), log id: 6bee35a7 >2014-04-09 15:18:23,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [761509c1] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, vm=VM [vm_dl]), log id: 145a81f2 >2014-04-09 15:18:23,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [761509c1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82,devices=[Ljava.util.HashMap;@751b08d9,acpiEnable=true,vmName=vm_dl,cpuType=Conroe,custom={} >2014-04-09 15:18:23,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [761509c1] FINISH, CreateVDSCommand, log id: 145a81f2 >2014-04-09 15:18:23,697 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [761509c1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 6bee35a7 >2014-04-09 15:18:23,697 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [761509c1] Lock freed to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:18:23,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [761509c1] Correlation ID: 761509c1, Job ID: db7c5e09-91f2-4d87-bdf6-0565c4ee5371, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl was started by admin@internal (Host: DC-85.218). >2014-04-09 15:18:26,561 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-45) VM vm_dl 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 moved from WaitForLaunch --> PoweringUp >2014-04-09 15:18:26,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[14a1d5e6-7bf8-49cd-beef-9509b0f2af82]), log id: 4bd85d4f >2014-04-09 15:18:26,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-45) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@69d6146f, log id: 4bd85d4f >2014-04-09 15:18:34,632 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-14) [68a70724] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:18:34,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [68a70724] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, ticket=3+Yyuz0JKifR, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7168c2d1 >2014-04-09 15:18:34,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [68a70724] FINISH, SetVmTicketVDSCommand, log id: 7168c2d1 >2014-04-09 15:18:34,737 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [68a70724] Correlation ID: 68a70724, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_dl >2014-04-09 15:19:24,832 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-34) VM vm_dl 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 moved from PoweringUp --> Up >2014-04-09 15:19:24,864 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-34) Correlation ID: 761509c1, Job ID: db7c5e09-91f2-4d87-bdf6-0565c4ee5371, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl started on Host DC-85.218 >2014-04-09 15:19:33,555 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (ajp-/127.0.0.1:8702-4) [69f18bbb] Lock Acquired to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:19:33,638 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-46) [69f18bbb] Running command: HibernateVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:19:33,650 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-46) [69f18bbb] START, UpdateVmDynamicDataVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@9c6b15b1), log id: 6745a2ed >2014-04-09 15:19:33,652 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-46) [69f18bbb] FINISH, UpdateVmDynamicDataVDSCommand, log id: 6745a2ed >2014-04-09 15:19:33,665 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 08dea1e9-437c-41c7-a31d-4c4d8fd64b8e, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = b19f5e54-b8a3-4272-8452-9c9a1aacddc5, newImageDescription = ), log id: 7738618 >2014-04-09 15:19:33,665 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 15:19:33,665 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=08dea1e9-437c-41c7-a31d-4c4d8fd64b8e > size=1,350,565,888 bytes > volFormat=RAW > volType=Preallocated > volUUID=b19f5e54-b8a3-4272-8452-9c9a1aacddc5 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 15:19:33,708 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] FINISH, CreateImageVDSCommand, return: b19f5e54-b8a3-4272-8452-9c9a1aacddc5, log id: 7738618 >2014-04-09 15:19:33,723 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) [69f18bbb] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ee052e9a-ae73-42c8-bc60-020227d82a67 >2014-04-09 15:19:33,723 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-46) [69f18bbb] CommandMultiAsyncTasks::AttachTask: Attaching task 84447a01-8e34-41e5-af4c-feda62b4b033 to command ee052e9a-ae73-42c8-bc60-020227d82a67. >2014-04-09 15:19:33,727 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [69f18bbb] Adding task 84447a01-8e34-41e5-af4c-feda62b4b033 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:19:33,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 6ab7f682-b76e-4f5d-b2dc-a0ad5184334f, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 27454ec4-3e63-4c9e-b310-3fd3a16c935e, newImageDescription = ), log id: 203f7ae3 >2014-04-09 15:19:33,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 15:19:33,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] -- createVolume parameters: > sdUUID=e5613c67-ce49-4a35-b8f2-2df469d0fc78 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=6ab7f682-b76e-4f5d-b2dc-a0ad5184334f > size=10,240 bytes > volFormat=COW > volType=Sparse > volUUID=27454ec4-3e63-4c9e-b310-3fd3a16c935e > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 15:19:33,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-4-thread-46) [69f18bbb] FINISH, CreateImageVDSCommand, return: 27454ec4-3e63-4c9e-b310-3fd3a16c935e, log id: 203f7ae3 >2014-04-09 15:19:33,805 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-46) [69f18bbb] CommandMultiAsyncTasks::AttachTask: Attaching task 8ee008f6-31a4-4836-8de0-f7036e870910 to command ee052e9a-ae73-42c8-bc60-020227d82a67. >2014-04-09 15:19:33,813 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [69f18bbb] Adding task 8ee008f6-31a4-4836-8de0-f7036e870910 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:19:33,825 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-46) [69f18bbb] START, UpdateVmDynamicDataVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@e728dfce), log id: 2382e5bd >2014-04-09 15:19:33,830 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (pool-4-thread-46) [69f18bbb] FINISH, UpdateVmDynamicDataVDSCommand, log id: 2382e5bd >2014-04-09 15:19:33,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [69f18bbb] Correlation ID: 69f18bbb, Job ID: 78e99b12-7a3e-4367-8e9e-e33a8d20d91c, Call Stack: null, Custom Event ID: -1, Message: Suspending VM vm_dl was initiated by User admin@internal (Host: DC-85.218). >2014-04-09 15:19:33,847 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) [69f18bbb] BaseAsyncTask::StartPollingTask: Starting to poll task 84447a01-8e34-41e5-af4c-feda62b4b033. >2014-04-09 15:19:33,847 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) [69f18bbb] BaseAsyncTask::StartPollingTask: Starting to poll task 8ee008f6-31a4-4836-8de0-f7036e870910. >2014-04-09 15:19:33,847 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-46) [69f18bbb] Lock freed to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:19:37,010 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) VM vm_dl 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 moved from PreparingForHibernate --> Up >2014-04-09 15:19:40,910 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-37) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-04-09 15:19:40,928 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-37) SPMAsyncTask::PollTask: Polling task 84447a01-8e34-41e5-af4c-feda62b4b033 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:19:40,947 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-37) BaseAsyncTask::OnTaskEndSuccess: Task 84447a01-8e34-41e5-af4c-feda62b4b033 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:19:40,947 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-37) Task with DB Task ID a76b9a0d-c32e-4499-9f66-811d534ac32d and VDSM Task ID 8ee008f6-31a4-4836-8de0-f7036e870910 is in state Polling. End action for command ee052e9a-ae73-42c8-bc60-020227d82a67 will proceed when all the entitys tasks are completed. >2014-04-09 15:19:40,947 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-37) SPMAsyncTask::PollTask: Polling task 8ee008f6-31a4-4836-8de0-f7036e870910 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:19:40,955 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-37) BaseAsyncTask::OnTaskEndSuccess: Task 8ee008f6-31a4-4836-8de0-f7036e870910 (Parent Command HibernateVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:19:40,955 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-37) CommandAsyncTask::EndActionIfNecessary: All tasks of command ee052e9a-ae73-42c8-bc60-020227d82a67 has ended -> executing EndAction >2014-04-09 15:19:40,955 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-37) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: ee052e9a-ae73-42c8-bc60-020227d82a67): calling EndAction . >2014-04-09 15:19:40,956 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction Unknown, executionIndex: 0 >2014-04-09 15:19:40,980 INFO [org.ovirt.engine.core.bll.HibernateVmCommand] (pool-4-thread-46) Ending command successfully: org.ovirt.engine.core.bll.HibernateVmCommand >2014-04-09 15:19:40,984 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-46) START, HibernateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, hibernationVolHandle=e5613c67-ce49-4a35-b8f2-2df469d0fc78,0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f,08dea1e9-437c-41c7-a31d-4c4d8fd64b8e,b19f5e54-b8a3-4272-8452-9c9a1aacddc5,6ab7f682-b76e-4f5d-b2dc-a0ad5184334f,27454ec4-3e63-4c9e-b310-3fd3a16c935e), log id: a2a8ff2 >2014-04-09 15:19:40,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-46) START, HibernateBrokerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, hibernationVolHandle=e5613c67-ce49-4a35-b8f2-2df469d0fc78,0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f,08dea1e9-437c-41c7-a31d-4c4d8fd64b8e,b19f5e54-b8a3-4272-8452-9c9a1aacddc5,6ab7f682-b76e-4f5d-b2dc-a0ad5184334f,27454ec4-3e63-4c9e-b310-3fd3a16c935e), log id: 487ea014 >2014-04-09 15:19:40,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HibernateBrokerVDSCommand] (pool-4-thread-46) FINISH, HibernateBrokerVDSCommand, log id: 487ea014 >2014-04-09 15:19:41,005 INFO [org.ovirt.engine.core.vdsbroker.HibernateVDSCommand] (pool-4-thread-46) FINISH, HibernateVDSCommand, log id: a2a8ff2 >2014-04-09 15:19:41,007 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm completed, handling the result. >2014-04-09 15:19:41,007 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type HibernateVm succeeded, clearing tasks. >2014-04-09 15:19:41,014 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8ee008f6-31a4-4836-8de0-f7036e870910 >2014-04-09 15:19:41,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 8ee008f6-31a4-4836-8de0-f7036e870910), log id: 5065f2ba >2014-04-09 15:19:41,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=8ee008f6-31a4-4836-8de0-f7036e870910), log id: 5522ba92 >2014-04-09 15:19:41,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 5522ba92 >2014-04-09 15:19:41,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 5065f2ba >2014-04-09 15:19:41,030 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 8ee008f6-31a4-4836-8de0-f7036e870910 from DataBase >2014-04-09 15:19:41,031 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 84447a01-8e34-41e5-af4c-feda62b4b033 >2014-04-09 15:19:41,031 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 84447a01-8e34-41e5-af4c-feda62b4b033), log id: 2da5ba4c >2014-04-09 15:19:41,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=84447a01-8e34-41e5-af4c-feda62b4b033), log id: 5b69eafd >2014-04-09 15:19:41,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 5b69eafd >2014-04-09 15:19:41,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 2da5ba4c >2014-04-09 15:19:41,047 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 84447a01-8e34-41e5-af4c-feda62b4b033 from DataBase >2014-04-09 15:19:41,047 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ee052e9a-ae73-42c8-bc60-020227d82a67 >2014-04-09 15:19:46,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-83) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, force=false, secondsToWait=0, gracefully=false), log id: 101b0ea8 >2014-04-09 15:19:46,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, DestroyVDSCommand, log id: 101b0ea8 >2014-04-09 15:19:46,971 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl on Host DC-85.218 is suspended. >2014-04-09 15:19:46,973 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) vm vm_dl running in db and not running in vds - add to rerun treatment. vds DC-85.218 >2014-04-09 15:19:46,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-83) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[14a1d5e6-7bf8-49cd-beef-9509b0f2af82]), log id: 4101dc4b >2014-04-09 15:19:46,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-83) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@1d7972ef, log id: 4101dc4b >2014-04-09 15:19:59,095 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-46) [cb3e00b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:19:59,112 INFO [org.ovirt.engine.core.bll.RemoveVmHibernationVolumesCommand] (pool-4-thread-46) [54d68a1c] Running command: RemoveVmHibernationVolumesCommand internal: true. >2014-04-09 15:19:59,137 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [54d68a1c] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 08dea1e9-437c-41c7-a31d-4c4d8fd64b8e, postZeros = false, forceDelete = false), log id: 385b48e1 >2014-04-09 15:20:00,325 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [54d68a1c] FINISH, DeleteImageGroupVDSCommand, log id: 385b48e1 >2014-04-09 15:20:00,347 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) [54d68a1c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0568be61-8527-4349-b72c-a3a6c8004ada >2014-04-09 15:20:00,347 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-46) [54d68a1c] CommandMultiAsyncTasks::AttachTask: Attaching task 92e60698-fdbe-4db4-a133-505f5ecd3290 to command 0568be61-8527-4349-b72c-a3a6c8004ada. >2014-04-09 15:20:00,473 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [54d68a1c] Adding task 92e60698-fdbe-4db4-a133-505f5ecd3290 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:20:00,570 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [54d68a1c] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 6ab7f682-b76e-4f5d-b2dc-a0ad5184334f, postZeros = false, forceDelete = false), log id: 55e16098 >2014-04-09 15:20:01,751 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [54d68a1c] FINISH, DeleteImageGroupVDSCommand, log id: 55e16098 >2014-04-09 15:20:01,771 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-46) [54d68a1c] CommandMultiAsyncTasks::AttachTask: Attaching task 80afcdf9-932e-41d8-9cec-862fc6786bb2 to command 0568be61-8527-4349-b72c-a3a6c8004ada. >2014-04-09 15:20:01,778 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [54d68a1c] Adding task 80afcdf9-932e-41d8-9cec-862fc6786bb2 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:20:01,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [54d68a1c] Correlation ID: cb3e00b, Job ID: eb6365ea-ae73-4b4b-92cf-ecf6b74e969b, Call Stack: null, Custom Event ID: -1, Message: Suspended VM vm_dl powered off by admin@internal. >2014-04-09 15:20:01,811 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) [54d68a1c] BaseAsyncTask::StartPollingTask: Starting to poll task 92e60698-fdbe-4db4-a133-505f5ecd3290. >2014-04-09 15:20:01,812 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) [54d68a1c] BaseAsyncTask::StartPollingTask: Starting to poll task 80afcdf9-932e-41d8-9cec-862fc6786bb2. >2014-04-09 15:20:05,586 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-46) [7e51dafe] Running command: StopVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:20:05,603 INFO [org.ovirt.engine.core.bll.RemoveVmHibernationVolumesCommand] (pool-4-thread-46) [7e631a6e] Running command: RemoveVmHibernationVolumesCommand internal: true. >2014-04-09 15:20:05,628 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [7e631a6e] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 08dea1e9-437c-41c7-a31d-4c4d8fd64b8e, postZeros = false, forceDelete = false), log id: 3e5254a2 >2014-04-09 15:20:05,910 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [7e631a6e] Command DeleteImageGroupVDS execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Image does not exist in domain: 'image=08dea1e9-437c-41c7-a31d-4c4d8fd64b8e, domain=e5613c67-ce49-4a35-b8f2-2df469d0fc78' >2014-04-09 15:20:05,910 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [7e631a6e] FINISH, DeleteImageGroupVDSCommand, log id: 3e5254a2 >2014-04-09 15:20:05,936 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [7e631a6e] Removed task e026622c-a9cf-4bde-8336-3ab610ccf36b from DataBase >2014-04-09 15:20:05,963 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [7e631a6e] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = e5613c67-ce49-4a35-b8f2-2df469d0fc78, imageGroupId = 6ab7f682-b76e-4f5d-b2dc-a0ad5184334f, postZeros = false, forceDelete = false), log id: 39b54972 >2014-04-09 15:20:06,196 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [7e631a6e] Command DeleteImageGroupVDS execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Image does not exist in domain: 'image=6ab7f682-b76e-4f5d-b2dc-a0ad5184334f, domain=e5613c67-ce49-4a35-b8f2-2df469d0fc78' >2014-04-09 15:20:06,196 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-46) [7e631a6e] FINISH, DeleteImageGroupVDSCommand, log id: 39b54972 >2014-04-09 15:20:06,229 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [7e631a6e] Removed task 9fd9bd62-164c-4ca4-9e41-d5874b9bb851 from DataBase >2014-04-09 15:20:06,271 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [7e631a6e] Correlation ID: 7e51dafe, Job ID: 9e8eafdd-c83b-4ecf-88f1-a1834beb4c2f, Call Stack: null, Custom Event ID: -1, Message: Suspended VM vm_dl powered off by admin@internal. >2014-04-09 15:20:10,958 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-77) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-04-09 15:20:10,996 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task 92e60698-fdbe-4db4-a133-505f5ecd3290 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:20:11,012 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::OnTaskEndSuccess: Task 92e60698-fdbe-4db4-a133-505f5ecd3290 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:20:11,012 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-77) Task with DB Task ID 63d111ea-2145-45ed-a6d3-d9db117be96c and VDSM Task ID 80afcdf9-932e-41d8-9cec-862fc6786bb2 is in state Polling. End action for command 0568be61-8527-4349-b72c-a3a6c8004ada will proceed when all the entitys tasks are completed. >2014-04-09 15:20:11,012 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task 80afcdf9-932e-41d8-9cec-862fc6786bb2 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:20:11,020 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::OnTaskEndSuccess: Task 80afcdf9-932e-41d8-9cec-862fc6786bb2 (Parent Command ShutdownVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:20:11,021 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::EndActionIfNecessary: All tasks of command 0568be61-8527-4349-b72c-a3a6c8004ada has ended -> executing EndAction >2014-04-09 15:20:11,021 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: 0568be61-8527-4349-b72c-a3a6c8004ada): calling EndAction . >2014-04-09 15:20:11,021 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction ShutdownVm, executionIndex: 0 >2014-04-09 15:20:11,037 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-46) Ending command successfully: org.ovirt.engine.core.bll.ShutdownVmCommand >2014-04-09 15:20:11,095 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type ShutdownVm completed, handling the result. >2014-04-09 15:20:11,095 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type ShutdownVm succeeded, clearing tasks. >2014-04-09 15:20:11,103 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 80afcdf9-932e-41d8-9cec-862fc6786bb2 >2014-04-09 15:20:11,104 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 80afcdf9-932e-41d8-9cec-862fc6786bb2), log id: 1787ba79 >2014-04-09 15:20:11,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=80afcdf9-932e-41d8-9cec-862fc6786bb2), log id: 4fe36a00 >2014-04-09 15:20:11,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 4fe36a00 >2014-04-09 15:20:11,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 1787ba79 >2014-04-09 15:20:11,120 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 80afcdf9-932e-41d8-9cec-862fc6786bb2 from DataBase >2014-04-09 15:20:11,120 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 92e60698-fdbe-4db4-a133-505f5ecd3290 >2014-04-09 15:20:11,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 92e60698-fdbe-4db4-a133-505f5ecd3290), log id: 226f9101 >2014-04-09 15:20:11,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=92e60698-fdbe-4db4-a133-505f5ecd3290), log id: 4a98ea50 >2014-04-09 15:20:11,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 4a98ea50 >2014-04-09 15:20:11,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 226f9101 >2014-04-09 15:20:11,154 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task 92e60698-fdbe-4db4-a133-505f5ecd3290 from DataBase >2014-04-09 15:20:11,154 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0568be61-8527-4349-b72c-a3a6c8004ada >2014-04-09 15:20:19,748 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-15) [5aa67a42] Lock Acquired to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:20:19,758 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-15) [5aa67a42] START, IsVmDuringInitiatingVDSCommand( vmId = 14a1d5e6-7bf8-49cd-beef-9509b0f2af82), log id: 52de1028 >2014-04-09 15:20:19,758 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-15) [5aa67a42] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 52de1028 >2014-04-09 15:20:19,844 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [5aa67a42] Running command: RunVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:20:19,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [5aa67a42] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 654d63dd >2014-04-09 15:20:19,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [5aa67a42] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/10.66.85.218:_NFS/7a3c7740-81a1-4969-ad72-791dd92cbcb3/images/11111111-1111-1111-1111-111111111111, log id: 654d63dd >2014-04-09 15:20:19,929 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [5aa67a42] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, vm=VM [vm_dl]), log id: 74cee677 >2014-04-09 15:20:19,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [5aa67a42] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, vm=VM [vm_dl]), log id: 403f3512 >2014-04-09 15:20:20,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [5aa67a42] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82,devices=[Ljava.util.HashMap;@73ad273c,acpiEnable=true,vmName=vm_dl,cpuType=Conroe,custom={device_b4a104e7-b442-440a-b3f4-d8da7a45821ddevice_06511978-dc04-40ac-ba9f-dd050ba8cfcbdevice_c2389469-b1b0-4830-8e0b-319bca0a1e35=VmDevice {vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, deviceId=c2389469-b1b0-4830-8e0b-319bca0a1e35, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_b4a104e7-b442-440a-b3f4-d8da7a45821ddevice_06511978-dc04-40ac-ba9f-dd050ba8cfcbdevice_c2389469-b1b0-4830-8e0b-319bca0a1e35device_d4210f7f-0007-4857-b9b0-2181bea2e10adevice_c43e838c-62d1-4237-9cb5-cf52d83fa443=VmDevice {vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, deviceId=c43e838c-62d1-4237-9cb5-cf52d83fa443, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_b4a104e7-b442-440a-b3f4-d8da7a45821ddevice_06511978-dc04-40ac-ba9f-dd050ba8cfcb=VmDevice {vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, deviceId=06511978-dc04-40ac-ba9f-dd050ba8cfcb, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_b4a104e7-b442-440a-b3f4-d8da7a45821ddevice_06511978-dc04-40ac-ba9f-dd050ba8cfcbdevice_c2389469-b1b0-4830-8e0b-319bca0a1e35device_d4210f7f-0007-4857-b9b0-2181bea2e10a=VmDevice {vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, deviceId=d4210f7f-0007-4857-b9b0-2181bea2e10a, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_b4a104e7-b442-440a-b3f4-d8da7a45821d=VmDevice {vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, deviceId=b4a104e7-b442-440a-b3f4-d8da7a45821d, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}} >2014-04-09 15:20:20,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [5aa67a42] FINISH, CreateVDSCommand, log id: 403f3512 >2014-04-09 15:20:20,028 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [5aa67a42] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 74cee677 >2014-04-09 15:20:20,028 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [5aa67a42] Lock freed to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:20:20,036 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [5aa67a42] Correlation ID: 5aa67a42, Job ID: 9768f68f-f304-4d01-8305-2512d6d7db21, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl was started by admin@internal (Host: DC-85.218). >2014-04-09 15:20:23,716 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) VM vm_dl 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 moved from WaitForLaunch --> PoweringUp >2014-04-09 15:20:23,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[14a1d5e6-7bf8-49cd-beef-9509b0f2af82]), log id: 1b97ca0f >2014-04-09 15:20:23,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4836446b, log id: 1b97ca0f >2014-04-09 15:20:26,479 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-14) [78ea491e] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:20:26,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [78ea491e] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, ticket=/xUHeznInjiv, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1a639f59 >2014-04-09 15:20:26,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [78ea491e] FINISH, SetVmTicketVDSCommand, log id: 1a639f59 >2014-04-09 15:20:26,614 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [78ea491e] Correlation ID: 78ea491e, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM vm_dl >2014-04-09 15:20:42,510 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-66) Setting new tasks map. The map contains now 2 tasks >2014-04-09 15:20:49,486 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-46) [4412d110] Running command: StopVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 15:20:49,492 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [4412d110] START, DestroyVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=0, gracefully=false), log id: 55157341 >2014-04-09 15:20:49,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [4412d110] START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, force=false, secondsToWait=0, gracefully=false), log id: 496ba60b >2014-04-09 15:20:50,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [4412d110] FINISH, DestroyVDSCommand, log id: 496ba60b >2014-04-09 15:20:50,419 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [4412d110] FINISH, DestroyVmVDSCommand, return: Down, log id: 55157341 >2014-04-09 15:20:50,436 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [4412d110] Correlation ID: 4412d110, Job ID: 3a9e814c-b13e-4e8a-9db0-f00389024b93, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc powered off by admin@internal (Host: DC-85.218). >2014-04-09 15:21:08,082 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-46) [6e4cf08f] Running command: StopVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:21:08,089 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [6e4cf08f] START, DestroyVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, force=false, secondsToWait=0, gracefully=false), log id: 30782e93 >2014-04-09 15:21:08,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [6e4cf08f] START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=14a1d5e6-7bf8-49cd-beef-9509b0f2af82, force=false, secondsToWait=0, gracefully=false), log id: 3a8bf06c >2014-04-09 15:21:08,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [6e4cf08f] FINISH, DestroyVDSCommand, log id: 3a8bf06c >2014-04-09 15:21:08,970 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [6e4cf08f] FINISH, DestroyVmVDSCommand, return: Down, log id: 30782e93 >2014-04-09 15:21:08,985 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [6e4cf08f] Correlation ID: 6e4cf08f, Job ID: 2f4bdadc-e39e-45f0-8c15-d9cde1fce97b, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl powered off by admin@internal (Host: DC-85.218). >2014-04-09 15:21:12,510 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-43) Setting new tasks map. The map contains now 0 tasks >2014-04-09 15:21:12,511 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-43) Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 15:23:34,705 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-11) [68222767] Lock Acquired to object EngineLock [exclusiveLocks= key: dc-vm-rn value: VM_NAME >, sharedLocks= ] >2014-04-09 15:23:34,749 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-11) [68222767] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-09 15:23:34,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [68222767] Correlation ID: 68222767, Job ID: 6fc7731e-9cf5-439a-9cfb-4ed9da60e1ee, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn was created by admin@internal. >2014-04-09 15:23:34,866 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-11) [68222767] Lock freed to object EngineLock [exclusiveLocks= key: dc-vm-rn value: VM_NAME >, sharedLocks= ] >2014-04-09 15:23:34,922 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-46) [4d3dffd3] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM, ID: 06b6a7c0-599a-4f36-8c3f-d66c7e741d47 Type: VnicProfile >2014-04-09 15:23:34,931 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-4) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-09 15:23:34,939 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-13) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-09 15:23:34,982 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-46) [53582708] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:23:35,025 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [53582708] Correlation ID: 53582708, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM dc-vm-rn. (User: admin@internal) >2014-04-09 15:23:35,057 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [53582708] Correlation ID: 4d3dffd3, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM dc-vm-rn. (User: admin@internal) >2014-04-09 15:23:43,603 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-13) [7aa23ada] Lock Acquired to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM_DISK_BOOT >, sharedLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >] >2014-04-09 15:23:43,632 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-13) [7aa23ada] Running command: AddDiskCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM, ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 15:23:43,723 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-13) [23093624] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 15:23:43,742 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-13) [23093624] Lock freed to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM_DISK_BOOT >, sharedLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >] >2014-04-09 15:23:43,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-13) [23093624] START, CreateImageVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = f3007363-b598-4016-8819-aa6aac76ff4b, imageSizeInBytes = 8589934592, volumeFormat = RAW, newImageId = b59ca5ac-54e1-4a3a-9d61-a76297f6678c, newImageDescription = ), log id: 37555534 >2014-04-09 15:23:43,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-13) [23093624] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-09 15:23:43,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-13) [23093624] -- createVolume parameters: > sdUUID=7cee4e2f-9997-4578-8396-c3aabb03d4c6 > spUUID=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f > imgGUID=f3007363-b598-4016-8819-aa6aac76ff4b > size=8,589,934,592 bytes > volFormat=RAW > volType=Preallocated > volUUID=b59ca5ac-54e1-4a3a-9d61-a76297f6678c > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-09 15:23:43,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-13) [23093624] FINISH, CreateImageVDSCommand, return: b59ca5ac-54e1-4a3a-9d61-a76297f6678c, log id: 37555534 >2014-04-09 15:23:43,803 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-13) [23093624] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 2118c72f-4beb-4f68-81ff-832d6a0c4835 >2014-04-09 15:23:43,803 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-13) [23093624] CommandMultiAsyncTasks::AttachTask: Attaching task 4fc9beb6-3e84-450c-8782-6430b024d708 to command 2118c72f-4beb-4f68-81ff-832d6a0c4835. >2014-04-09 15:23:43,818 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-13) [23093624] Adding task 4fc9beb6-3e84-450c-8782-6430b024d708 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:23:43,859 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [23093624] Correlation ID: 7aa23ada, Job ID: 02802263-6611-42f3-813b-cff081cd4b4f, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of dc-vm-rn_Disk1 was initiated on VM dc-vm-rn by admin@internal. >2014-04-09 15:23:43,860 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-13) [23093624] BaseAsyncTask::StartPollingTask: Starting to poll task 4fc9beb6-3e84-450c-8782-6430b024d708. >2014-04-09 15:23:51,058 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-09 15:23:51,073 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-1) SPMAsyncTask::PollTask: Polling task 4fc9beb6-3e84-450c-8782-6430b024d708 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:23:51,084 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-1) BaseAsyncTask::OnTaskEndSuccess: Task 4fc9beb6-3e84-450c-8782-6430b024d708 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:23:51,084 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-1) CommandAsyncTask::EndActionIfNecessary: All tasks of command 2118c72f-4beb-4f68-81ff-832d6a0c4835 has ended -> executing EndAction >2014-04-09 15:23:51,084 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-1) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 2118c72f-4beb-4f68-81ff-832d6a0c4835): calling EndAction . >2014-04-09 15:23:51,084 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-09 15:23:51,100 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-47) [7aa23ada] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-09 15:23:51,108 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-47) [23093624] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-09 15:23:51,122 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [23093624] START, GetImageInfoVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = f3007363-b598-4016-8819-aa6aac76ff4b, imageId = b59ca5ac-54e1-4a3a-9d61-a76297f6678c), log id: 439a26e4 >2014-04-09 15:23:51,445 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-47) [23093624] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7de49c84, log id: 439a26e4 >2014-04-09 15:23:51,475 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) Correlation ID: 7aa23ada, Job ID: 02802263-6611-42f3-813b-cff081cd4b4f, Call Stack: null, Custom Event ID: -1, Message: The disk dc-vm-rn_Disk1 was successfully added to VM dc-vm-rn. >2014-04-09 15:23:51,475 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-09 15:23:51,475 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-09 15:23:51,483 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4fc9beb6-3e84-450c-8782-6430b024d708 >2014-04-09 15:23:51,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 4fc9beb6-3e84-450c-8782-6430b024d708), log id: 5281ff1a >2014-04-09 15:23:51,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=4fc9beb6-3e84-450c-8782-6430b024d708), log id: 646ab928 >2014-04-09 15:23:51,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 646ab928 >2014-04-09 15:23:51,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 5281ff1a >2014-04-09 15:23:51,550 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task 4fc9beb6-3e84-450c-8782-6430b024d708 from DataBase >2014-04-09 15:23:51,550 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 2118c72f-4beb-4f68-81ff-832d6a0c4835 >2014-04-09 15:24:00,228 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] START, IsVmDuringInitiatingVDSCommand( vmId = 05a0280b-e76a-4d0e-950a-935502fe89e5), log id: 331374ff >2014-04-09 15:24:00,228 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 331374ff >2014-04-09 15:24:00,266 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] Running command: RunVmOnceCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:24:00,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 40b2dd82 >2014-04-09 15:24:00,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/10.66.85.218:_NFS/7a3c7740-81a1-4969-ad72-791dd92cbcb3/images/11111111-1111-1111-1111-111111111111, log id: 40b2dd82 >2014-04-09 15:24:00,341 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, vm=VM [dc-vm-rn]), log id: 776171dc >2014-04-09 15:24:00,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, vm=VM [dc-vm-rn]), log id: 129c3fe4 >2014-04-09 15:24:00,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=05a0280b-e76a-4d0e-950a-935502fe89e5,devices=[Ljava.util.HashMap;@31573ed6,acpiEnable=true,vmName=dc-vm-rn,cpuType=Conroe,custom={} >2014-04-09 15:24:00,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] FINISH, CreateVDSCommand, log id: 129c3fe4 >2014-04-09 15:24:00,416 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-6) [5c5fecfd] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 776171dc >2014-04-09 15:24:00,426 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [5c5fecfd] Correlation ID: 5c5fecfd, Job ID: f335d073-367d-4a12-81bc-ed56db1efc33, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn was started by admin@internal (Host: DC-85.218). >2014-04-09 15:24:06,178 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from WaitForLaunch --> PoweringUp >2014-04-09 15:24:06,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-49) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[05a0280b-e76a-4d0e-950a-935502fe89e5]), log id: 51ee4433 >2014-04-09 15:24:06,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-49) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@5e7d5c5, log id: 51ee4433 >2014-04-09 15:24:17,562 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-3) [7fd69e09] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:24:17,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [7fd69e09] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, ticket=4gfPmuR1EiTT, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1f05f128 >2014-04-09 15:24:17,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [7fd69e09] FINISH, SetVmTicketVDSCommand, log id: 1f05f128 >2014-04-09 15:24:17,689 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [7fd69e09] Correlation ID: 7fd69e09, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-rn >2014-04-09 15:24:27,156 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [35fb52ea] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:24:27,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [35fb52ea] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, ticket=RxhCiV48vVCy, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 3720479 >2014-04-09 15:24:27,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [35fb52ea] FINISH, SetVmTicketVDSCommand, log id: 3720479 >2014-04-09 15:24:27,268 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [35fb52ea] Correlation ID: 35fb52ea, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-rn >2014-04-09 15:25:01,707 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-68) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from PoweringUp --> Up >2014-04-09 15:25:01,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) Correlation ID: 5c5fecfd, Job ID: f335d073-367d-4a12-81bc-ed56db1efc33, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn started on Host DC-85.218 >2014-04-09 15:25:12,811 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) Setting new tasks map. The map contains now 0 tasks >2014-04-09 15:25:12,812 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 15:25:44,550 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 15:36:56,976 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-99) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.218 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 15:37:09,901 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-97) Start refreshing all users data >2014-04-09 15:37:10,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-04-09 15:37:10,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center dc_iscsi >2014-04-09 15:37:10,970 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-26) START, UpdateVMVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 4), log id: 54deb499 >2014-04-09 15:37:11,105 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, UpdateVMVDSCommand, log id: 54deb499 >2014-04-09 15:37:11,131 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center dc_iscsi >2014-04-09 15:37:11,131 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center dc_iscsi >2014-04-09 15:37:11,135 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center dc_iscsi >2014-04-09 15:37:11,135 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center dc_iscsi >2014-04-09 15:37:11,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center dc_iscsi >2014-04-09 15:37:11,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 15:37:11,151 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 15:37:11,151 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 15:37:11,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 15:37:11,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 15:37:11,156 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 15:37:17,286 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-17) [39454225] Running command: LogoutUserCommand internal: false. >2014-04-09 15:37:17,321 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-17) [39454225] Correlation ID: 39454225, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-09 15:37:19,170 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host DC-85.215 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 15:39:14,403 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from Up --> RebootInProgress >2014-04-09 15:39:14,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-63) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[05a0280b-e76a-4d0e-950a-935502fe89e5]), log id: fef5517 >2014-04-09 15:39:14,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-63) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@1154d346, log id: fef5517 >2014-04-09 15:40:09,722 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from RebootInProgress --> Up >2014-04-09 15:40:30,997 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-76) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 15:42:53,552 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-3) [510616be] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:42:53,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [510616be] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, ticket=EbP1wSJp4Wp3, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 23ddbe16 >2014-04-09 15:42:53,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [510616be] FINISH, SetVmTicketVDSCommand, log id: 23ddbe16 >2014-04-09 15:42:53,648 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [510616be] Correlation ID: 510616be, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-rn >2014-04-09 15:43:58,770 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-90) Failed in GetVmStatsVDS method >2014-04-09 15:43:58,771 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-90) Error code noVM and error message VDSGenericException: VDSErrorException: Failed to GetVmStatsVDS, error = Virtual machine does not exist >2014-04-09 15:43:58,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-90) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VMInfoListReturnForXmlRpc@1996a74d >2014-04-09 15:43:58,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-90) HostName = DC-85.218 >2014-04-09 15:43:58,771 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand] (DefaultQuartzScheduler_Worker-90) Command GetVmStatsVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmStatsVDS, error = Virtual machine does not exist >2014-04-09 15:43:58,774 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) vm dc-vm-rn running in db and not running in vds - add to rerun treatment. vds DC-85.218 >2014-04-09 15:44:01,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-77) START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, force=false, secondsToWait=0, gracefully=false), log id: 518b82c7 >2014-04-09 15:44:01,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, DestroyVDSCommand, log id: 518b82c7 >2014-04-09 15:44:02,473 WARN [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-5) [47b6f589] CanDoAction of action SetVmTicket failed. Reasons:VAR__ACTION__SET,VAR__TYPE__VM_TICKET,ACTION_TYPE_FAILED_VM_STATUS_ILLEGAL,VAR__VM_STATUS__DOWN >2014-04-09 15:44:07,567 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [a8482a9] Lock Acquired to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >, sharedLocks= ] >2014-04-09 15:44:07,580 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [a8482a9] START, IsVmDuringInitiatingVDSCommand( vmId = 05a0280b-e76a-4d0e-950a-935502fe89e5), log id: 58190dec >2014-04-09 15:44:07,580 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [a8482a9] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 58190dec >2014-04-09 15:44:07,652 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [a8482a9] Running command: RunVmCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:44:07,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [a8482a9] START, IsoPrefixVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId=0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 473bb01c >2014-04-09 15:44:07,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-46) [a8482a9] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/10.66.85.218:_NFS/7a3c7740-81a1-4969-ad72-791dd92cbcb3/images/11111111-1111-1111-1111-111111111111, log id: 473bb01c >2014-04-09 15:44:07,796 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [a8482a9] START, CreateVmVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, vm=VM [dc-vm-rn]), log id: 746380d7 >2014-04-09 15:44:07,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [a8482a9] START, CreateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, vm=VM [dc-vm-rn]), log id: 7776c1d9 >2014-04-09 15:44:07,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [a8482a9] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-2,transparentHugePages=true,vmId=05a0280b-e76a-4d0e-950a-935502fe89e5,devices=[Ljava.util.HashMap;@5179b7a2,acpiEnable=true,vmName=dc-vm-rn,cpuType=Conroe,custom={device_80ee3644-cc67-41f2-9031-928112f00370device_d211afb9-57f3-4a72-8d33-426328baf053device_4354d5e2-6583-4faa-9271-1adb7fae9653device_21758d99-7035-41ac-a522-c24c2c65f4bedevice_6d0ad28e-0e76-4593-a111-b0eb3f21be46=VmDevice {vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, deviceId=6d0ad28e-0e76-4593-a111-b0eb3f21be46, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_80ee3644-cc67-41f2-9031-928112f00370device_d211afb9-57f3-4a72-8d33-426328baf053device_4354d5e2-6583-4faa-9271-1adb7fae9653device_21758d99-7035-41ac-a522-c24c2c65f4be=VmDevice {vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, deviceId=21758d99-7035-41ac-a522-c24c2c65f4be, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_80ee3644-cc67-41f2-9031-928112f00370device_d211afb9-57f3-4a72-8d33-426328baf053device_4354d5e2-6583-4faa-9271-1adb7fae9653=VmDevice {vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, deviceId=4354d5e2-6583-4faa-9271-1adb7fae9653, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_80ee3644-cc67-41f2-9031-928112f00370=VmDevice {vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, deviceId=80ee3644-cc67-41f2-9031-928112f00370, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_80ee3644-cc67-41f2-9031-928112f00370device_d211afb9-57f3-4a72-8d33-426328baf053device_4354d5e2-6583-4faa-9271-1adb7fae9653device_21758d99-7035-41ac-a522-c24c2c65f4bedevice_6d0ad28e-0e76-4593-a111-b0eb3f21be46device_3f06e0c8-724e-4875-9dbc-17e1df959b9a=VmDevice {vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, deviceId=3f06e0c8-724e-4875-9dbc-17e1df959b9a, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_80ee3644-cc67-41f2-9031-928112f00370device_d211afb9-57f3-4a72-8d33-426328baf053=VmDevice {vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, deviceId=d211afb9-57f3-4a72-8d33-426328baf053, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}} >2014-04-09 15:44:07,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-46) [a8482a9] FINISH, CreateVDSCommand, log id: 7776c1d9 >2014-04-09 15:44:07,919 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-46) [a8482a9] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 746380d7 >2014-04-09 15:44:07,919 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-46) [a8482a9] Lock freed to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >, sharedLocks= ] >2014-04-09 15:44:07,927 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [a8482a9] Correlation ID: a8482a9, Job ID: 306d9305-657b-4fb6-a072-d02f2f0fc95a, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn was started by admin@internal (Host: DC-85.218). >2014-04-09 15:44:14,630 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-29) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from WaitForLaunch --> PoweringUp >2014-04-09 15:44:14,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-29) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[05a0280b-e76a-4d0e-950a-935502fe89e5]), log id: 364c1847 >2014-04-09 15:44:14,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-29) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@3dcdf92a, log id: 364c1847 >2014-04-09 15:45:09,080 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-10) [5fa13031] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:45:09,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-10) [5fa13031] START, SetVmTicketVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, ticket=vYoVb96EnHRD, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 28b76899 >2014-04-09 15:45:09,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-10) [5fa13031] FINISH, SetVmTicketVDSCommand, log id: 28b76899 >2014-04-09 15:45:09,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [5fa13031] Correlation ID: 5fa13031, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM dc-vm-rn >2014-04-09 15:45:09,670 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from PoweringUp --> Up >2014-04-09 15:45:09,878 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) Correlation ID: a8482a9, Job ID: 306d9305-657b-4fb6-a072-d02f2f0fc95a, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn started on Host DC-85.218 >2014-04-09 15:45:54,512 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-6) [2df81415] Lock Acquired to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >, sharedLocks= ] >2014-04-09 15:45:54,639 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (pool-4-thread-48) [2df81415] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:45:54,667 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-48) [2df81415] START, MigrateVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, srcHost=10.66.85.218, dstVdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, dstHost=10.66.85.215:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 30c28d58 >2014-04-09 15:45:54,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-48) [2df81415] VdsBroker::migrate::Entered (vm_guid=05a0280b-e76a-4d0e-950a-935502fe89e5, srcHost=10.66.85.218, dstHost=10.66.85.215:54321, method=online >2014-04-09 15:45:54,668 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-48) [2df81415] START, MigrateBrokerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, srcHost=10.66.85.218, dstVdsId=6c442434-1073-4f29-a3bd-c20b77a28d91, dstHost=10.66.85.215:54321, migrationMethod=ONLINE, tunnelMigration=false), log id: 1420703a >2014-04-09 15:45:54,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-4-thread-48) [2df81415] FINISH, MigrateBrokerVDSCommand, log id: 1420703a >2014-04-09 15:45:54,698 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-4-thread-48) [2df81415] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 30c28d58 >2014-04-09 15:45:54,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [2df81415] Correlation ID: 2df81415, Job ID: 3a5abbd9-2ba6-4b25-8856-132f555c3695, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: dc-vm-rn, Source: DC-85.218, Destination: DC-85.215, User: admin@internal). >2014-04-09 15:45:55,399 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) RefreshVmList vm id 05a0280b-e76a-4d0e-950a-935502fe89e5 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:45:58,452 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-72) RefreshVmList vm id 05a0280b-e76a-4d0e-950a-935502fe89e5 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:46:01,979 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) [1e736b86] RefreshVmList vm id 05a0280b-e76a-4d0e-950a-935502fe89e5 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:46:05,008 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) RefreshVmList vm id 05a0280b-e76a-4d0e-950a-935502fe89e5 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:46:07,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) START, FullListVdsCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vds=Host[DC-85.218], vmIds=[05a0280b-e76a-4d0e-950a-935502fe89e5]), log id: 486d5fd9 >2014-04-09 15:46:07,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4afc4b5, log id: 486d5fd9 >2014-04-09 15:46:08,039 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-85) RefreshVmList vm id 05a0280b-e76a-4d0e-950a-935502fe89e5 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:46:11,116 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) RefreshVmList vm id 05a0280b-e76a-4d0e-950a-935502fe89e5 is migrating to vds DC-85.215 ignoring it in the refresh until migration is done >2014-04-09 15:46:11,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-86) [127d87cf] START, DestroyVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, force=false, secondsToWait=0, gracefully=false), log id: 45883943 >2014-04-09 15:46:12,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-86) [127d87cf] FINISH, DestroyVDSCommand, log id: 45883943 >2014-04-09 15:46:12,578 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) [127d87cf] Handing over VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 to Host 6c442434-1073-4f29-a3bd-c20b77a28d91. Setting VM to status MigratingTo >2014-04-09 15:46:12,578 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) [127d87cf] vm dc-vm-rn running in db and not running in vds - add to rerun treatment. vds DC-85.218 >2014-04-09 15:46:14,174 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) VM dc-vm-rn 05a0280b-e76a-4d0e-950a-935502fe89e5 moved from MigratingTo --> Up >2014-04-09 15:46:14,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-13) START, FullListVdsCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vds=Host[DC-85.215], vmIds=[05a0280b-e76a-4d0e-950a-935502fe89e5]), log id: 758e04dc >2014-04-09 15:46:14,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-13) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@3ee143cf, log id: 758e04dc >2014-04-09 15:46:14,320 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) Correlation ID: 2df81415, Job ID: 3a5abbd9-2ba6-4b25-8856-132f555c3695, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dc-vm-rn, Source: DC-85.218, Destination: DC-85.215, Duration: 19 sec). >2014-04-09 15:46:14,329 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (DefaultQuartzScheduler_Worker-13) Lock freed to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >, sharedLocks= ] >2014-04-09 15:51:14,546 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-46) [3bbef1] Running command: StopVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:51:14,552 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [3bbef1] START, DestroyVmVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=0, gracefully=false), log id: 402a4203 >2014-04-09 15:51:14,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [3bbef1] START, DestroyVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=70cb0dc5-8f43-499d-957d-124aebd3fd35, force=false, secondsToWait=0, gracefully=false), log id: 60a36892 >2014-04-09 15:51:19,038 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-50) [13844709] Running command: StopVmCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:51:19,089 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [13844709] START, DestroyVmVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, force=false, secondsToWait=0, gracefully=false), log id: 1091ebed >2014-04-09 15:51:20,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [3bbef1] FINISH, DestroyVDSCommand, log id: 60a36892 >2014-04-09 15:51:20,510 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [3bbef1] FINISH, DestroyVmVDSCommand, return: Down, log id: 402a4203 >2014-04-09 15:51:20,517 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [13844709] START, DestroyVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, vmId=05a0280b-e76a-4d0e-950a-935502fe89e5, force=false, secondsToWait=0, gracefully=false), log id: 4ff0ffcb >2014-04-09 15:51:20,522 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [3bbef1] Correlation ID: 3bbef1, Job ID: b9c0c190-7750-450e-815c-19e2939187be, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 powered off by admin@internal (Host: DC-85.215). >2014-04-09 15:51:22,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [13844709] FINISH, DestroyVDSCommand, log id: 4ff0ffcb >2014-04-09 15:51:22,257 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [13844709] FINISH, DestroyVmVDSCommand, return: Down, log id: 1091ebed >2014-04-09 15:51:22,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [13844709] Correlation ID: 13844709, Job ID: 3cf649c2-8a96-48ca-9cee-4743f8f7553b, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn powered off by admin@internal (Host: DC-85.215). >2014-04-09 15:52:40,562 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-7) [7bbdec5e] Lock Acquired to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 15:52:40,662 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [7bbdec5e] Running command: RemoveVmCommand internal: false. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:52:40,667 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [7bbdec5e] START, SetVmStatusVDSCommand( vmId = 70cb0dc5-8f43-499d-957d-124aebd3fd35, status = ImageLocked), log id: c3830d7 >2014-04-09 15:52:40,677 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [7bbdec5e] FINISH, SetVmStatusVDSCommand, log id: c3830d7 >2014-04-09 15:52:40,687 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [7bbdec5e] Lock freed to object EngineLock [exclusiveLocks= key: 70cb0dc5-8f43-499d-957d-124aebd3fd35 value: VM >, sharedLocks= ] >2014-04-09 15:52:40,758 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-48) [503659cb] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 70cb0dc5-8f43-499d-957d-124aebd3fd35 Type: VM >2014-04-09 15:52:40,801 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-48) [3e903782] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 15:52:40,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-48) [3e903782] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 89cb56a4-f024-444a-a531-9039cae8528a, postZeros = false, forceDelete = false), log id: 5519cb02 >2014-04-09 15:52:42,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-48) [3e903782] FINISH, DeleteImageGroupVDSCommand, log id: 5519cb02 >2014-04-09 15:52:42,168 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) [3e903782] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command e5696c3f-9486-46f1-8c00-7506c7b0a83b >2014-04-09 15:52:42,168 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [3e903782] CommandMultiAsyncTasks::AttachTask: Attaching task f97bd6a6-34b0-49bd-8414-15e71386107f to command e5696c3f-9486-46f1-8c00-7506c7b0a83b. >2014-04-09 15:52:42,179 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [3e903782] Adding task f97bd6a6-34b0-49bd-8414-15e71386107f (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:52:42,313 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [3e903782] Correlation ID: 7bbdec5e, Job ID: c3666bee-e532-405a-84da-fe1ac4ac9e3a, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-2 was successfully removed. >2014-04-09 15:52:42,313 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [3e903782] BaseAsyncTask::StartPollingTask: Starting to poll task f97bd6a6-34b0-49bd-8414-15e71386107f. >2014-04-09 15:52:45,857 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-10) [fd8787b] Lock Acquired to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >, sharedLocks= ] >2014-04-09 15:52:45,930 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [fd8787b] Running command: RemoveVmCommand internal: false. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:52:45,930 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [fd8787b] START, SetVmStatusVDSCommand( vmId = 05a0280b-e76a-4d0e-950a-935502fe89e5, status = ImageLocked), log id: 54b222d8 >2014-04-09 15:52:45,937 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [fd8787b] FINISH, SetVmStatusVDSCommand, log id: 54b222d8 >2014-04-09 15:52:45,946 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [fd8787b] Lock freed to object EngineLock [exclusiveLocks= key: 05a0280b-e76a-4d0e-950a-935502fe89e5 value: VM >, sharedLocks= ] >2014-04-09 15:52:45,967 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-50) [5ffb4c95] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 05a0280b-e76a-4d0e-950a-935502fe89e5 Type: VM >2014-04-09 15:52:45,971 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-50) [77f2fb37] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 15:52:45,980 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [77f2fb37] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = f3007363-b598-4016-8819-aa6aac76ff4b, postZeros = false, forceDelete = false), log id: 73fc08fe >2014-04-09 15:52:47,010 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [77f2fb37] FINISH, DeleteImageGroupVDSCommand, log id: 73fc08fe >2014-04-09 15:52:47,055 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [77f2fb37] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ecdf1da9-b8b2-4b8e-95ec-51fc4916faa3 >2014-04-09 15:52:47,055 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [77f2fb37] CommandMultiAsyncTasks::AttachTask: Attaching task 9a462b08-9d13-4968-8ac6-c211eec89255 to command ecdf1da9-b8b2-4b8e-95ec-51fc4916faa3. >2014-04-09 15:52:47,072 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [77f2fb37] Adding task 9a462b08-9d13-4968-8ac6-c211eec89255 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:52:47,165 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [77f2fb37] Correlation ID: fd8787b, Job ID: b39cdc23-f050-4cfb-b0f9-1febd2c8f0d3, Call Stack: null, Custom Event ID: -1, Message: VM dc-vm-rn was successfully removed. >2014-04-09 15:52:47,165 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [77f2fb37] BaseAsyncTask::StartPollingTask: Starting to poll task 9a462b08-9d13-4968-8ac6-c211eec89255. >2014-04-09 15:52:49,520 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-17) [3c6e067] Lock Acquired to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 15:52:49,621 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [3c6e067] Running command: RemoveVmCommand internal: false. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 15:52:49,622 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [3c6e067] START, SetVmStatusVDSCommand( vmId = 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc, status = ImageLocked), log id: 3b075564 >2014-04-09 15:52:49,627 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [3c6e067] FINISH, SetVmStatusVDSCommand, log id: 3b075564 >2014-04-09 15:52:49,638 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [3c6e067] Lock freed to object EngineLock [exclusiveLocks= key: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc value: VM >, sharedLocks= ] >2014-04-09 15:52:49,658 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-50) [39dbb054] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 9efd6c2a-c1cc-4cde-8dff-ea9d8eb56acc Type: VM >2014-04-09 15:52:49,674 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-50) [19882e4a] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-09 15:52:49,689 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [19882e4a] START, DeleteImageGroupVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, imageGroupId = 5d1d405b-6c8d-4973-8e80-c11555885cc5, postZeros = false, forceDelete = false), log id: 1c8ae21c >2014-04-09 15:52:51,067 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [19882e4a] FINISH, DeleteImageGroupVDSCommand, log id: 1c8ae21c >2014-04-09 15:52:51,127 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [19882e4a] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command a187456a-211e-4cb2-b1b1-2f7afbcac9e3 >2014-04-09 15:52:51,128 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [19882e4a] CommandMultiAsyncTasks::AttachTask: Attaching task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c to command a187456a-211e-4cb2-b1b1-2f7afbcac9e3. >2014-04-09 15:52:51,146 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [19882e4a] Adding task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-09 15:52:51,255 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [19882e4a] Correlation ID: 3c6e067, Job ID: 5e603c20-edc9-442d-b487-adf9b40de717, Call Stack: null, Custom Event ID: -1, Message: VM vm_vnc was successfully removed. >2014-04-09 15:52:51,255 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [19882e4a] BaseAsyncTask::StartPollingTask: Starting to poll task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c. >2014-04-09 15:52:52,201 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-04-09 15:52:52,245 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) SPMAsyncTask::PollTask: Polling task 9a462b08-9d13-4968-8ac6-c211eec89255 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:52:52,263 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) BaseAsyncTask::OnTaskEndSuccess: Task 9a462b08-9d13-4968-8ac6-c211eec89255 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:52:52,263 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndActionIfNecessary: All tasks of command ecdf1da9-b8b2-4b8e-95ec-51fc4916faa3 has ended -> executing EndAction >2014-04-09 15:52:52,264 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: ecdf1da9-b8b2-4b8e-95ec-51fc4916faa3): calling EndAction . >2014-04-09 15:52:52,264 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) SPMAsyncTask::PollTask: Polling task f97bd6a6-34b0-49bd-8414-15e71386107f (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:52:52,264 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-09 15:52:52,271 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) BaseAsyncTask::OnTaskEndSuccess: Task f97bd6a6-34b0-49bd-8414-15e71386107f (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:52:52,272 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndActionIfNecessary: All tasks of command e5696c3f-9486-46f1-8c00-7506c7b0a83b has ended -> executing EndAction >2014-04-09 15:52:52,272 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: e5696c3f-9486-46f1-8c00-7506c7b0a83b): calling EndAction . >2014-04-09 15:52:52,272 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) SPMAsyncTask::PollTask: Polling task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-09 15:52:52,272 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-09 15:52:52,288 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) BaseAsyncTask::OnTaskEndSuccess: Task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-09 15:52:52,288 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndActionIfNecessary: All tasks of command a187456a-211e-4cb2-b1b1-2f7afbcac9e3 has ended -> executing EndAction >2014-04-09 15:52:52,289 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: a187456a-211e-4cb2-b1b1-2f7afbcac9e3): calling EndAction . >2014-04-09 15:52:52,289 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-09 15:52:52,297 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-09 15:52:52,297 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-09 15:52:52,298 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-09 15:52:52,298 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-09 15:52:52,298 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-09 15:52:52,299 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-09 15:52:52,305 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 9a462b08-9d13-4968-8ac6-c211eec89255 >2014-04-09 15:52:52,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = 9a462b08-9d13-4968-8ac6-c211eec89255), log id: 2b548d0a >2014-04-09 15:52:52,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=9a462b08-9d13-4968-8ac6-c211eec89255), log id: 3bf7a1bf >2014-04-09 15:52:52,313 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task f97bd6a6-34b0-49bd-8414-15e71386107f >2014-04-09 15:52:52,313 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-46) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-09 15:52:52,314 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = f97bd6a6-34b0-49bd-8414-15e71386107f), log id: 2fc1847e >2014-04-09 15:52:52,315 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-09 15:52:52,315 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-09 15:52:52,321 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c >2014-04-09 15:52:52,322 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) START, SPMClearTaskVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, taskId = bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c), log id: 2a1eca0 >2014-04-09 15:52:52,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 3bf7a1bf >2014-04-09 15:52:52,332 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 2b548d0a >2014-04-09 15:52:52,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c), log id: 54b5fdb9 >2014-04-09 15:52:52,338 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 9a462b08-9d13-4968-8ac6-c211eec89255 from DataBase >2014-04-09 15:52:52,338 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ecdf1da9-b8b2-4b8e-95ec-51fc4916faa3 >2014-04-09 15:52:52,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-46) FINISH, HSMClearTaskVDSCommand, log id: 54b5fdb9 >2014-04-09 15:52:52,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-46) FINISH, SPMClearTaskVDSCommand, log id: 2a1eca0 >2014-04-09 15:52:52,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, taskId=f97bd6a6-34b0-49bd-8414-15e71386107f), log id: 3ae3e7a1 >2014-04-09 15:52:52,355 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-46) BaseAsyncTask::RemoveTaskFromDB: Removed task bab8f5ce-e7d7-44c5-9b6a-bfda96425d2c from DataBase >2014-04-09 15:52:52,355 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-46) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity a187456a-211e-4cb2-b1b1-2f7afbcac9e3 >2014-04-09 15:52:52,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 3ae3e7a1 >2014-04-09 15:52:52,358 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 2fc1847e >2014-04-09 15:52:52,363 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task f97bd6a6-34b0-49bd-8414-15e71386107f from DataBase >2014-04-09 15:52:52,363 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity e5696c3f-9486-46f1-8c00-7506c7b0a83b >2014-04-09 15:52:52,691 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-8) [24496580] Lock Acquired to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:52:52,746 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [24496580] Running command: RemoveVmCommand internal: false. Entities affected : ID: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 Type: VM >2014-04-09 15:52:52,747 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [24496580] START, SetVmStatusVDSCommand( vmId = 14a1d5e6-7bf8-49cd-beef-9509b0f2af82, status = ImageLocked), log id: 7c334694 >2014-04-09 15:52:52,752 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [24496580] FINISH, SetVmStatusVDSCommand, log id: 7c334694 >2014-04-09 15:52:52,755 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [24496580] Lock freed to object EngineLock [exclusiveLocks= key: 14a1d5e6-7bf8-49cd-beef-9509b0f2af82 value: VM >, sharedLocks= ] >2014-04-09 15:52:52,796 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [24496580] Correlation ID: 24496580, Job ID: 9ba35736-be63-4d9b-85e0-e6a7a30598d5, Call Stack: null, Custom Event ID: -1, Message: VM vm_dl was successfully removed. >2014-04-09 15:53:10,728 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-11) [52e5c9f6] Lock Acquired to object EngineLock [exclusiveLocks= key: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 value: STORAGE >, sharedLocks= ] >2014-04-09 15:53:10,787 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (pool-4-thread-47) [52e5c9f6] Running command: ForceRemoveStorageDomainCommand internal: false. Entities affected : ID: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 Type: Storage >2014-04-09 15:53:10,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (pool-4-thread-47) [52e5c9f6] START, DetachStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7a3c7740-81a1-4969-ad72-791dd92cbcb3, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = -1, force = true), log id: 64526b60 >2014-04-09 15:53:11,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (pool-4-thread-47) [52e5c9f6] FINISH, DetachStorageDomainVDSCommand, log id: 64526b60 >2014-04-09 15:53:11,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (pool-4-thread-47) [52e5c9f6] START, ResetISOPathVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false), log id: 570a2f5f >2014-04-09 15:53:11,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (pool-4-thread-47) [52e5c9f6] FINISH, ResetISOPathVDSCommand, log id: 570a2f5f >2014-04-09 15:53:11,564 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [52e5c9f6] Correlation ID: 52e5c9f6, Job ID: 50788050-4cec-4ca4-b397-bd6b390250b6, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISO was forcibly removed by admin@internal >2014-04-09 15:53:11,573 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (pool-4-thread-47) [52e5c9f6] Lock freed to object EngineLock [exclusiveLocks= key: 7a3c7740-81a1-4969-ad72-791dd92cbcb3 value: STORAGE >, sharedLocks= ] >2014-04-09 15:53:24,118 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [19dbaeae] Lock Acquired to object EngineLock [exclusiveLocks= key: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 value: STORAGE >, sharedLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >] >2014-04-09 15:53:24,207 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-48) [19dbaeae] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 15:53:24,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (pool-4-thread-48) [19dbaeae] START, DeactivateStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 4f6819b1 >2014-04-09 15:53:25,542 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [7f482310] Failed to Acquire Lock to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >, sharedLocks= ] >2014-04-09 15:53:25,542 WARN [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [7f482310] CanDoAction of action DeactivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ACTION_TYPE_FAILED_OBJECT_LOCKED >2014-04-09 15:53:26,907 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (pool-4-thread-48) [19dbaeae] FINISH, DeactivateStorageDomainVDSCommand, log id: 4f6819b1 >2014-04-09 15:53:26,907 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-48) [19dbaeae] Lock freed to object EngineLock [exclusiveLocks= key: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 value: STORAGE >, sharedLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >] >2014-04-09 15:53:26,916 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-4-thread-46) [19dbaeae] After deactivate treatment vds: DC-85.218,pool dc_iscsi >2014-04-09 15:53:26,916 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (pool-4-thread-50) [19dbaeae] After deactivate treatment vds: DC-85.215,pool dc_iscsi >2014-04-09 15:53:26,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [19dbaeae] START, RefreshStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: fdc8fc0 >2014-04-09 15:53:26,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-46) [19dbaeae] START, RefreshStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, masterStorageDomainId=e5613c67-ce49-4a35-b8f2-2df469d0fc78, masterVersion=1), log id: 44f6950a >2014-04-09 15:53:27,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-50) [19dbaeae] FINISH, RefreshStoragePoolVDSCommand, log id: fdc8fc0 >2014-04-09 15:53:28,458 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-2) [4ff7734e] Lock Acquired to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >, sharedLocks= ] >2014-04-09 15:53:28,522 WARN [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-2) [4ff7734e] CanDoAction of action DeactivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_MASTER_WITH_LOCKED_DOMAINS >2014-04-09 15:53:28,522 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-2) [4ff7734e] Lock freed to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >, sharedLocks= ] >2014-04-09 15:53:45,888 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-47) [59e2ba1e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 15:53:45,892 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-47) [59e2ba1e] START, SetVdsStatusVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 1e05821c >2014-04-09 15:53:45,903 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-47) [59e2ba1e] FINISH, SetVdsStatusVDSCommand, log id: 1e05821c >2014-04-09 15:53:45,953 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-47) [59e2ba1e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 15:53:45,970 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [59e2ba1e] Correlation ID: 59e2ba1e, Job ID: d3d0e665-af70-4e90-b082-6d5e613e89c3, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.218 was switched to Maintenance mode by admin@internal. >2014-04-09 15:53:48,199 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-13) [809f930] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >] >2014-04-09 15:53:48,241 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-44) [809f930] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 15:53:48,245 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-44) [809f930] START, SetVdsStatusVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 4499a365 >2014-04-09 15:53:48,252 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-44) [809f930] VDS DC-85.215 is spm and moved from up calling ResetIrs. >2014-04-09 15:53:48,253 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-44) [809f930] START, ResetIrsVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, vdsId = 6c442434-1073-4f29-a3bd-c20b77a28d91, ignoreStopFailed = false), log id: 29c1a6a5 >2014-04-09 15:53:48,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-44) [809f930] START, SpmStopVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f), log id: 4354bcf >2014-04-09 15:53:48,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-44) [809f930] SpmStopVDSCommand::Stopping SPM on vds DC-85.215, pool id 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f >2014-04-09 15:53:48,683 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-22) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = ad1b4923-fe33-4a29-a5a2-01e43e851736 : DC-85.218 >2014-04-09 15:53:48,722 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) Clearing cache of pool: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f for problematic entities of VDS: DC-85.218. >2014-04-09 15:53:48,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-22) START, DisconnectStoragePoolVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, vds_spm_id = 2), log id: 7fd168e2 >2014-04-09 15:53:49,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-44) [809f930] FINISH, SpmStopVDSCommand, log id: 4354bcf >2014-04-09 15:53:49,538 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-44) [809f930] FINISH, ResetIrsVDSCommand, log id: 29c1a6a5 >2014-04-09 15:53:49,538 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-44) [809f930] FINISH, SetVdsStatusVDSCommand, log id: 4499a365 >2014-04-09 15:53:49,538 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-44) [809f930] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f value: POOL >] >2014-04-09 15:53:49,573 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-10) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 6c442434-1073-4f29-a3bd-c20b77a28d91 : DC-85.215 >2014-04-09 15:53:49,604 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-44) [809f930] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 15:53:49,619 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) [809f930] Correlation ID: 809f930, Job ID: d353b545-955d-4d33-a917-33b072cee71c, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.215 was switched to Maintenance mode by admin@internal. >2014-04-09 15:53:49,633 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-35) Clearing cache of pool: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f for problematic entities of VDS: DC-85.215. >2014-04-09 15:53:49,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-10) START, DisconnectStoragePoolVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, vds_spm_id = 3), log id: 3f6ab8cf >2014-04-09 15:53:52,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-46) [19dbaeae] FINISH, RefreshStoragePoolVDSCommand, log id: 44f6950a >2014-04-09 15:53:52,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-46) [19dbaeae] START, DisconnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: bef1546e-0fbb-46d2-acf2-7ff7d2182d93, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-44f1f7d03-8e7f49b42085281e-s3-jiahu-265383-2, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74cd4223 >2014-04-09 15:53:54,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, DisconnectStoragePoolVDSCommand, log id: 3f6ab8cf >2014-04-09 15:53:54,227 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-10) [2f699e05] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 15:53:54,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-10) [2f699e05] START, DisconnectStorageServerVDSCommand(HostName = DC-85.215, HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: 9cfbeb6a-9870-4034-bc38-385f924f0d70, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 23c18d54 >2014-04-09 15:53:57,667 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-18) [ecbeb05] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 15:53:57,685 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [ecbeb05] Correlation ID: ecbeb05, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center dc_iscsi. Setting status to Non Responsive. >2014-04-09 15:53:58,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, DisconnectStoragePoolVDSCommand, log id: 7fd168e2 >2014-04-09 15:53:58,014 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-22) [4902995d] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 15:53:58,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-22) [4902995d] START, DisconnectStorageServerVDSCommand(HostName = DC-85.218, HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736, storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, storageType = ISCSI, connectionList = [{ id: 9cfbeb6a-9870-4034-bc38-385f924f0d70, connection: 10.66.90.100, iqn: iqn.2001-05.com.equallogic:0-8a0906-9951f7d03-34cf49b25f04f94b-libvirt-2-150313, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 27b9d2aa >2014-04-09 15:54:00,017 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [2c464907] Lock Acquired to object EngineLock [exclusiveLocks= key: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 value: STORAGE >, sharedLocks= ] >2014-04-09 15:54:00,126 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (pool-4-thread-44) [2c464907] Running command: ForceRemoveStorageDomainCommand internal: false. Entities affected : ID: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 Type: Storage >2014-04-09 15:54:00,127 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (pool-4-thread-44) [2c464907] START, DetachStorageDomainVDSCommand( storagePoolId = 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f, ignoreFailoverLimit = false, storageDomainId = 7cee4e2f-9997-4578-8396-c3aabb03d4c6, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = -1, force = true), log id: 198dcf38 >2014-04-09 15:54:00,146 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (pool-4-thread-44) [2c464907] FINISH, DetachStorageDomainVDSCommand, log id: 198dcf38 >2014-04-09 15:54:00,146 ERROR [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (pool-4-thread-44) [2c464907] Could not force detach storage domain dc_ISCSI_2. error: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: Cannot allocate IRS server (Failed with error IRS_REPOSITORY_NOT_FOUND and code 5009) >2014-04-09 15:54:00,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-10) [2f699e05] FINISH, DisconnectStorageServerVDSCommand, return: {9cfbeb6a-9870-4034-bc38-385f924f0d70=0}, log id: 23c18d54 >2014-04-09 15:54:00,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) [2c464907] Correlation ID: 2c464907, Job ID: 8d23c1b8-9e51-4cd3-82aa-c32d5d19b6cf, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_2 was forcibly removed by admin@internal >2014-04-09 15:54:00,268 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (pool-4-thread-44) [2c464907] Lock freed to object EngineLock [exclusiveLocks= key: 7cee4e2f-9997-4578-8396-c3aabb03d4c6 value: STORAGE >, sharedLocks= ] >2014-04-09 15:54:01,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (pool-4-thread-46) [19dbaeae] FINISH, DisconnectStorageServerVDSCommand, return: {bef1546e-0fbb-46d2-acf2-7ff7d2182d93=0}, log id: 74cd4223 >2014-04-09 15:54:01,676 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [19dbaeae] Correlation ID: 19dbaeae, Job ID: 0c3342d0-c0b8-43be-b8f0-d16d0270fb64, Call Stack: null, Custom Event ID: -1, Message: Storage Domain dc_ISCSI_2 (Data Center dc_iscsi) was deactivated by admin@internal >2014-04-09 15:54:05,023 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [5feef8c1] Lock Acquired to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >, sharedLocks= ] >2014-04-09 15:54:05,102 WARN [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [5feef8c1] CanDoAction of action ForceRemoveStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DESTROY_DOMAIN,ERROR_CANNOT_DESTROY_LAST_STORAGE_DOMAIN >2014-04-09 15:54:05,102 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-6) [5feef8c1] Lock freed to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >, sharedLocks= ] >2014-04-09 15:54:08,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-22) [4902995d] FINISH, DisconnectStorageServerVDSCommand, return: {9cfbeb6a-9870-4034-bc38-385f924f0d70=0}, log id: 27b9d2aa >2014-04-09 15:54:11,223 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-16) [48722323] Lock Acquired to object EngineLock [exclusiveLocks= key: 6c442434-1073-4f29-a3bd-c20b77a28d91 value: VDS >, sharedLocks= ] >2014-04-09 15:54:11,230 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-50) [48722323] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 6c442434-1073-4f29-a3bd-c20b77a28d91 Type: VDS >2014-04-09 15:54:11,279 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-50) [48722323] START, RemoveVdsVDSCommand( HostId = 6c442434-1073-4f29-a3bd-c20b77a28d91), log id: 6a93311d >2014-04-09 15:54:11,280 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-50) [48722323] vdsManager::disposing >2014-04-09 15:54:11,280 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-50) [48722323] FINISH, RemoveVdsVDSCommand, log id: 6a93311d >2014-04-09 15:54:11,292 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [48722323] Correlation ID: 48722323, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.215 was removed by admin@internal. >2014-04-09 15:54:11,293 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-50) [48722323] Lock freed to object EngineLock [exclusiveLocks= key: 6c442434-1073-4f29-a3bd-c20b77a28d91 value: VDS >, sharedLocks= ] >2014-04-09 15:54:13,026 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-23) [40980259] Setting new tasks map. The map contains now 0 tasks >2014-04-09 15:54:13,027 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-23) [40980259] Cleared all tasks of pool 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f. >2014-04-09 15:54:13,988 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-10) [4c737b2] Lock Acquired to object EngineLock [exclusiveLocks= key: ad1b4923-fe33-4a29-a5a2-01e43e851736 value: VDS >, sharedLocks= ] >2014-04-09 15:54:13,994 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-50) [4c737b2] Running command: RemoveVdsCommand internal: false. Entities affected : ID: ad1b4923-fe33-4a29-a5a2-01e43e851736 Type: VDS >2014-04-09 15:54:14,072 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-50) [4c737b2] START, RemoveVdsVDSCommand( HostId = ad1b4923-fe33-4a29-a5a2-01e43e851736), log id: 291e9bfa >2014-04-09 15:54:14,072 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-50) [4c737b2] vdsManager::disposing >2014-04-09 15:54:14,073 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-50) [4c737b2] FINISH, RemoveVdsVDSCommand, log id: 291e9bfa >2014-04-09 15:54:14,083 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [4c737b2] Correlation ID: 4c737b2, Call Stack: null, Custom Event ID: -1, Message: Host DC-85.218 was removed by admin@internal. >2014-04-09 15:54:14,084 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-50) [4c737b2] Lock freed to object EngineLock [exclusiveLocks= key: ad1b4923-fe33-4a29-a5a2-01e43e851736 value: VDS >, sharedLocks= ] >2014-04-09 15:54:26,718 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-10) [28a9606c] Lock Acquired to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >, sharedLocks= ] >2014-04-09 15:54:26,730 WARN [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-10) [28a9606c] CanDoAction of action ForceRemoveStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DESTROY_DOMAIN,ERROR_CANNOT_DESTROY_LAST_STORAGE_DOMAIN >2014-04-09 15:54:26,730 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (ajp-/127.0.0.1:8702-10) [28a9606c] Lock freed to object EngineLock [exclusiveLocks= key: e5613c67-ce49-4a35-b8f2-2df469d0fc78 value: STORAGE >, sharedLocks= ] >2014-04-09 15:54:37,940 WARN [org.ovirt.engine.core.bll.storage.RemoveStoragePoolCommand] (ajp-/127.0.0.1:8702-13) [7701e771] CanDoAction of action RemoveStoragePool failed. Reasons:VAR__TYPE__STORAGE__POOL,VAR__ACTION__REMOVE,ACTION_TYPE_FAILED_NO_VDS_IN_POOL >2014-04-09 15:54:50,979 INFO [org.ovirt.engine.core.bll.storage.RemoveStoragePoolCommand] (ajp-/127.0.0.1:8702-1) [76d9be71] Running command: RemoveStoragePoolCommand internal: false. Entities affected : ID: 0370c3b5-a8a0-4e18-88e3-4ede4eb9f12f Type: StoragePool >2014-04-09 15:54:51,221 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [76d9be71] Correlation ID: 76d9be71, Job ID: 5fe1fea4-f7a2-4b02-82ee-98cdf3464bf6, Call Stack: null, Custom Event ID: -1, Message: Data Center dc_iscsi was forcibly removed by admin@internal >2014-04-09 15:55:52,937 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 16:10:33,697 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [6079cede] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 16:25:55,842 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-87) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 16:37:09,906 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-10) [2f699e05] Start refreshing all users data >2014-04-09 16:37:11,156 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-04-09 16:37:11,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 16:37:11,173 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 16:37:11,173 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 16:37:11,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 16:37:11,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 16:37:11,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 16:40:33,895 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-50) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 16:55:57,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 17:10:37,294 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-92) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 17:26:00,948 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 17:37:09,912 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-56) Start refreshing all users data >2014-04-09 17:37:11,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-04-09 17:37:11,180 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 17:37:11,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 17:37:11,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 17:37:11,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 17:37:11,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 17:37:11,197 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 17:40:39,026 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-89) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 17:56:16,468 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 18:10:41,064 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-67) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 18:26:17,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 18:37:09,916 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) Start refreshing all users data >2014-04-09 18:37:11,197 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-04-09 18:37:11,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 18:37:11,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 18:37:11,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 18:37:11,216 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 18:37:11,216 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 18:37:11,218 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 18:40:41,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-57) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 18:56:32,657 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-34) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 19:10:56,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [40980259] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 19:26:47,429 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 19:37:09,920 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) Start refreshing all users data >2014-04-09 19:37:11,223 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-04-09 19:37:11,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 19:37:11,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 19:37:11,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 19:37:11,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 19:37:11,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 19:37:11,230 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 19:41:01,217 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-20) [211fe558] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 19:56:54,293 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 20:11:02,607 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-82) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 20:26:54,568 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 20:37:09,923 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-53) Start refreshing all users data >2014-04-09 20:37:11,231 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Attempting to update VMs/Templates Ovf. >2014-04-09 20:37:11,233 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 20:37:11,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 20:37:11,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 20:37:11,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 20:37:11,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 20:37:11,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) [29d39d31] Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 20:41:03,323 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 20:56:55,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 21:11:05,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 21:27:10,340 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-77) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 21:37:09,999 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-8) Start refreshing all users data >2014-04-09 21:37:11,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-04-09 21:37:11,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 21:37:11,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 21:37:11,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 21:37:11,257 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 21:37:11,257 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 21:37:11,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 21:41:08,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 21:57:17,157 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 22:11:14,695 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-45) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 22:27:23,715 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 22:37:10,069 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-59) Start refreshing all users data >2014-04-09 22:37:11,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-04-09 22:37:11,261 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 22:37:11,263 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 22:37:11,263 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 22:37:11,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 22:37:11,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 22:37:11,266 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 22:41:22,961 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 22:57:29,006 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 23:11:32,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 23:27:35,785 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-09 23:37:10,073 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-51) Start refreshing all users data >2014-04-09 23:37:11,266 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-04-09 23:37:11,269 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-09 23:37:11,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-09 23:37:11,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-09 23:37:11,286 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-09 23:37:11,286 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 23:37:11,287 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-09 23:41:34,615 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-09 23:57:38,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-72) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 00:11:39,645 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 00:27:42,602 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 00:37:10,102 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-59) Start refreshing all users data >2014-04-10 00:37:11,287 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-04-10 00:37:11,289 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 00:37:11,297 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 00:37:11,297 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 00:37:11,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 00:37:11,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 00:37:11,303 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 00:41:44,075 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-58) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 00:57:46,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 01:11:47,258 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-51) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 01:27:49,841 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 01:37:10,106 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Start refreshing all users data >2014-04-10 01:37:11,305 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-04-10 01:37:11,307 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 01:37:11,309 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 01:37:11,309 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 01:37:11,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 01:37:11,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 01:37:11,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 01:41:59,606 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 01:57:52,539 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 02:12:00,966 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 02:27:56,655 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 02:37:10,110 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-75) Start refreshing all users data >2014-04-10 02:37:11,313 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-04-10 02:37:11,314 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 02:37:11,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 02:37:11,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 02:37:11,317 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 02:37:11,317 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 02:37:11,319 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 02:42:01,346 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 02:57:58,761 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) [68dc1a40] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 03:12:03,036 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 03:28:13,991 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-13) Start deleteAgedOutAuditLogs >2014-04-10 03:35:35,017 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-13) Finished deleteAgedOutAuditLogs >2014-04-10 03:37:10,115 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-53) Start refreshing all users data >2014-04-10 03:37:11,320 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-04-10 03:37:11,322 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 03:37:11,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 03:37:11,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 03:37:11,325 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 03:37:11,325 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 03:37:11,327 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 03:42:05,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-44) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 03:58:16,485 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-47) [1ad889f5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 04:12:06,201 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 04:28:23,518 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 04:37:10,120 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-87) Start refreshing all users data >2014-04-10 04:37:11,328 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Attempting to update VMs/Templates Ovf. >2014-04-10 04:37:11,331 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 04:37:11,334 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 04:37:11,334 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 04:37:11,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 04:37:11,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 04:37:11,337 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [cc3164a] Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 04:42:07,443 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 04:58:25,533 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 05:12:07,709 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-85) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 05:28:26,256 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 05:37:10,124 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-14) [cc3164a] Start refreshing all users data >2014-04-10 05:37:11,337 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-04-10 05:37:11,339 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 05:37:11,341 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 05:37:11,341 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 05:37:11,343 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 05:37:11,343 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 05:37:11,344 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 05:42:22,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 05:58:32,911 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 06:12:30,136 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [127d87cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 06:28:35,305 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [ecbeb05] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 06:37:10,129 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-87) Start refreshing all users data >2014-04-10 06:37:11,345 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-04-10 06:37:11,346 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 06:37:11,348 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 06:37:11,348 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 06:37:11,350 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 06:37:11,350 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 06:37:11,351 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 06:42:32,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-57) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 06:58:45,750 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-90) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 07:12:37,969 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 07:28:50,684 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-57) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 07:37:10,134 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-33) Start refreshing all users data >2014-04-10 07:37:11,352 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-04-10 07:37:11,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 07:37:11,356 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 07:37:11,356 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 07:37:11,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 07:37:11,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 07:37:11,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 07:42:38,817 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [40980259] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 07:58:51,780 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-92) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 08:12:53,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-49) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 08:28:54,394 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 08:37:10,138 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-57) Start refreshing all users data >2014-04-10 08:37:11,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-04-10 08:37:11,362 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 08:37:11,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 08:37:11,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 08:37:11,366 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 08:37:11,366 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 08:37:11,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 08:42:55,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 08:58:55,693 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 09:12:57,426 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 09:29:01,000 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 09:37:10,142 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-96) Start refreshing all users data >2014-04-10 09:37:11,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-04-10 09:37:11,369 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 09:37:11,371 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 09:37:11,371 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 09:37:11,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 09:37:11,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 09:37:11,374 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 09:43:02,981 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-38) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 09:59:06,067 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 10:13:15,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-85) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 10:29:07,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-95) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 10:37:10,145 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-87) Start refreshing all users data >2014-04-10 10:37:11,374 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-04-10 10:37:11,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 10:37:11,378 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 10:37:11,378 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 10:37:11,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 10:37:11,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 10:37:11,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 10:43:22,634 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 10:59:11,428 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 11:13:29,658 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [6079cede] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 11:29:14,361 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 11:37:10,149 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-24) Start refreshing all users data >2014-04-10 11:37:11,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-04-10 11:37:11,386 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 11:37:11,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 11:37:11,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 11:37:11,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 11:37:11,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 11:37:11,391 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 11:43:35,707 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 11:59:14,944 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 12:13:36,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-46) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 12:29:18,611 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 12:37:10,153 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-49) Start refreshing all users data >2014-04-10 12:37:11,391 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-04-10 12:37:11,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 12:37:11,395 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 12:37:11,395 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 12:37:11,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 12:37:11,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 12:37:11,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 12:43:36,675 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 12:59:29,591 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 13:13:38,890 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 13:29:33,176 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-55) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 13:37:10,157 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-3) Start refreshing all users data >2014-04-10 13:37:11,399 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-04-10 13:37:11,400 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 13:37:11,401 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 13:37:11,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 13:37:11,403 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 13:37:11,403 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 13:37:11,404 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 13:43:47,728 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [2610ec1f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 13:59:36,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-58) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.32 [1017 MB] is under defined threshold [1024 MB]. >2014-04-10 14:03:35,509 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginAdminUserCommand internal: false. >2014-04-10 14:03:35,570 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 14:03:35,706 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginUserCommand internal: false. >2014-04-10 14:03:35,728 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 14:03:59,630 INFO [org.ovirt.engine.core.bll.RemoveVdsGroupCommand] (pool-4-thread-50) [2a34a6bd] Running command: RemoveVdsGroupCommand internal: false. Entities affected : ID: 49b0b7ef-14eb-407d-92a7-9af77d09236a Type: VdsGroups >2014-04-10 14:03:59,675 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [2a34a6bd] Correlation ID: 2a34a6bd, Call Stack: null, Custom Event ID: -1, Message: Host cluster dc_iscsi was removed by admin@internal >2014-04-10 14:04:09,508 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-15) [497b3a50] Lock Acquired to object EngineLock [exclusiveLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM >, sharedLocks= ] >2014-04-10 14:04:09,699 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [497b3a50] Running command: RemoveVmCommand internal: false. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM >2014-04-10 14:04:09,699 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [497b3a50] START, SetVmStatusVDSCommand( vmId = a3a055b8-512e-47e3-95ec-2a8cfd338eb4, status = ImageLocked), log id: 3f45a557 >2014-04-10 14:04:09,704 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [497b3a50] FINISH, SetVmStatusVDSCommand, log id: 3f45a557 >2014-04-10 14:04:09,707 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [497b3a50] Lock freed to object EngineLock [exclusiveLocks= key: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 value: VM >, sharedLocks= ] >2014-04-10 14:04:09,808 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-50) [2eeb65bb] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: a3a055b8-512e-47e3-95ec-2a8cfd338eb4 Type: VM >2014-04-10 14:04:09,819 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-50) [9e7a21b] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-10 14:04:09,831 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [9e7a21b] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = 0c0fd37f-6e74-4837-84c6-66e9d7ca9a89, postZeros = false, forceDelete = false), log id: 3b3bd45e >2014-04-10 14:04:10,011 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [9e7a21b] FINISH, DeleteImageGroupVDSCommand, log id: 3b3bd45e >2014-04-10 14:04:10,043 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [9e7a21b] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command aaac2d9a-0033-4d33-9ede-7db9cae21a1f >2014-04-10 14:04:10,043 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [9e7a21b] CommandMultiAsyncTasks::AttachTask: Attaching task d1737d24-ca0e-42ab-a340-746fa6c222cd to command aaac2d9a-0033-4d33-9ede-7db9cae21a1f. >2014-04-10 14:04:10,056 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [9e7a21b] Adding task d1737d24-ca0e-42ab-a340-746fa6c222cd (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 14:04:10,200 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [9e7a21b] Correlation ID: 497b3a50, Job ID: a7d9a218-3035-448c-8af3-5a2490ba1e39, Call Stack: null, Custom Event ID: -1, Message: VM vm4 was successfully removed. >2014-04-10 14:04:10,200 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [9e7a21b] BaseAsyncTask::StartPollingTask: Starting to poll task d1737d24-ca0e-42ab-a340-746fa6c222cd. >2014-04-10 14:04:14,130 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) [211fe558] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-10 14:04:14,151 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] SPMAsyncTask::PollTask: Polling task d1737d24-ca0e-42ab-a340-746fa6c222cd (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 14:04:14,183 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] BaseAsyncTask::OnTaskEndSuccess: Task d1737d24-ca0e-42ab-a340-746fa6c222cd (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 14:04:14,183 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] CommandAsyncTask::EndActionIfNecessary: All tasks of command aaac2d9a-0033-4d33-9ede-7db9cae21a1f has ended -> executing EndAction >2014-04-10 14:04:14,183 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) [211fe558] CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: aaac2d9a-0033-4d33-9ede-7db9cae21a1f): calling EndAction . >2014-04-10 14:04:14,183 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [211fe558] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-10 14:04:14,208 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [211fe558] Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-10 14:04:14,211 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-10 14:04:14,211 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-10 14:04:14,314 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d1737d24-ca0e-42ab-a340-746fa6c222cd >2014-04-10 14:04:14,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = d1737d24-ca0e-42ab-a340-746fa6c222cd), log id: 13d73172 >2014-04-10 14:04:14,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=d1737d24-ca0e-42ab-a340-746fa6c222cd), log id: 14ef3d8b >2014-04-10 14:04:14,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 14ef3d8b >2014-04-10 14:04:14,330 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 13d73172 >2014-04-10 14:04:14,358 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task d1737d24-ca0e-42ab-a340-746fa6c222cd from DataBase >2014-04-10 14:04:14,358 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity aaac2d9a-0033-4d33-9ede-7db9cae21a1f >2014-04-10 14:04:16,507 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [71701bb] Running command: ShutdownVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-10 14:04:16,510 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [71701bb] Entered (VM vm3). >2014-04-10 14:04:16,510 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [71701bb] Sending shutdown command for VM vm3. >2014-04-10 14:04:16,512 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [71701bb] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=30, gracefully=true), log id: 74ce59dc >2014-04-10 14:04:16,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [71701bb] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=30, gracefully=true), log id: 71350252 >2014-04-10 14:04:16,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [71701bb] FINISH, DestroyVDSCommand, log id: 71350252 >2014-04-10 14:04:16,541 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [71701bb] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 74ce59dc >2014-04-10 14:04:16,549 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [71701bb] Correlation ID: 71701bb, Job ID: 502ede86-4f77-4ab9-b69b-a9853fcbb074, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin@internal on VM vm3 (Host: 10.66.106.40). >2014-04-10 14:04:20,032 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [4b3f6d5b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-10 14:04:20,290 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [4b3f6d5b] Entered (VM vm2). >2014-04-10 14:04:20,290 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [4b3f6d5b] Sending shutdown command for VM vm2. >2014-04-10 14:04:20,293 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [4b3f6d5b] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, force=false, secondsToWait=30, gracefully=true), log id: 5ce41fe1 >2014-04-10 14:04:20,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [4b3f6d5b] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, force=false, secondsToWait=30, gracefully=true), log id: 5b1437b8 >2014-04-10 14:04:20,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [4b3f6d5b] FINISH, DestroyVDSCommand, log id: 5b1437b8 >2014-04-10 14:04:20,340 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [4b3f6d5b] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 5ce41fe1 >2014-04-10 14:04:20,357 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [4b3f6d5b] Correlation ID: 4b3f6d5b, Job ID: 672ef2d4-9476-441d-be57-0b162596b117, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin@internal on VM vm2 (Host: 10.66.106.40). >2014-04-10 14:04:23,382 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [30240541] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-10 14:04:23,390 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [30240541] Entered (VM vm1). >2014-04-10 14:04:23,390 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-50) [30240541] Sending shutdown command for VM vm1. >2014-04-10 14:04:23,394 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [30240541] START, DestroyVmVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=30, gracefully=true), log id: 5e1d817 >2014-04-10 14:04:23,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [30240541] START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=30, gracefully=true), log id: 7189db5f >2014-04-10 14:04:23,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [30240541] FINISH, DestroyVDSCommand, log id: 7189db5f >2014-04-10 14:04:23,423 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [30240541] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 5e1d817 >2014-04-10 14:04:23,648 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [30240541] Correlation ID: 30240541, Job ID: 664e110f-b840-42c2-9598-707b7601934f, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin@internal on VM vm1 (Host: 10.66.106.32). >2014-04-10 14:04:33,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-87) START, DestroyVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, vmId=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, force=false, secondsToWait=0, gracefully=false), log id: 4ac0ffeb >2014-04-10 14:04:33,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, DestroyVDSCommand, log id: 4ac0ffeb >2014-04-10 14:04:33,558 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-87) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 is down. Exit message: User shut down >2014-04-10 14:04:33,560 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.106.32 >2014-04-10 14:04:38,570 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-15) [7cf60f32] Lock Acquired to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-10 14:04:38,928 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [7cf60f32] Running command: RemoveVmCommand internal: false. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-10 14:04:38,929 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [7cf60f32] START, SetVmStatusVDSCommand( vmId = 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f, status = ImageLocked), log id: 3e0c258c >2014-04-10 14:04:38,934 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [7cf60f32] FINISH, SetVmStatusVDSCommand, log id: 3e0c258c >2014-04-10 14:04:38,945 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [7cf60f32] Lock freed to object EngineLock [exclusiveLocks= key: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f value: VM >, sharedLocks= ] >2014-04-10 14:04:39,013 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-50) [171d83ac] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f Type: VM >2014-04-10 14:04:39,026 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-50) [7b62e43e] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-10 14:04:39,037 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [7b62e43e] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = d84232e1-e105-4c7e-8657-28d777960e4e, postZeros = false, forceDelete = false), log id: 559af29 >2014-04-10 14:04:39,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [7b62e43e] FINISH, DeleteImageGroupVDSCommand, log id: 559af29 >2014-04-10 14:04:39,143 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [7b62e43e] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 89ffa995-e436-4dfc-b03a-075c4d472d77 >2014-04-10 14:04:39,143 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [7b62e43e] CommandMultiAsyncTasks::AttachTask: Attaching task 37f9af5d-9958-4332-80b7-62f823de6429 to command 89ffa995-e436-4dfc-b03a-075c4d472d77. >2014-04-10 14:04:39,162 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [7b62e43e] Adding task 37f9af5d-9958-4332-80b7-62f823de6429 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 14:04:39,251 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [7b62e43e] Correlation ID: 7cf60f32, Job ID: 2c365aef-2e96-456b-a56d-4bf1adcd56b0, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was successfully removed. >2014-04-10 14:04:39,251 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [7b62e43e] BaseAsyncTask::StartPollingTask: Starting to poll task 37f9af5d-9958-4332-80b7-62f823de6429. >2014-04-10 14:04:44,185 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-91) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-10 14:04:44,196 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-91) SPMAsyncTask::PollTask: Polling task 37f9af5d-9958-4332-80b7-62f823de6429 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 14:04:44,287 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-91) BaseAsyncTask::OnTaskEndSuccess: Task 37f9af5d-9958-4332-80b7-62f823de6429 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 14:04:44,288 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-91) CommandAsyncTask::EndActionIfNecessary: All tasks of command 89ffa995-e436-4dfc-b03a-075c4d472d77 has ended -> executing EndAction >2014-04-10 14:04:44,288 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-91) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 89ffa995-e436-4dfc-b03a-075c4d472d77): calling EndAction . >2014-04-10 14:04:44,288 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-10 14:04:44,398 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-10 14:04:44,400 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-10 14:04:44,400 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-10 14:04:44,409 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 37f9af5d-9958-4332-80b7-62f823de6429 >2014-04-10 14:04:44,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 37f9af5d-9958-4332-80b7-62f823de6429), log id: 3ff35813 >2014-04-10 14:04:44,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=37f9af5d-9958-4332-80b7-62f823de6429), log id: 11b6832 >2014-04-10 14:04:44,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 11b6832 >2014-04-10 14:04:44,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 3ff35813 >2014-04-10 14:04:44,442 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 37f9af5d-9958-4332-80b7-62f823de6429 from DataBase >2014-04-10 14:04:44,442 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 89ffa995-e436-4dfc-b03a-075c4d472d77 >2014-04-10 14:04:52,599 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-48) [3686bf87] Running command: StopVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-10 14:04:52,606 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-48) [3686bf87] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, force=false, secondsToWait=0, gracefully=false), log id: 30a3ef7f >2014-04-10 14:04:52,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-48) [3686bf87] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, force=false, secondsToWait=0, gracefully=false), log id: 54dfc188 >2014-04-10 14:04:53,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-48) [3686bf87] FINISH, DestroyVDSCommand, log id: 54dfc188 >2014-04-10 14:04:53,402 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-48) [3686bf87] FINISH, DestroyVmVDSCommand, return: Down, log id: 30a3ef7f >2014-04-10 14:04:53,424 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [3686bf87] Correlation ID: 3686bf87, Job ID: 686ee2ce-0bb3-4ecd-b35b-8cded7b8b99d, Call Stack: null, Custom Event ID: -1, Message: VM vm2 powered off by admin@internal (Host: 10.66.106.40). >2014-04-10 14:04:58,232 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-50) [6c1eab12] Running command: StopVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-10 14:04:58,238 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [6c1eab12] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: 2275fdfd >2014-04-10 14:04:58,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [6c1eab12] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, force=false, secondsToWait=0, gracefully=false), log id: add0778 >2014-04-10 14:04:59,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [6c1eab12] FINISH, DestroyVDSCommand, log id: add0778 >2014-04-10 14:04:59,373 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [6c1eab12] FINISH, DestroyVmVDSCommand, return: Down, log id: 2275fdfd >2014-04-10 14:04:59,390 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [6c1eab12] Correlation ID: 6c1eab12, Job ID: de68c47e-be44-4eb2-868f-f75b0b2a1e55, Call Stack: null, Custom Event ID: -1, Message: VM vm3 powered off by admin@internal (Host: 10.66.106.40). >2014-04-10 14:05:01,570 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-17) [4f08fbad] Lock Acquired to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-10 14:05:01,698 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [4f08fbad] Running command: RemoveVmCommand internal: false. Entities affected : ID: e7983b62-8992-42a8-afd7-f7b815d80bbb Type: VM >2014-04-10 14:05:01,699 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [4f08fbad] START, SetVmStatusVDSCommand( vmId = e7983b62-8992-42a8-afd7-f7b815d80bbb, status = ImageLocked), log id: 34c62dbd >2014-04-10 14:05:01,704 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [4f08fbad] FINISH, SetVmStatusVDSCommand, log id: 34c62dbd >2014-04-10 14:05:01,715 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [4f08fbad] Lock freed to object EngineLock [exclusiveLocks= key: e7983b62-8992-42a8-afd7-f7b815d80bbb value: VM >, sharedLocks= ] >2014-04-10 14:05:01,756 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [4f08fbad] Correlation ID: 4f08fbad, Job ID: 9de3a594-1a88-481e-afd6-69e8370b4acb, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was successfully removed. >2014-04-10 14:05:09,242 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-15) [222ee7e] Lock Acquired to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-10 14:05:09,322 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [222ee7e] Running command: RemoveVmCommand internal: false. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-10 14:05:09,323 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [222ee7e] START, SetVmStatusVDSCommand( vmId = c9ccfdfe-0f0d-4c96-8bd7-47723067081a, status = ImageLocked), log id: 5decdefd >2014-04-10 14:05:09,328 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [222ee7e] FINISH, SetVmStatusVDSCommand, log id: 5decdefd >2014-04-10 14:05:09,339 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [222ee7e] Lock freed to object EngineLock [exclusiveLocks= key: c9ccfdfe-0f0d-4c96-8bd7-47723067081a value: VM >, sharedLocks= ] >2014-04-10 14:05:09,363 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-48) [6f1beb56] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: c9ccfdfe-0f0d-4c96-8bd7-47723067081a Type: VM >2014-04-10 14:05:09,386 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-48) [5e0066ad] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-10 14:05:09,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-48) [5e0066ad] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = 75fbb675-c45b-4977-a046-84ac78c9c372, postZeros = false, forceDelete = false), log id: 664f1868 >2014-04-10 14:05:09,454 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-48) [5e0066ad] FINISH, DeleteImageGroupVDSCommand, log id: 664f1868 >2014-04-10 14:05:09,475 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) [5e0066ad] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 81550e49-81f6-47e6-8a63-0dbec7418d8f >2014-04-10 14:05:09,475 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [5e0066ad] CommandMultiAsyncTasks::AttachTask: Attaching task 5015ff27-cde8-47bb-bc6c-6f061851e632 to command 81550e49-81f6-47e6-8a63-0dbec7418d8f. >2014-04-10 14:05:09,495 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [5e0066ad] Adding task 5015ff27-cde8-47bb-bc6c-6f061851e632 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 14:05:09,603 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [5e0066ad] Correlation ID: 222ee7e, Job ID: d72b7c94-afce-4c21-9b29-1651b49e4b77, Call Stack: null, Custom Event ID: -1, Message: VM vm3 was successfully removed. >2014-04-10 14:05:09,603 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [5e0066ad] BaseAsyncTask::StartPollingTask: Starting to poll task 5015ff27-cde8-47bb-bc6c-6f061851e632. >2014-04-10 14:05:14,290 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-77) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-04-10 14:05:14,301 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task 5015ff27-cde8-47bb-bc6c-6f061851e632 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 14:05:14,313 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::OnTaskEndSuccess: Task 5015ff27-cde8-47bb-bc6c-6f061851e632 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 14:05:14,313 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::EndActionIfNecessary: All tasks of command 81550e49-81f6-47e6-8a63-0dbec7418d8f has ended -> executing EndAction >2014-04-10 14:05:14,314 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 81550e49-81f6-47e6-8a63-0dbec7418d8f): calling EndAction . >2014-04-10 14:05:14,314 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-10 14:05:14,336 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-10 14:05:14,338 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-10 14:05:14,338 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-10 14:05:14,344 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 5015ff27-cde8-47bb-bc6c-6f061851e632 >2014-04-10 14:05:14,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 5015ff27-cde8-47bb-bc6c-6f061851e632), log id: 6ff21726 >2014-04-10 14:05:14,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, taskId=5015ff27-cde8-47bb-bc6c-6f061851e632), log id: 7ecdf934 >2014-04-10 14:05:14,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 7ecdf934 >2014-04-10 14:05:14,359 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 6ff21726 >2014-04-10 14:05:14,370 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 5015ff27-cde8-47bb-bc6c-6f061851e632 from DataBase >2014-04-10 14:05:14,370 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 81550e49-81f6-47e6-8a63-0dbec7418d8f >2014-04-10 14:05:21,793 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-50) [26a9db25] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-10 14:05:21,797 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [26a9db25] START, SetVdsStatusVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 33f1d910 >2014-04-10 14:05:21,835 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [26a9db25] FINISH, SetVdsStatusVDSCommand, log id: 33f1d910 >2014-04-10 14:05:21,877 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-50) [26a9db25] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-10 14:05:21,885 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [26a9db25] Correlation ID: 26a9db25, Job ID: 5ace40a9-eed8-4c58-8ecd-84ecf0b234b9, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was switched to Maintenance mode by admin@internal. >2014-04-10 14:05:22,519 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 539a81aa-3a8e-4454-b673-e6092c868b2c : 10.66.106.32 >2014-04-10 14:05:22,555 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-48) Clearing cache of pool: f721168f-5edd-4f5f-8976-591eb93f960e for problematic entities of VDS: 10.66.106.32. >2014-04-10 14:05:22,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-55) START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2), log id: 72d1d378 >2014-04-10 14:05:25,569 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-5) [249ab6d3] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 14:05:25,604 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-48) [249ab6d3] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-10 14:05:25,608 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [249ab6d3] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 83da93b >2014-04-10 14:05:25,627 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [249ab6d3] VDS 10.66.106.40 is spm and moved from up calling ResetIrs. >2014-04-10 14:05:25,627 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-48) [249ab6d3] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, ignoreStopFailed = false), log id: 4fb0b55b >2014-04-10 14:05:25,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-48) [249ab6d3] START, SpmStopVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 563ff973 >2014-04-10 14:05:25,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-48) [249ab6d3] SpmStopVDSCommand::Stopping SPM on vds 10.66.106.40, pool id f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 14:05:25,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-48) [249ab6d3] FINISH, SpmStopVDSCommand, log id: 563ff973 >2014-04-10 14:05:25,728 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-48) [249ab6d3] FINISH, ResetIrsVDSCommand, log id: 4fb0b55b >2014-04-10 14:05:25,728 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [249ab6d3] FINISH, SetVdsStatusVDSCommand, log id: 83da93b >2014-04-10 14:05:25,728 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-48) [249ab6d3] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 14:05:25,776 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-48) [249ab6d3] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-10 14:05:25,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [249ab6d3] Correlation ID: 249ab6d3, Job ID: bd9a62c9-22e1-4799-b928-d37cfe151d23, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was switched to Maintenance mode by admin@internal. >2014-04-10 14:05:26,234 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 : 10.66.106.40 >2014-04-10 14:05:26,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) Clearing cache of pool: f721168f-5edd-4f5f-8976-591eb93f960e for problematic entities of VDS: 10.66.106.40. >2014-04-10 14:05:26,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-17) START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1), log id: 6403e61d >2014-04-10 14:05:29,435 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Setting new tasks map. The map contains now 2 tasks >2014-04-10 14:05:30,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, DisconnectStoragePoolVDSCommand, log id: 72d1d378 >2014-04-10 14:05:30,606 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-55) [6952031] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 14:05:30,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-55) [6952031] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.32, HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: cf29e06 >2014-04-10 14:05:33,170 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-6) [2b2c1a0b] Lock Acquired to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-10 14:05:33,176 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [2b2c1a0b] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 539a81aa-3a8e-4454-b673-e6092c868b2c Type: VDS >2014-04-10 14:05:33,244 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [2b2c1a0b] START, RemoveVdsVDSCommand( HostId = 539a81aa-3a8e-4454-b673-e6092c868b2c), log id: 4d79fa53 >2014-04-10 14:05:33,549 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-69) [610954fd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 14:05:33,575 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) [610954fd] Correlation ID: 610954fd, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting status to Non Responsive. >2014-04-10 14:05:35,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, DisconnectStoragePoolVDSCommand, log id: 6403e61d >2014-04-10 14:05:35,392 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-17) [12be6d12] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 14:05:35,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-17) [12be6d12] START, DisconnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f67c0a7 >2014-04-10 14:05:37,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-55) [6952031] FINISH, DisconnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: cf29e06 >2014-04-10 14:05:37,591 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-49) [2b2c1a0b] vdsManager::disposing >2014-04-10 14:05:37,592 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [2b2c1a0b] FINISH, RemoveVdsVDSCommand, log id: 4d79fa53 >2014-04-10 14:05:37,599 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [2b2c1a0b] Correlation ID: 2b2c1a0b, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.32 was removed by admin@internal. >2014-04-10 14:05:37,600 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [2b2c1a0b] Lock freed to object EngineLock [exclusiveLocks= key: 539a81aa-3a8e-4454-b673-e6092c868b2c value: VDS >, sharedLocks= ] >2014-04-10 14:05:37,658 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-13) [3363371f] Lock Acquired to object EngineLock [exclusiveLocks= key: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 value: VDS >, sharedLocks= ] >2014-04-10 14:05:37,664 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [3363371f] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 Type: VDS >2014-04-10 14:05:37,694 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [3363371f] START, RemoveVdsVDSCommand( HostId = 8b916f9f-d5e6-40a1-8e4b-58ef7df47820), log id: 12c3a34f >2014-04-10 14:05:42,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-17) [12be6d12] FINISH, DisconnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 7f67c0a7 >2014-04-10 14:05:42,132 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-49) [3363371f] vdsManager::disposing >2014-04-10 14:05:42,133 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [3363371f] FINISH, RemoveVdsVDSCommand, log id: 12c3a34f >2014-04-10 14:05:42,140 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [3363371f] Correlation ID: 3363371f, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was removed by admin@internal. >2014-04-10 14:05:42,141 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [3363371f] Lock freed to object EngineLock [exclusiveLocks= key: 8b916f9f-d5e6-40a1-8e4b-58ef7df47820 value: VDS >, sharedLocks= ] >2014-04-10 14:05:59,435 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-83) Setting new tasks map. The map contains now 1 tasks >2014-04-10 14:06:29,436 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Setting new tasks map. The map contains now 0 tasks >2014-04-10 14:06:29,436 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-10 14:37:10,161 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-64) Start refreshing all users data >2014-04-10 14:37:11,404 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-04-10 15:15:56,436 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginAdminUserCommand internal: false. >2014-04-10 15:15:56,467 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 15:15:57,243 INFO [org.ovirt.engine.api.restapi.security.auth.LoginValidator] (ajp-/127.0.0.1:8702-5) Validating session failed, reason: Session does not exist. >2014-04-10 15:16:40,710 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-16) [4605f9c0] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor103.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.GeneratedMethodAccessor102.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:16:40,735 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-16) [4605f9c0] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 15:16:40,764 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: d93a3416-9009-416f-bc87-042f80ee95af Type: VDS >2014-04-10 15:16:40,777 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-10 15:16:40,778 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-16) [6144b6da] Cannot get vdsManager for vdsid=d93a3416-9009-416f-bc87-042f80ee95af >2014-04-10 15:16:40,781 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] START, RemoveVdsVDSCommand(HostName = 10.66.85.206, HostId = d93a3416-9009-416f-bc87-042f80ee95af), log id: 6b6f763a >2014-04-10 15:16:40,781 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-16) [6144b6da] Cannot get vdsManager for vdsid=d93a3416-9009-416f-bc87-042f80ee95af >2014-04-10 15:16:40,781 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] FINISH, RemoveVdsVDSCommand, log id: 6b6f763a >2014-04-10 15:16:40,781 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-16) [6144b6da] Cannot get vdsManager for vdsid=d93a3416-9009-416f-bc87-042f80ee95af >2014-04-10 15:16:40,783 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] START, AddVdsVDSCommand(HostName = 10.66.85.206, HostId = d93a3416-9009-416f-bc87-042f80ee95af), log id: 461c94e9 >2014-04-10 15:16:40,784 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] AddVds - entered , starting logic to add VDS d93a3416-9009-416f-bc87-042f80ee95af >2014-04-10 15:16:40,785 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] AddVds - VDS d93a3416-9009-416f-bc87-042f80ee95af was added, will try to add it to the resource manager >2014-04-10 15:16:40,786 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-16) [6144b6da] Entered VdsManager constructor >2014-04-10 15:16:40,801 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-16) [6144b6da] Initialize vdsBroker (10.66.85.206,54,321) >2014-04-10 15:16:40,802 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-16) [6144b6da] VDS d93a3416-9009-416f-bc87-042f80ee95af was added to the Resource Manager >2014-04-10 15:16:40,802 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-16) [6144b6da] FINISH, AddVdsVDSCommand, log id: 461c94e9 >2014-04-10 15:16:40,810 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [6144b6da] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.85.206. >2014-04-10 15:16:40,845 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [6144b6da] Correlation ID: 4605f9c0, Job ID: 291046dd-7ae5-479d-9a7a-65f9602ada0f, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 was added by admin@internal. >2014-04-10 15:16:40,854 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [7857b5a6] Lock Acquired to object EngineLock [exclusiveLocks= key: d93a3416-9009-416f-bc87-042f80ee95af value: VDS >, sharedLocks= ] >2014-04-10 15:16:40,870 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [7857b5a6] Running command: InstallVdsCommand internal: true. Entities affected : ID: d93a3416-9009-416f-bc87-042f80ee95af Type: VDS >2014-04-10 15:16:40,870 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [7857b5a6] Before Installation host d93a3416-9009-416f-bc87-042f80ee95af, 10.66.85.206 >2014-04-10 15:16:40,875 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [7857b5a6] START, SetVdsStatusVDSCommand(HostName = 10.66.85.206, HostId = d93a3416-9009-416f-bc87-042f80ee95af, status=Installing, nonOperationalReason=NONE), log id: 1b3698aa >2014-04-10 15:16:40,887 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [7857b5a6] FINISH, SetVdsStatusVDSCommand, log id: 1b3698aa >2014-04-10 15:16:40,987 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-49) [7857b5a6] Installation 10.66.85.206: Connected to host 10.66.85.206 with SSH key fingerprint: 0d:45:e2:9f:d4:38:12:e1:9f:dc:3c:8e:e2:ac:e4:ad >2014-04-10 15:16:40,995 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [7857b5a6] Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Connected to host 10.66.85.206 with SSH key fingerprint: 0d:45:e2:9f:d4:38:12:e1:9f:dc:3c:8e:e2:ac:e4:ad. >2014-04-10 15:16:41,038 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-49) [7857b5a6] Installation of 10.66.85.206. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-10 15:16:41,055 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-49) SSH execute root@10.66.85.206 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-10 15:16:42,782 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Initializing >2014-04-10 15:16:42,815 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Initializing. >2014-04-10 15:16:42,833 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Environment setup >2014-04-10 15:16:42,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Environment setup. >2014-04-10 15:16:42,862 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Environment packages setup >2014-04-10 15:16:42,896 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Environment packages setup. >2014-04-10 15:16:43,805 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-15) [3c8c2c14] Initializing Host: 10.66.85.206 >2014-04-10 15:16:57,452 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Status: Downloading Packages >2014-04-10 15:16:57,468 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Status: Downloading Packages. >2014-04-10 15:16:58,940 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64 >2014-04-10 15:16:58,959 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Download/Verify: dmidecode-2.12-5.el6_5.x86_64. >2014-04-10 15:16:58,960 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Status: Check Package Signatures >2014-04-10 15:16:58,968 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Status: Check Package Signatures. >2014-04-10 15:16:58,968 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Status: Running Test Transaction >2014-04-10 15:16:58,976 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Status: Running Test Transaction. >2014-04-10 15:16:59,479 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Status: Running Transaction >2014-04-10 15:16:59,495 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Status: Running Transaction. >2014-04-10 15:17:00,479 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64 >2014-04-10 15:17:00,494 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum update: 1/2: 1:dmidecode-2.12-5.el6_5.x86_64. >2014-04-10 15:17:01,095 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum updated: 2/2: dmidecode >2014-04-10 15:17:01,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum updated: 2/2: dmidecode. >2014-04-10 15:17:02,713 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u >2014-04-10 15:17:02,765 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Verify: 1/2: dmidecode.x86_64 1:2.12-5.el6_5 - u. >2014-04-10 15:17:02,828 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud >2014-04-10 15:17:02,844 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Verify: 2/2: dmidecode.x86_64 1:2.11-2.el6 - ud. >2014-04-10 15:17:03,450 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Programs detection >2014-04-10 15:17:03,461 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Programs detection. >2014-04-10 15:17:03,461 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Environment customization >2014-04-10 15:17:03,469 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Environment customization. >2014-04-10 15:17:03,549 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Logs at host located at: '/tmp/ovirt-host-deploy-20140410151701.log' >2014-04-10 15:17:03,561 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Logs at host located at: '/tmp/ovirt-host-deploy-20140410151701.log'. >2014-04-10 15:17:03,648 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.85.206 reports unique id 44454C4C-3900-104A-8048-B7C04F4D3258 >2014-04-10 15:17:03,676 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 44454C4C-3900-104A-8048-B7C04F4D3258 to Host 10.66.85.206 >2014-04-10 15:17:03,796 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Setup validation >2014-04-10 15:17:03,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Setup validation. >2014-04-10 15:17:04,342 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Machine does not support constant timestamp counter, this may effect performance >2014-04-10 15:17:04,352 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 installation in progress . Machine does not support constant timestamp counter, this may effect performance. >2014-04-10 15:17:04,365 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Hardware supports virtualization >2014-04-10 15:17:04,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Hardware supports virtualization. >2014-04-10 15:17:04,716 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Transaction setup >2014-04-10 15:17:04,727 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Transaction setup. >2014-04-10 15:17:04,779 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Misc configuration >2014-04-10 15:17:04,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Misc configuration. >2014-04-10 15:17:04,794 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Package installation >2014-04-10 15:17:04,802 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Package installation. >2014-04-10 15:17:35,159 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Downloading: RHEL-test/filelists_db 2.6 M(33%) >2014-04-10 15:17:35,182 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Downloading: RHEL-test/filelists_db 2.6 M(33%). >2014-04-10 15:18:05,399 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Downloading: RHEL-test/filelists_db 6.6 M(85%) >2014-04-10 15:18:05,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Downloading: RHEL-test/filelists_db 6.6 M(85%). >2014-04-10 15:18:12,876 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-10 15:18:12,892 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.85.206. Yum [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-10 15:18:12,893 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7'] >2014-04-10 15:18:12,909 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.85.206. Failed to execute stage 'Package installation': [u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt = 0.10.2-29.el6_5.7', u'libvirt-lock-sanlock-0.10.2-29.el6_5.7.x86_64 requires libvirt-client = 0.10.2-29.el6_5.7']. >2014-04-10 15:18:12,909 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Yum Performing yum transaction rollback >2014-04-10 15:18:12,926 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Yum Performing yum transaction rollback. >2014-04-10 15:18:12,926 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Pre-termination >2014-04-10 15:18:12,943 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Pre-termination. >2014-04-10 15:18:12,953 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410151812-10.66.85.206-7857b5a6.log' >2014-04-10 15:18:12,967 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410151812-10.66.85.206-7857b5a6.log'. >2014-04-10 15:18:13,200 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Termination >2014-04-10 15:18:13,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7857b5a6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Termination. >2014-04-10 15:18:13,378 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-49) SSH error running command root@10.66.85.206:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:18:13,382 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-49) [7857b5a6] Error during host 10.66.85.206 install: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:18:13,384 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [7857b5a6] Host installation failed for host d93a3416-9009-416f-bc87-042f80ee95af, 10.66.85.206.: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:18:13,389 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [7857b5a6] START, SetVdsStatusVDSCommand(HostName = 10.66.85.206, HostId = d93a3416-9009-416f-bc87-042f80ee95af, status=InstallFailed, nonOperationalReason=NONE), log id: 7da8983a >2014-04-10 15:18:13,401 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [7857b5a6] FINISH, SetVdsStatusVDSCommand, log id: 7da8983a >2014-04-10 15:18:13,418 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [7857b5a6] Correlation ID: 7857b5a6, Job ID: 291046dd-7ae5-479d-9a7a-65f9602ada0f, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 installation failed. Command returned failure code 1 during SSH session 'root@10.66.85.206'. >2014-04-10 15:18:13,426 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [7857b5a6] Lock freed to object EngineLock [exclusiveLocks= key: d93a3416-9009-416f-bc87-042f80ee95af value: VDS >, sharedLocks= ] >2014-04-10 15:20:04,727 WARN [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-8) [471c3bf4] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_OPERATIONAL >2014-04-10 15:20:13,998 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-9) [2a77f779] Lock Acquired to object EngineLock [exclusiveLocks= key: d93a3416-9009-416f-bc87-042f80ee95af value: VDS >, sharedLocks= ] >2014-04-10 15:20:14,004 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [2a77f779] Running command: RemoveVdsCommand internal: false. Entities affected : ID: d93a3416-9009-416f-bc87-042f80ee95af Type: VDS >2014-04-10 15:20:14,052 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [2a77f779] START, RemoveVdsVDSCommand( HostId = d93a3416-9009-416f-bc87-042f80ee95af), log id: 592895ef >2014-04-10 15:20:14,052 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-49) [2a77f779] vdsManager::disposing >2014-04-10 15:20:14,053 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [2a77f779] FINISH, RemoveVdsVDSCommand, log id: 592895ef >2014-04-10 15:20:14,058 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [2a77f779] Correlation ID: 2a77f779, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 was removed by admin@internal. >2014-04-10 15:20:14,058 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [2a77f779] Lock freed to object EngineLock [exclusiveLocks= key: d93a3416-9009-416f-bc87-042f80ee95af value: VDS >, sharedLocks= ] >2014-04-10 15:20:16,712 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [5d88f072] Lock Acquired to object EngineLock [exclusiveLocks= key: d93a3416-9009-416f-bc87-042f80ee95af value: VDS >, sharedLocks= ] >2014-04-10 15:20:16,716 WARN [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [5d88f072] CanDoAction of action RemoveVds failed. Reasons:VAR__ACTION__REMOVE,VAR__TYPE__HOST,VDS_INVALID_SERVER_ID >2014-04-10 15:20:16,716 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [5d88f072] Lock freed to object EngineLock [exclusiveLocks= key: d93a3416-9009-416f-bc87-042f80ee95af value: VDS >, sharedLocks= ] >2014-04-10 15:21:09,667 WARN [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [1d0f3caa] Failed to initiate vdsm-id request on host: java.io.IOException: Command returned failure code 127 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.getInstalledVdsIdIfExists(AddVdsCommand.java:404) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canConnect(AddVdsCommand.java:426) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand.canDoAction(AddVdsCommand.java:342) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCanDoAction(CommandBase.java:741) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:356) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.RunAction(Backend.java:353) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor103.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view8.RunAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.RunAction(GenericApiGWTServiceImpl.java:131) > at sun.reflect.GeneratedMethodAccessor102.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec.jar:1.0.2.Final-redhat-1] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:295) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:246) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:214) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:149) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:499) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:169) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:145) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:97) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:102) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:336) > at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:488) > at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:420) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:920) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:21:09,695 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [1d0f3caa] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 15:21:09,723 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 Type: VDS >2014-04-10 15:21:09,737 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-10 15:21:09,737 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Cannot get vdsManager for vdsid=5f152d4b-5272-42a4-b3d7-28b5e2fa2379 >2014-04-10 15:21:09,740 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] START, RemoveVdsVDSCommand(HostName = 10.66.85.206, HostId = 5f152d4b-5272-42a4-b3d7-28b5e2fa2379), log id: 6266e35 >2014-04-10 15:21:09,740 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Cannot get vdsManager for vdsid=5f152d4b-5272-42a4-b3d7-28b5e2fa2379 >2014-04-10 15:21:09,740 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] FINISH, RemoveVdsVDSCommand, log id: 6266e35 >2014-04-10 15:21:09,741 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Cannot get vdsManager for vdsid=5f152d4b-5272-42a4-b3d7-28b5e2fa2379 >2014-04-10 15:21:09,743 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] START, AddVdsVDSCommand(HostName = 10.66.85.206, HostId = 5f152d4b-5272-42a4-b3d7-28b5e2fa2379), log id: 3fc3ad8f >2014-04-10 15:21:09,743 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] AddVds - entered , starting logic to add VDS 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 >2014-04-10 15:21:09,745 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] AddVds - VDS 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 was added, will try to add it to the resource manager >2014-04-10 15:21:09,745 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Entered VdsManager constructor >2014-04-10 15:21:09,760 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Initialize vdsBroker (10.66.85.206,54,321) >2014-04-10 15:21:09,761 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [5fe57ab8] VDS 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 was added to the Resource Manager >2014-04-10 15:21:09,761 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [5fe57ab8] FINISH, AddVdsVDSCommand, log id: 3fc3ad8f >2014-04-10 15:21:09,768 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.85.206. >2014-04-10 15:21:09,795 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [63a497f6] Lock Acquired to object EngineLock [exclusiveLocks= key: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 value: VDS >, sharedLocks= ] >2014-04-10 15:21:09,803 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [5fe57ab8] Correlation ID: 1d0f3caa, Job ID: 71f493d0-2df9-49a7-859a-eb192a1fb62b, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 was added by admin@internal. >2014-04-10 15:21:09,828 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [63a497f6] Running command: InstallVdsCommand internal: true. Entities affected : ID: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 Type: VDS >2014-04-10 15:21:09,829 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [63a497f6] Before Installation host 5f152d4b-5272-42a4-b3d7-28b5e2fa2379, 10.66.85.206 >2014-04-10 15:21:09,834 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [63a497f6] START, SetVdsStatusVDSCommand(HostName = 10.66.85.206, HostId = 5f152d4b-5272-42a4-b3d7-28b5e2fa2379, status=Installing, nonOperationalReason=NONE), log id: 10bcd004 >2014-04-10 15:21:09,846 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [63a497f6] FINISH, SetVdsStatusVDSCommand, log id: 10bcd004 >2014-04-10 15:21:09,945 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-49) [63a497f6] Installation 10.66.85.206: Connected to host 10.66.85.206 with SSH key fingerprint: 0d:45:e2:9f:d4:38:12:e1:9f:dc:3c:8e:e2:ac:e4:ad >2014-04-10 15:21:09,953 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [63a497f6] Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Connected to host 10.66.85.206 with SSH key fingerprint: 0d:45:e2:9f:d4:38:12:e1:9f:dc:3c:8e:e2:ac:e4:ad. >2014-04-10 15:21:09,995 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-49) [63a497f6] Installation of 10.66.85.206. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-10 15:21:10,009 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-49) SSH execute root@10.66.85.206 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-10 15:21:11,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Initializing >2014-04-10 15:21:11,761 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Initializing. >2014-04-10 15:21:11,779 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Environment setup >2014-04-10 15:21:11,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Environment setup. >2014-04-10 15:21:11,796 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Failed to execute stage 'Environment setup': Existing lock /var/run/yum.pid: another copy is running as pid 29007. >2014-04-10 15:21:11,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host 10.66.85.206. Failed to execute stage 'Environment setup': Existing lock /var/run/yum.pid: another copy is running as pid 29007.. >2014-04-10 15:21:11,812 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Pre-termination >2014-04-10 15:21:11,820 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Pre-termination. >2014-04-10 15:21:11,830 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410152111-10.66.85.206-63a497f6.log' >2014-04-10 15:21:11,845 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410152111-10.66.85.206-63a497f6.log'. >2014-04-10 15:21:12,041 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.85.206: Stage: Termination >2014-04-10 15:21:12,053 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 63a497f6, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.85.206. Stage: Termination. >2014-04-10 15:21:12,190 ERROR [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-49) SSH error running command root@10.66.85.206:'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True': java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:21:12,193 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-49) [63a497f6] Error during host 10.66.85.206 install: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:21:12,195 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [63a497f6] Host installation failed for host 5f152d4b-5272-42a4-b3d7-28b5e2fa2379, 10.66.85.206.: java.io.IOException: Command returned failure code 1 during SSH session 'root@10.66.85.206' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:508) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.executeCommand(SSHDialog.java:311) [utils.jar:] > at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1043) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:192) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor79.invoke(Unknown Source) [:1.7.0_51] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_51] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_51] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.0.Final-redhat-14] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:173) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_51] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_51] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_51] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51] > >2014-04-10 15:21:12,200 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [63a497f6] START, SetVdsStatusVDSCommand(HostName = 10.66.85.206, HostId = 5f152d4b-5272-42a4-b3d7-28b5e2fa2379, status=InstallFailed, nonOperationalReason=NONE), log id: 303f37c7 >2014-04-10 15:21:12,211 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [63a497f6] FINISH, SetVdsStatusVDSCommand, log id: 303f37c7 >2014-04-10 15:21:12,228 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [63a497f6] Correlation ID: 63a497f6, Job ID: 71f493d0-2df9-49a7-859a-eb192a1fb62b, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 installation failed. Command returned failure code 1 during SSH session 'root@10.66.85.206'. >2014-04-10 15:21:12,236 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [63a497f6] Lock freed to object EngineLock [exclusiveLocks= key: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 value: VDS >, sharedLocks= ] >2014-04-10 15:21:12,765 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-42) Initializing Host: 10.66.85.206 >2014-04-10 15:24:12,973 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-4) [78deb25d] Lock Acquired to object EngineLock [exclusiveLocks= key: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 value: VDS >, sharedLocks= ] >2014-04-10 15:24:12,979 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [78deb25d] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 Type: VDS >2014-04-10 15:24:13,046 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [78deb25d] START, RemoveVdsVDSCommand( HostId = 5f152d4b-5272-42a4-b3d7-28b5e2fa2379), log id: 5d047161 >2014-04-10 15:24:13,046 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-49) [78deb25d] vdsManager::disposing >2014-04-10 15:24:13,046 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [78deb25d] FINISH, RemoveVdsVDSCommand, log id: 5d047161 >2014-04-10 15:24:13,059 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [78deb25d] Correlation ID: 78deb25d, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.85.206 was removed by admin@internal. >2014-04-10 15:24:13,060 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [78deb25d] Lock freed to object EngineLock [exclusiveLocks= key: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 value: VDS >, sharedLocks= ] >2014-04-10 15:24:38,979 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-13) [2ff52c63] Lock Acquired to object EngineLock [exclusiveLocks= key: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 value: VDS >, sharedLocks= ] >2014-04-10 15:24:38,983 WARN [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-13) [2ff52c63] CanDoAction of action RemoveVds failed. Reasons:VAR__ACTION__REMOVE,VAR__TYPE__HOST,VDS_INVALID_SERVER_ID >2014-04-10 15:24:38,983 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-13) [2ff52c63] Lock freed to object EngineLock [exclusiveLocks= key: 5f152d4b-5272-42a4-b3d7-28b5e2fa2379 value: VDS >, sharedLocks= ] >2014-04-10 15:29:35,783 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [135143dc] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 15:29:35,812 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [c419384] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 15:29:35,825 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [c419384] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-10 15:29:35,826 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [c419384] Cannot get vdsManager for vdsid=7c543dbd-143a-473f-9095-a0257d455417 >2014-04-10 15:29:35,829 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [c419384] START, RemoveVdsVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 30133f24 >2014-04-10 15:29:35,829 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [c419384] Cannot get vdsManager for vdsid=7c543dbd-143a-473f-9095-a0257d455417 >2014-04-10 15:29:35,829 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [c419384] FINISH, RemoveVdsVDSCommand, log id: 30133f24 >2014-04-10 15:29:35,829 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [c419384] Cannot get vdsManager for vdsid=7c543dbd-143a-473f-9095-a0257d455417 >2014-04-10 15:29:35,831 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [c419384] START, AddVdsVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 2c9ec44d >2014-04-10 15:29:35,831 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [c419384] AddVds - entered , starting logic to add VDS 7c543dbd-143a-473f-9095-a0257d455417 >2014-04-10 15:29:35,833 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [c419384] AddVds - VDS 7c543dbd-143a-473f-9095-a0257d455417 was added, will try to add it to the resource manager >2014-04-10 15:29:35,833 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [c419384] Entered VdsManager constructor >2014-04-10 15:29:35,849 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [c419384] Initialize vdsBroker (10.66.83.216,54,321) >2014-04-10 15:29:35,850 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [c419384] VDS 7c543dbd-143a-473f-9095-a0257d455417 was added to the Resource Manager >2014-04-10 15:29:35,850 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [c419384] FINISH, AddVdsVDSCommand, log id: 2c9ec44d >2014-04-10 15:29:35,857 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [c419384] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.83.216. >2014-04-10 15:29:35,892 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [c419384] Correlation ID: 135143dc, Job ID: d3e5864e-afdb-42e6-ba7c-ea7bf84d1bcf, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.83.216 was added by admin@internal. >2014-04-10 15:29:35,901 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1a7ac7dc] Lock Acquired to object EngineLock [exclusiveLocks= key: 7c543dbd-143a-473f-9095-a0257d455417 value: VDS >, sharedLocks= ] >2014-04-10 15:29:35,917 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1a7ac7dc] Running command: InstallVdsCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 15:29:35,917 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1a7ac7dc] Before Installation host 7c543dbd-143a-473f-9095-a0257d455417, 10.66.83.216 >2014-04-10 15:29:35,922 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [1a7ac7dc] START, SetVdsStatusVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, status=Installing, nonOperationalReason=NONE), log id: 2963328e >2014-04-10 15:29:35,934 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [1a7ac7dc] FINISH, SetVdsStatusVDSCommand, log id: 2963328e >2014-04-10 15:29:36,011 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-49) [1a7ac7dc] Installation 10.66.83.216: Connected to host 10.66.83.216 with SSH key fingerprint: 7d:c4:ec:e1:8b:ee:d6:21:38:0b:4d:a9:86:10:14:e6 >2014-04-10 15:29:36,025 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [1a7ac7dc] Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Connected to host 10.66.83.216 with SSH key fingerprint: 7d:c4:ec:e1:8b:ee:d6:21:38:0b:4d:a9:86:10:14:e6. >2014-04-10 15:29:36,041 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-49) [1a7ac7dc] Installation of 10.66.83.216. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-10 15:29:36,056 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-49) SSH execute root@10.66.83.216 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-10 15:29:36,848 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Initializing >2014-04-10 15:29:36,859 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Initializing. >2014-04-10 15:29:36,872 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Environment setup >2014-04-10 15:29:36,884 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Environment setup. >2014-04-10 15:29:36,887 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Environment packages setup >2014-04-10 15:29:36,901 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Environment packages setup. >2014-04-10 15:29:38,854 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-37) Initializing Host: 10.66.83.216 >2014-04-10 15:30:01,079 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Programs detection >2014-04-10 15:30:01,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Programs detection. >2014-04-10 15:30:01,128 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Environment customization >2014-04-10 15:30:01,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Environment customization. >2014-04-10 15:30:01,147 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Logs at host located at: '/tmp/ovirt-host-deploy-20140410152953.log' >2014-04-10 15:30:01,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Logs at host located at: '/tmp/ovirt-host-deploy-20140410152953.log'. >2014-04-10 15:30:01,235 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.83.216 reports unique id 44454C4C-3600-1050-8058-B6C04F4B3258 >2014-04-10 15:30:01,264 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 44454C4C-3600-1050-8058-B6C04F4B3258 to Host 10.66.83.216 >2014-04-10 15:30:01,330 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Setup validation >2014-04-10 15:30:01,339 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Setup validation. >2014-04-10 15:30:01,532 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Hardware supports virtualization >2014-04-10 15:30:01,547 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Hardware supports virtualization. >2014-04-10 15:30:01,605 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Transaction setup >2014-04-10 15:30:01,614 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Transaction setup. >2014-04-10 15:30:01,645 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Misc configuration >2014-04-10 15:30:01,655 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Misc configuration. >2014-04-10 15:30:01,656 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Package installation >2014-04-10 15:30:01,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Package installation. >2014-04-10 15:30:05,084 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Misc configuration >2014-04-10 15:30:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Misc configuration. >2014-04-10 15:30:06,301 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Enrolling certificate >2014-04-10 15:30:06,353 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Enrolling certificate. >2014-04-10 15:30:07,877 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Transaction commit >2014-04-10 15:30:07,911 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Transaction commit. >2014-04-10 15:30:07,943 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Closing up >2014-04-10 15:30:07,969 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Closing up. >2014-04-10 15:30:09,039 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stopping libvirtd >2014-04-10 15:30:09,052 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stopping libvirtd. >2014-04-10 15:30:09,167 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Starting vdsm >2014-04-10 15:30:09,177 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Starting vdsm. >2014-04-10 15:30:11,797 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Pre-termination >2014-04-10 15:30:11,810 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Pre-termination. >2014-04-10 15:30:11,822 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410153011-10.66.83.216-1a7ac7dc.log' >2014-04-10 15:30:11,835 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410153011-10.66.83.216-1a7ac7dc.log'. >2014-04-10 15:30:12,079 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.83.216: Stage: Termination >2014-04-10 15:30:12,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1a7ac7dc, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.83.216. Stage: Termination. >2014-04-10 15:30:12,205 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1a7ac7dc] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 15:30:12,205 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-49) [1a7ac7dc] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 15:30:13,426 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-49) [1a7ac7dc] Engine managed to communicate with VDSM agent on host 10.66.83.216 >2014-04-10 15:30:13,630 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [1a7ac7dc] START, SetVdsStatusVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, status=Initializing, nonOperationalReason=NONE), log id: 66298729 >2014-04-10 15:30:13,635 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-49) [1a7ac7dc] FINISH, SetVdsStatusVDSCommand, log id: 66298729 >2014-04-10 15:30:13,635 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1a7ac7dc] After Installation host 10.66.83.216, VDS >2014-04-10 15:30:13,643 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [1a7ac7dc] Correlation ID: 1a7ac7dc, Job ID: d3e5864e-afdb-42e6-ba7c-ea7bf84d1bcf, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.83.216 installed >2014-04-10 15:30:13,652 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-49) [1a7ac7dc] Lock freed to object EngineLock [exclusiveLocks= key: 7c543dbd-143a-473f-9095-a0257d455417 value: VDS >, sharedLocks= ] >2014-04-10 15:30:15,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GetHardwareInfoVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vds=Host[10.66.83.216]), log id: 2bf01199 >2014-04-10 15:30:15,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GetHardwareInfoVDSCommand, log id: 2bf01199 >2014-04-10 15:30:15,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GetHardwareInfoVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vds=Host[10.66.83.216]), log id: 1c25ad5b >2014-04-10 15:30:15,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GetHardwareInfoVDSCommand, log id: 1c25ad5b >2014-04-10 15:30:15,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.83.216. >2014-04-10 15:30:15,602 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-25) [12b7fb61] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 15:30:15,606 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-25) [87257b4] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 15:30:15,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-25) [87257b4] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7c0991e0 >2014-04-10 15:30:16,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-25) [87257b4] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 7c0991e0 >2014-04-10 15:30:16,082 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-25) [87257b4] Host 10.66.83.216 storage connection was succeeded >2014-04-10 15:30:16,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-49) START, ConnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 6047384a >2014-04-10 15:30:19,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-49) FINISH, ConnectStoragePoolVDSCommand, log id: 6047384a >2014-04-10 15:30:20,003 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-25) [87257b4] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 9e0fc50 >2014-04-10 15:30:20,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-25) [87257b4] FINISH, SetMOMPolicyParametersVDSCommand, log id: 9e0fc50 >2014-04-10 15:30:20,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) [87257b4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.83.216. >2014-04-10 15:30:20,115 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-25) [7baa4d21] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 15:30:20,121 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 15:30:29,241 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-70) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.83.216 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 15:30:30,026 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-51) hostFromVds::selectedVds - 10.66.83.216, spmStatus Free, storage pool NFS_shyu >2014-04-10 15:30:30,041 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-51) starting spm on vds 10.66.83.216, storage pool NFS_shyu, prevId -1, LVER 1 >2014-04-10 15:30:30,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-51) START, SpmStartVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, prevId=-1, prevLVER=1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 41805d6a >2014-04-10 15:30:30,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-51) spmStart polling started: taskId = 0beaea5b-274a-4941-9a5b-e15990c428f4 >2014-04-10 15:30:42,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-51) spmStart polling ended: taskId = 0beaea5b-274a-4941-9a5b-e15990c428f4 task status = finished >2014-04-10 15:30:42,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-51) spmStart polling ended, spm status: SPM >2014-04-10 15:30:42,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-51) START, HSMClearTaskVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, taskId=0beaea5b-274a-4941-9a5b-e15990c428f4), log id: 26e5f4fc >2014-04-10 15:30:42,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, HSMClearTaskVDSCommand, log id: 26e5f4fc >2014-04-10 15:30:42,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@9393939, log id: 41805d6a >2014-04-10 15:30:42,240 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-51) Initialize Irs proxy from vds: 10.66.83.216 >2014-04-10 15:30:42,256 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-51) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.83.216 (Address: 10.66.83.216). >2014-04-10 15:30:42,282 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-50) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: bceabe3 >2014-04-10 15:30:42,374 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-50) -- executeIrsBrokerCommand: Attempting on storage pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 15:30:42,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-50) START, HSMGetAllTasksInfoVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 5eb568e6 >2014-04-10 15:30:42,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-50) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 5eb568e6 >2014-04-10 15:30:42,384 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-50) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: bceabe3 >2014-04-10 15:30:42,384 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) Discovered no tasks on Storage Pool NFS_shyu >2014-04-10 15:31:30,828 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-2) [5adcffa3] Lock Acquired to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-04-10 15:31:30,873 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-2) [5adcffa3] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 15:31:31,005 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [5adcffa3] Correlation ID: 5adcffa3, Job ID: 063ee132-7df5-418e-8f9d-924670f25305, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was created by admin@internal. >2014-04-10 15:31:31,013 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-2) [5adcffa3] Lock freed to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-04-10 15:31:32,265 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-49) [1753a6ac] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-10 15:31:32,322 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-49) [19eb2c8f] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 15:31:32,351 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-4) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-10 15:31:32,363 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [19eb2c8f] Correlation ID: 19eb2c8f, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm1. (User: admin@internal) >2014-04-10 15:31:32,388 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [19eb2c8f] Correlation ID: 1753a6ac, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm1. (User: admin@internal) >2014-04-10 15:31:32,545 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-5) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-10 15:31:41,156 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-3) [7c0e0669] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM_DISK_BOOT >, sharedLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >] >2014-04-10 15:31:41,179 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-3) [7c0e0669] Running command: AddDiskCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM, ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:31:41,276 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-3) [61fd6c98] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:31:41,293 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-3) [61fd6c98] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM_DISK_BOOT >, sharedLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >] >2014-04-10 15:31:41,294 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [61fd6c98] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = 409d768f-348d-4a6d-a68b-62d87a5870af, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = bc604dd4-ef89-4074-be72-b3225ac7c434, newImageDescription = ), log id: 1e7ade57 >2014-04-10 15:31:41,294 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [61fd6c98] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-10 15:31:41,294 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [61fd6c98] -- createVolume parameters: > sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=409d768f-348d-4a6d-a68b-62d87a5870af > size=1,073,741,824 bytes > volFormat=RAW > volType=Sparse > volUUID=bc604dd4-ef89-4074-be72-b3225ac7c434 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-10 15:31:41,415 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [61fd6c98] FINISH, CreateImageVDSCommand, return: bc604dd4-ef89-4074-be72-b3225ac7c434, log id: 1e7ade57 >2014-04-10 15:31:41,448 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-3) [61fd6c98] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 2f95887d-9c02-4886-8a4b-d41aeb8de81d >2014-04-10 15:31:41,448 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-3) [61fd6c98] CommandMultiAsyncTasks::AttachTask: Attaching task 876d7a22-4606-4be7-827e-7fc659a1f243 to command 2f95887d-9c02-4886-8a4b-d41aeb8de81d. >2014-04-10 15:31:41,468 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-3) [61fd6c98] Adding task 876d7a22-4606-4be7-827e-7fc659a1f243 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 15:31:41,517 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [61fd6c98] Correlation ID: 7c0e0669, Job ID: 495a494c-db52-4ffb-8f68-da2a762c300d, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm1_Disk1 was initiated on VM vm1 by admin@internal. >2014-04-10 15:31:41,517 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-3) [61fd6c98] BaseAsyncTask::StartPollingTask: Starting to poll task 876d7a22-4606-4be7-827e-7fc659a1f243. >2014-04-10 15:31:46,890 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-56) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-10 15:31:46,899 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) SPMAsyncTask::PollTask: Polling task 876d7a22-4606-4be7-827e-7fc659a1f243 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 15:31:46,941 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) BaseAsyncTask::OnTaskEndSuccess: Task 876d7a22-4606-4be7-827e-7fc659a1f243 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 15:31:46,941 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-56) CommandAsyncTask::EndActionIfNecessary: All tasks of command 2f95887d-9c02-4886-8a4b-d41aeb8de81d has ended -> executing EndAction >2014-04-10 15:31:46,942 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-56) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 2f95887d-9c02-4886-8a4b-d41aeb8de81d): calling EndAction . >2014-04-10 15:31:46,942 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-10 15:31:46,958 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-50) [7c0e0669] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-10 15:31:46,965 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-50) [61fd6c98] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-10 15:31:46,981 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [61fd6c98] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = 409d768f-348d-4a6d-a68b-62d87a5870af, imageId = bc604dd4-ef89-4074-be72-b3225ac7c434), log id: 1b65d6a3 >2014-04-10 15:31:47,026 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [61fd6c98] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f8b6e63, log id: 1b65d6a3 >2014-04-10 15:31:47,049 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: 7c0e0669, Job ID: 495a494c-db52-4ffb-8f68-da2a762c300d, Call Stack: null, Custom Event ID: -1, Message: The disk vm1_Disk1 was successfully added to VM vm1. >2014-04-10 15:31:47,050 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-10 15:31:47,050 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-10 15:31:47,058 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 876d7a22-4606-4be7-827e-7fc659a1f243 >2014-04-10 15:31:47,058 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 876d7a22-4606-4be7-827e-7fc659a1f243), log id: 1fd8e9ef >2014-04-10 15:31:47,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, taskId=876d7a22-4606-4be7-827e-7fc659a1f243), log id: 59e65a3e >2014-04-10 15:31:47,071 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 59e65a3e >2014-04-10 15:31:47,071 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 1fd8e9ef >2014-04-10 15:31:47,074 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 876d7a22-4606-4be7-827e-7fc659a1f243 from DataBase >2014-04-10 15:31:47,075 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 2f95887d-9c02-4886-8a4b-d41aeb8de81d >2014-04-10 15:31:48,130 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-6) [36fefde0] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:31:48,141 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [36fefde0] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 1f94499 >2014-04-10 15:31:48,141 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [36fefde0] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1f94499 >2014-04-10 15:31:48,241 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [36fefde0] Running command: RunVmCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 15:31:48,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [36fefde0] START, IsoPrefixVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 726ff877 >2014-04-10 15:31:48,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [36fefde0] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 726ff877 >2014-04-10 15:31:48,319 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [36fefde0] START, CreateVmVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 5d072ec6 >2014-04-10 15:31:48,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [36fefde0] START, CreateVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 6fb00b5e >2014-04-10 15:31:48,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [36fefde0] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9,devices=[Ljava.util.HashMap;@67da5dfd,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={} >2014-04-10 15:31:48,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [36fefde0] FINISH, CreateVDSCommand, log id: 6fb00b5e >2014-04-10 15:31:48,449 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [36fefde0] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5d072ec6 >2014-04-10 15:31:48,449 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [36fefde0] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:31:48,458 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [36fefde0] Correlation ID: 36fefde0, Job ID: 3f8a4954-09a3-42ef-a318-3278ee79e225, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.83.216). >2014-04-10 15:31:51,184 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) [3ea46189] VM vm1 5ad91579-e7e9-4ca3-af75-2aa157c818f9 moved from WaitForLaunch --> PoweringUp >2014-04-10 15:31:51,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-4) [3ea46189] START, FullListVdsCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vds=Host[10.66.83.216], vmIds=[5ad91579-e7e9-4ca3-af75-2aa157c818f9]), log id: 1dcfd31f >2014-04-10 15:31:51,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-4) [3ea46189] FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@88c3c91, log id: 1dcfd31f >2014-04-10 15:32:49,559 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-21) VM vm1 5ad91579-e7e9-4ca3-af75-2aa157c818f9 moved from PoweringUp --> Up >2014-04-10 15:32:49,586 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) Correlation ID: 36fefde0, Job ID: 3f8a4954-09a3-42ef-a318-3278ee79e225, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host 10.66.83.216 >2014-04-10 15:33:01,421 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) Setting new tasks map. The map contains now 0 tasks >2014-04-10 15:33:01,422 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-10 15:34:18,017 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 in problem. vds: 10.66.83.216 >2014-04-10 15:34:33,281 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 in problem. vds: 10.66.83.216 >2014-04-10 15:35:44,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-23) [40980259] Command ListVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-04-10 15:35:44,732 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-9) IrsBroker::Failed::GetStoragePoolInfoVDS due to: SocketException: Connection reset >2014-04-10 15:35:44,764 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-23) [40980259] Failed to refresh VDS , vds = 7c543dbd-143a-473f-9095-a0257d455417 : 10.66.83.216, VDS Network Error, continuing. >java.net.SocketException: Connection reset >2014-04-10 15:35:48,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GetHardwareInfoVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vds=Host[10.66.83.216]), log id: 5b649c76 >2014-04-10 15:35:48,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GetHardwareInfoVDSCommand, log id: 5b649c76 >2014-04-10 15:35:48,319 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.83.216. >2014-04-10 15:35:48,328 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-2) [44042fe4] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 15:35:48,331 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-2) [c006b0] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 15:35:48,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-2) [c006b0] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 8260802 >2014-04-10 15:35:54,759 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-86) [1b3ce876] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 15:35:54,801 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [1b3ce876] Correlation ID: 1b3ce876, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting status to Non Responsive. >2014-04-10 15:35:54,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-86) [1b3ce876] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-04-10 15:35:54,812 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-86) [1b3ce876] HostName = 10.66.83.216 >2014-04-10 15:35:54,812 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-86) [1b3ce876] Command HSMGetAllTasksStatusesVDS execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-04-10 15:37:10,164 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-93) Start refreshing all users data >2014-04-10 15:37:11,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-04-10 15:37:30,868 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-49) [2ffeeabc] Running command: StopVmCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 15:37:30,875 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-49) [2ffeeabc] START, DestroyVmVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, force=false, secondsToWait=0, gracefully=false), log id: 71a60b43 >2014-04-10 15:37:48,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-2) [c006b0] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 8260802 >2014-04-10 15:37:48,578 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-2) [c006b0] Host 10.66.83.216 storage connection was succeeded >2014-04-10 15:37:48,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) START, ConnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 68c08936 >2014-04-10 15:38:51,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=304, mMessage=Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878']] >2014-04-10 15:38:51,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) HostName = 10.66.83.216 >2014-04-10 15:38:51,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878' >2014-04-10 15:38:51,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-48) FINISH, ConnectStoragePoolVDSCommand, log id: 68c08936 >2014-04-10 15:38:51,019 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (pool-4-thread-48) Could not connect host 10.66.83.216 to pool NFS_shyu, as the master domain is in inactive/unknown status - not failing the operation >2014-04-10 15:38:51,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-2) [c006b0] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 71edc882 >2014-04-10 15:38:51,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-2) [c006b0] FINISH, SetMOMPolicyParametersVDSCommand, log id: 71edc882 >2014-04-10 15:38:51,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-2) [c006b0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.83.216. >2014-04-10 15:38:51,122 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-2) [7fe9e582] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 15:38:51,129 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-2) [1f5f93bd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 15:38:51,141 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 in problem. vds: 10.66.83.216 >2014-04-10 15:38:51,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-49) [2ffeeabc] START, DestroyVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, force=false, secondsToWait=0, gracefully=false), log id: 17956fd0 >2014-04-10 15:38:51,146 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 in problem. vds: 10.66.83.216 >2014-04-10 15:38:54,975 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-74) hostFromVds::selectedVds - 10.66.83.216, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-10 15:38:54,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-74) START, ConnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 1), log id: 3e779d0a >2014-04-10 15:39:18,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-44) starting ProcessDomainRecovery for domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 >2014-04-10 15:39:18,085 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-44) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 was reported by all hosts in status UP as problematic. Not moving the domain to NonOperational because it is being reconstructed now. >2014-04-10 15:39:18,161 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-44) [650ef3e5] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:39:18,229 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-44) [650ef3e5] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 7c543dbd-143a-473f-9095-a0257d455417, ignoreStopFailed = true), log id: 2154446b >2014-04-10 15:39:18,232 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-44) [650ef3e5] START, SpmStopVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 17f890e2 >2014-04-10 15:39:58,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-74) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=304, mMessage=Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878']] >2014-04-10 15:39:58,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-74) HostName = 10.66.83.216 >2014-04-10 15:39:58,307 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-74) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878' >2014-04-10 15:39:58,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, ConnectStoragePoolVDSCommand, log id: 3e779d0a >2014-04-10 15:39:58,308 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-74) IrsBroker::Failed::GetStoragePoolInfoVDS >2014-04-10 15:39:58,308 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-74) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878' >2014-04-10 15:39:58,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (pool-4-thread-44) [650ef3e5] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-04-10 15:39:58,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (pool-4-thread-44) [650ef3e5] HostName = 10.66.83.216 >2014-04-10 15:39:58,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (pool-4-thread-44) [650ef3e5] Command HSMGetAllTasksStatusesVDS execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-04-10 15:39:58,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-44) [650ef3e5] FINISH, SpmStopVDSCommand, log id: 17f890e2 >2014-04-10 15:39:58,354 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-44) [650ef3e5] FINISH, ResetIrsVDSCommand, log id: 2154446b >2014-04-10 15:39:58,356 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-44) [650ef3e5] START, DisconnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1), log id: 3e881d27 >2014-04-10 15:39:58,366 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-44) [650ef3e5] FINISH, DisconnectStoragePoolVDSCommand, log id: 3e881d27 >2014-04-10 15:39:58,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] START, ReconstructMasterVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vdsSpmId = 1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storagePoolName = NFS_shyu, masterDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, masterVersion = 2, domainsList = [{ domainId: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b, status: Maintenance };{ domainId: 55cb7668-7c5e-4553-b263-c6f3f86b358f, status: Unknown };{ domainId: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, status: Unknown };{ domainId: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654, status: Unknown };{ domainId: dbec8cee-b5e4-4011-9dd5-7c122389a878, status: InActive };]), log id: 49d5e58c >2014-04-10 15:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [12be6d12] Autorecovering 1 storage domains >2014-04-10 15:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [12be6d12] Autorecovering storage domains id: dbec8cee-b5e4-4011-9dd5-7c122389a878 >2014-04-10 15:40:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [45e79bf3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:40:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [45e79bf3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 3:40 PM >2014-04-10 15:40:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-46) [455bc426] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 15:40:00,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [455bc426] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1a0a7611 >2014-04-10 15:40:58,604 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-49) [2ffeeabc] FINISH, DestroyVDSCommand, log id: 17956fd0 >2014-04-10 15:40:58,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] Failed in ReconstructMasterVDS method >2014-04-10 15:40:58,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] Error code StorageDomainDoesNotExist and error message VDSGenericException: VDSErrorException: Failed to ReconstructMasterVDS, error = Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',) >2014-04-10 15:40:58,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] Command org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=358, mMessage=Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)]] >2014-04-10 15:40:58,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] HostName = 10.66.83.216 >2014-04-10 15:40:58,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] Command ReconstructMasterVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to ReconstructMasterVDS, error = Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',) >2014-04-10 15:40:58,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-44) [650ef3e5] FINISH, ReconstructMasterVDSCommand, log id: 49d5e58c >2014-04-10 15:40:58,629 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-49) [2ffeeabc] FINISH, DestroyVmVDSCommand, return: Down, log id: 71a60b43 >2014-04-10 15:40:58,629 ERROR [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-44) [650ef3e5] Command org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to ReconstructMasterVDS, error = Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',) (Failed with error StorageDomainDoesNotExist and code 358) >2014-04-10 15:40:58,636 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-44) [650ef3e5] Command [id=03882935-742a-453c-87fa-f61a19e2b55f]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: EntityStatusSnapshot [id=storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageId = dbec8cee-b5e4-4011-9dd5-7c122389a878, status=Unknown]. >2014-04-10 15:40:58,658 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-44) [650ef3e5] Command [id=03882935-742a-453c-87fa-f61a19e2b55f]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=dbec8cee-b5e4-4011-9dd5-7c122389a878. >2014-04-10 15:40:58,663 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [2ffeeabc] Correlation ID: 2ffeeabc, Job ID: c3b911f1-1364-4dff-b6c6-04a0c370fefa, Call Stack: null, Custom Event ID: -1, Message: VM vm1 powered off by admin@internal (Host: 10.66.83.216). >2014-04-10 15:40:58,664 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-44) [650ef3e5] Command [id=03882935-742a-453c-87fa-f61a19e2b55f]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=55cb7668-7c5e-4553-b263-c6f3f86b358f. >2014-04-10 15:40:58,694 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) [650ef3e5] Correlation ID: 650ef3e5, Job ID: dd20fb5c-92a2-4e87-99b9-ae695b84c563, Call Stack: null, Custom Event ID: -1, Message: Failed to Reconstruct Master Domain for Data Center NFS_shyu. >2014-04-10 15:40:58,703 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-50) [2f699e05] Finished reconstruct for pool f721168f-5edd-4f5f-8976-591eb93f960e. Clearing event queue >2014-04-10 15:40:58,705 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-50) [2f699e05] The following operation Event [eventType=RECONSTRUCT, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=55cb7668-7c5e-4553-b263-c6f3f86b358f, vdsId=null, description=IrsBrokerCommand.startReconstruct()] was cancelled, because of reconstruct was run before >2014-04-10 15:40:58,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-44) starting ProcessDomainRecovery for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 >2014-04-10 15:40:58,776 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-44) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 was reported by all hosts in status UP as problematic. Moving the domain to NonOperational. >2014-04-10 15:40:58,811 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-44) [1127fd2d] Lock Acquired to object EngineLock [exclusiveLocks= key: 55cb7668-7c5e-4553-b263-c6f3f86b358f value: STORAGE >, sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 15:40:58,827 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-44) [1127fd2d] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 15:40:58,835 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-44) [1127fd2d] Lock freed to object EngineLock [exclusiveLocks= key: 55cb7668-7c5e-4553-b263-c6f3f86b358f value: STORAGE >, sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 15:40:58,867 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) [1127fd2d] Correlation ID: 1127fd2d, Job ID: 3d040ec6-24a7-4d44-9b5e-486df8742df4, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain2 (Data Center NFS_shyu) was deactivated by system because it's not visible by any of the hosts. >2014-04-10 15:40:58,989 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) hostFromVds::selectedVds - 10.66.83.216, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-10 15:40:59,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-84) START, ConnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, masterVersion = 2), log id: 4a79f829 >2014-04-10 15:41:58,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [455bc426] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 1a0a7611 >2014-04-10 15:41:58,988 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [45e79bf3] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 3:41 PM >2014-04-10 15:42:02,102 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-46) domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 in problem. vds: 10.66.83.216 >2014-04-10 15:42:02,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-84) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=304, mMessage=Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878']] >2014-04-10 15:42:02,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-84) HostName = 10.66.83.216 >2014-04-10 15:42:02,303 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-84) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878' >2014-04-10 15:42:02,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, ConnectStoragePoolVDSCommand, log id: 4a79f829 >2014-04-10 15:42:02,303 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) IrsBroker::Failed::GetStoragePoolInfoVDS >2014-04-10 15:42:02,303 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878' >2014-04-10 15:42:02,383 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-45) [755ad243] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:42:02,542 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-45) [755ad243] START, DisconnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1), log id: 3cabbfb2 >2014-04-10 15:42:02,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-45) [755ad243] FINISH, DisconnectStoragePoolVDSCommand, log id: 3cabbfb2 >2014-04-10 15:42:02,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-45) [755ad243] START, ReconstructMasterVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vdsSpmId = 1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storagePoolName = NFS_shyu, masterDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion = 3, domainsList = [{ domainId: 55cb7668-7c5e-4553-b263-c6f3f86b358f, status: InActive };{ domainId: dbec8cee-b5e4-4011-9dd5-7c122389a878, status: InActive };{ domainId: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b, status: Maintenance };{ domainId: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, status: Unknown };{ domainId: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654, status: Unknown };]), log id: 62932996 >2014-04-10 15:42:12,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-80) Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-04-10 15:42:12,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-80) HostName = 10.66.83.216 >2014-04-10 15:42:12,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-80) Command HSMGetAllTasksStatusesVDS execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-04-10 15:42:12,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-80) hostFromVds::selectedVds - 10.66.83.216, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-10 15:42:12,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-80) START, ConnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1, masterDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion = 3), log id: 79553982 >2014-04-10 15:43:29,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-45) [755ad243] FINISH, ReconstructMasterVDSCommand, log id: 62932996 >2014-04-10 15:43:29,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-46) [755ad243] START, RefreshStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion=3), log id: 554b8315 >2014-04-10 15:44:33,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, ConnectStoragePoolVDSCommand, log id: 79553982 >2014-04-10 15:44:37,584 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-80) hostFromVds::Connected host to pool - selectedVds - 10.66.83.216, spmStatus Free, storage pool NFS_shyu >2014-04-10 15:44:37,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-80) starting spm on vds 10.66.83.216, storage pool NFS_shyu, prevId -1, LVER -1 >2014-04-10 15:44:37,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-80) START, SpmStartVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 79a01634 >2014-04-10 15:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) Autorecovering 2 storage domains >2014-04-10 15:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) Autorecovering storage domains id: 55cb7668-7c5e-4553-b263-c6f3f86b358f >2014-04-10 15:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [10efd5b2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 15:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [10efd5b2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 3:45 PM >2014-04-10 15:45:00,026 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [f37d346] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 15:45:00,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [f37d346] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 32e1e4f9 >2014-04-10 15:45:37,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-46) [755ad243] FINISH, RefreshStoragePoolVDSCommand, log id: 554b8315 >2014-04-10 15:45:37,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-80) spmStart polling started: taskId = 57b9cd75-073c-408d-98d1-cdefa21daec6 >2014-04-10 15:45:37,843 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-4-thread-45) [755ad243] START, MarkPoolInReconstructModeVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 2fb027a8 >2014-04-10 15:45:37,843 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-45) [755ad243] clear domain error-timers for pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 15:45:37,845 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-45) [755ad243] clearing cache for problematic entities in pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 15:45:37,845 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-4-thread-45) [755ad243] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 2fb027a8 >2014-04-10 15:45:37,863 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-45) [755ad243] Correlation ID: 755ad243, Job ID: d8425b4a-0145-46b4-851f-43084ab7a9fa, Call Stack: null, Custom Event ID: -1, Message: Reconstruct Master Domain for Data Center NFS_shyu completed. >2014-04-10 15:45:37,901 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-47) Finished reconstruct for pool f721168f-5edd-4f5f-8976-591eb93f960e. Clearing event queue >2014-04-10 15:45:37,901 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-47) The following operation Event [eventType=DOMAINFAILOVER, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=65eafe2b-4fa9-4ea1-a869-7deb5afd4654, vdsId=null, description=] was cancelled, because of reconstruct was run before >2014-04-10 15:45:37,902 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-47) The following operation Event [eventType=DOMAINFAILOVER, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, vdsId=null, description=] was cancelled, because of reconstruct was run before >2014-04-10 15:46:37,856 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [f37d346] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 32e1e4f9 >2014-04-10 15:46:37,858 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [10efd5b2] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 3:46 PM >2014-04-10 15:46:37,861 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [10efd5b2] Autorecovering storage domains id: dbec8cee-b5e4-4011-9dd5-7c122389a878 >2014-04-10 15:46:37,862 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [472a160c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:46:37,862 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [472a160c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 3:46 PM >2014-04-10 15:46:37,871 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [5389910a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 15:46:37,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5389910a] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 59f5548e >2014-04-10 15:47:37,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5389910a] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 59f5548e >2014-04-10 15:47:37,998 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [472a160c] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 3:47 PM >2014-04-10 15:48:23,849 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [2c2a285] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:48:23,894 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [2c2a285] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 1cabcc59 >2014-04-10 15:48:23,894 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [2c2a285] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1cabcc59 >2014-04-10 15:48:23,894 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [2c2a285] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_IMAGE_REPOSITORY_NOT_FOUND >2014-04-10 15:48:23,894 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [2c2a285] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:48:38,680 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [74fbd374] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:48:38,691 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [74fbd374] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 334254c4 >2014-04-10 15:48:38,691 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [74fbd374] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 334254c4 >2014-04-10 15:48:38,691 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [74fbd374] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_IMAGE_REPOSITORY_NOT_FOUND >2014-04-10 15:48:38,692 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [74fbd374] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:49:00,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-80) spmStart polling ended: taskId = 57b9cd75-073c-408d-98d1-cdefa21daec6 task status = finished >2014-04-10 15:49:00,887 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-80) spmStart polling ended, spm status: SPM >2014-04-10 15:49:00,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-80) START, HSMClearTaskVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, taskId=57b9cd75-073c-408d-98d1-cdefa21daec6), log id: 627f8fa1 >2014-04-10 15:49:00,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, HSMClearTaskVDSCommand, log id: 627f8fa1 >2014-04-10 15:49:00,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@57ab3b3c, log id: 79a01634 >2014-04-10 15:49:00,911 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-80) Initialize Irs proxy from vds: 10.66.83.216 >2014-04-10 15:49:00,927 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-80) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.83.216 (Address: 10.66.83.216). >2014-04-10 15:49:00,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-49) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 5937b392 >2014-04-10 15:49:01,019 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-49) -- executeIrsBrokerCommand: Attempting on storage pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 15:49:01,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-49) START, HSMGetAllTasksInfoVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 7095716f >2014-04-10 15:49:01,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-49) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 7095716f >2014-04-10 15:49:01,030 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-49) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 5937b392 >2014-04-10 15:49:01,030 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-49) Discovered no tasks on Storage Pool NFS_shyu >2014-04-10 15:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) Autorecovering 2 storage domains >2014-04-10 15:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) Autorecovering storage domains id: 55cb7668-7c5e-4553-b263-c6f3f86b358f >2014-04-10 15:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [1cfa9e1c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 15:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [1cfa9e1c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 3:50 PM >2014-04-10 15:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [1f5202e6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 15:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [1f5202e6] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3e6d9ea2 >2014-04-10 15:50:16,117 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-13) [268788d1] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:50:16,172 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-13) [268788d1] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 9bf2a6 >2014-04-10 15:50:16,172 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-13) [268788d1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 9bf2a6 >2014-04-10 15:50:16,175 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-13) [268788d1] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL >2014-04-10 15:50:16,175 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-13) [268788d1] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 15:51:00,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [1f5202e6] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 3e6d9ea2 >2014-04-10 15:51:00,052 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [1cfa9e1c] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 3:51 PM >2014-04-10 15:51:00,054 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [1cfa9e1c] Autorecovering storage domains id: dbec8cee-b5e4-4011-9dd5-7c122389a878 >2014-04-10 15:51:00,055 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [7f576adf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 15:51:00,055 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [7f576adf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 3:51 PM >2014-04-10 15:51:00,070 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [5c261c6c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 15:51:00,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5c261c6c] START, ConnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b6faca4 >2014-04-10 15:52:00,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5c261c6c] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 5b6faca4 >2014-04-10 15:52:00,098 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [7f576adf] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 3:52 PM >2014-04-10 15:54:31,006 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-39) [1e736b86] Storage Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 was reported by Host 10.66.83.216 as Active in Pool f721168f-5edd-4f5f-8976-591eb93f960e, moving to active status >2014-04-10 15:54:31,015 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-39) [1e736b86] Storage Domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 was reported by Host 10.66.83.216 as Active in Pool f721168f-5edd-4f5f-8976-591eb93f960e, moving to active status >2014-04-10 16:00:17,402 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-13) [5dd93c91] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:17,454 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-13) [5dd93c91] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 52017bae >2014-04-10 16:00:17,454 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-13) [5dd93c91] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 52017bae >2014-04-10 16:00:17,552 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [5dd93c91] Running command: RunVmCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 16:00:17,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [5dd93c91] START, IsoPrefixVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 45208345 >2014-04-10 16:00:17,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [5dd93c91] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 45208345 >2014-04-10 16:00:17,621 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [5dd93c91] START, CreateVmVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 1284d415 >2014-04-10 16:00:17,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [5dd93c91] START, CreateVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 5707564b >2014-04-10 16:00:17,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [5dd93c91] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9,devices=[Ljava.util.HashMap;@590bbe9a,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496device_ef2aaeb2-b27c-4be3-923d-a1a40ac25c9ddevice_0d6786d0-00ae-405a-9814-75c4544c9545=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=0d6786d0-00ae-405a-9814-75c4544c9545, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=42554dcc-d35a-4786-88d1-b5600932f9c8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=1b1b4a84-c8e4-441c-9240-e98ce4866404, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=02335a5a-3fe4-4d78-aa0b-4594c43e5496, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496device_ef2aaeb2-b27c-4be3-923d-a1a40ac25c9d=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=ef2aaeb2-b27c-4be3-923d-a1a40ac25c9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-04-10 16:00:17,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [5dd93c91] FINISH, CreateVDSCommand, log id: 5707564b >2014-04-10 16:00:17,719 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [5dd93c91] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 1284d415 >2014-04-10 16:00:17,719 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [5dd93c91] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:17,728 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [5dd93c91] Correlation ID: 5dd93c91, Job ID: 7a49c274-32cd-4d97-ac1f-0e695594fd6e, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.83.216). >2014-04-10 16:00:19,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-69) [610954fd] START, DestroyVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, force=false, secondsToWait=0, gracefully=false), log id: 2d14a2b3 >2014-04-10 16:00:19,711 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-69) [610954fd] FINISH, DestroyVDSCommand, log id: 2d14a2b3 >2014-04-10 16:00:19,737 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) [610954fd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 is down. Exit message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/409d768f-348d-4a6d-a68b-62d87a5870af/bc604dd4-ef89-4074-be72-b3225ac7c434': No such file or directory. >2014-04-10 16:00:19,737 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) [610954fd] Running on vds during rerun failed vm: null >2014-04-10 16:00:19,739 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) [610954fd] vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.83.216 >2014-04-10 16:00:19,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-69) [610954fd] START, FullListVdsCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vds=Host[10.66.83.216], vmIds=[5ad91579-e7e9-4ca3-af75-2aa157c818f9]), log id: 66413146 >2014-04-10 16:00:19,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-69) [610954fd] FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@420a1f1c, log id: 66413146 >2014-04-10 16:00:19,772 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) [610954fd] Rerun vm 5ad91579-e7e9-4ca3-af75-2aa157c818f9. Called from vds 10.66.83.216 >2014-04-10 16:00:19,787 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [610954fd] Correlation ID: 5dd93c91, Job ID: 7a49c274-32cd-4d97-ac1f-0e695594fd6e, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 on Host 10.66.83.216. >2014-04-10 16:00:19,814 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [610954fd] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:19,822 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-49) [610954fd] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 5636d25d >2014-04-10 16:00:19,822 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-49) [610954fd] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5636d25d >2014-04-10 16:00:19,834 WARN [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [610954fd] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT >2014-04-10 16:00:19,834 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [610954fd] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:19,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [610954fd] Correlation ID: 5dd93c91, Job ID: 7a49c274-32cd-4d97-ac1f-0e695594fd6e, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 (User: admin@internal). >2014-04-10 16:00:41,059 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.83.216 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 16:00:48,071 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [31321313] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:48,089 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [31321313] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 44146aa2 >2014-04-10 16:00:48,089 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [31321313] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 44146aa2 >2014-04-10 16:00:48,158 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [31321313] Running command: RunVmCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 16:00:48,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [31321313] START, IsoPrefixVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 3815ad87 >2014-04-10 16:00:48,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-49) [31321313] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 3815ad87 >2014-04-10 16:00:48,218 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [31321313] START, CreateVmVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 50b41f68 >2014-04-10 16:00:48,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [31321313] START, CreateVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 58b9f0f9 >2014-04-10 16:00:48,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [31321313] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9,devices=[Ljava.util.HashMap;@5477db91,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496device_ef2aaeb2-b27c-4be3-923d-a1a40ac25c9ddevice_0d6786d0-00ae-405a-9814-75c4544c9545=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=0d6786d0-00ae-405a-9814-75c4544c9545, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=42554dcc-d35a-4786-88d1-b5600932f9c8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=1b1b4a84-c8e4-441c-9240-e98ce4866404, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=02335a5a-3fe4-4d78-aa0b-4594c43e5496, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496device_ef2aaeb2-b27c-4be3-923d-a1a40ac25c9d=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=ef2aaeb2-b27c-4be3-923d-a1a40ac25c9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-04-10 16:00:48,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-49) [31321313] FINISH, CreateVDSCommand, log id: 58b9f0f9 >2014-04-10 16:00:48,325 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-49) [31321313] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 50b41f68 >2014-04-10 16:00:48,325 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) [31321313] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:48,341 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [31321313] Correlation ID: 31321313, Job ID: 71297abc-f670-44a7-9f8e-e868f944cb8d, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.83.216). >2014-04-10 16:00:50,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-88) START, DestroyVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, force=false, secondsToWait=0, gracefully=false), log id: 5b42e748 >2014-04-10 16:00:50,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, DestroyVDSCommand, log id: 5b42e748 >2014-04-10 16:00:50,183 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 is down. Exit message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/409d768f-348d-4a6d-a68b-62d87a5870af/bc604dd4-ef89-4074-be72-b3225ac7c434': No such file or directory. >2014-04-10 16:00:50,183 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) Running on vds during rerun failed vm: null >2014-04-10 16:00:50,184 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.83.216 >2014-04-10 16:00:50,209 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) Rerun vm 5ad91579-e7e9-4ca3-af75-2aa157c818f9. Called from vds 10.66.83.216 >2014-04-10 16:00:50,224 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) Correlation ID: 31321313, Job ID: 71297abc-f670-44a7-9f8e-e868f944cb8d, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 on Host 10.66.83.216. >2014-04-10 16:00:50,242 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:50,251 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-49) START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 7fa7d6fd >2014-04-10 16:00:50,251 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-49) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7fa7d6fd >2014-04-10 16:00:50,257 WARN [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT >2014-04-10 16:00:50,257 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-49) Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:00:50,283 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) Correlation ID: 31321313, Job ID: 71297abc-f670-44a7-9f8e-e868f944cb8d, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 (User: admin@internal). >2014-04-10 16:09:57,530 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginAdminUserCommand internal: false. >2014-04-10 16:09:57,567 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 16:09:57,628 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginUserCommand internal: false. >2014-04-10 16:09:57,642 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 16:10:53,122 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [24cf2ed7] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:10:53,134 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [24cf2ed7] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 683f3780 >2014-04-10 16:10:53,134 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [24cf2ed7] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 683f3780 >2014-04-10 16:10:53,201 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [24cf2ed7] Running command: RunVmCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 16:10:53,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [24cf2ed7] START, IsoPrefixVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 4216c121 >2014-04-10 16:10:53,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [24cf2ed7] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 4216c121 >2014-04-10 16:10:53,270 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [24cf2ed7] START, CreateVmVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 47edd617 >2014-04-10 16:10:53,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [24cf2ed7] START, CreateVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, vm=VM [vm1]), log id: 74d90919 >2014-04-10 16:10:53,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [24cf2ed7] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9,devices=[Ljava.util.HashMap;@594035a5,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496device_ef2aaeb2-b27c-4be3-923d-a1a40ac25c9ddevice_0d6786d0-00ae-405a-9814-75c4544c9545=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=0d6786d0-00ae-405a-9814-75c4544c9545, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=42554dcc-d35a-4786-88d1-b5600932f9c8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=1b1b4a84-c8e4-441c-9240-e98ce4866404, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=02335a5a-3fe4-4d78-aa0b-4594c43e5496, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1b1b4a84-c8e4-441c-9240-e98ce4866404device_42554dcc-d35a-4786-88d1-b5600932f9c8device_02335a5a-3fe4-4d78-aa0b-4594c43e5496device_ef2aaeb2-b27c-4be3-923d-a1a40ac25c9d=VmDevice {vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, deviceId=ef2aaeb2-b27c-4be3-923d-a1a40ac25c9d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-04-10 16:10:53,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [24cf2ed7] FINISH, CreateVDSCommand, log id: 74d90919 >2014-04-10 16:10:53,368 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [24cf2ed7] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 47edd617 >2014-04-10 16:10:53,368 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [24cf2ed7] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:10:53,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [24cf2ed7] Correlation ID: 24cf2ed7, Job ID: 49f6cfa8-c5e2-4707-8882-74494d8818f5, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.83.216). >2014-04-10 16:10:55,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-18) [ecbeb05] START, DestroyVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, vmId=5ad91579-e7e9-4ca3-af75-2aa157c818f9, force=false, secondsToWait=0, gracefully=false), log id: 5e6d74dc >2014-04-10 16:10:55,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-18) [ecbeb05] FINISH, DestroyVDSCommand, log id: 5e6d74dc >2014-04-10 16:10:55,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [ecbeb05] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 is down. Exit message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/409d768f-348d-4a6d-a68b-62d87a5870af/bc604dd4-ef89-4074-be72-b3225ac7c434': No such file or directory. >2014-04-10 16:10:55,593 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) [ecbeb05] Running on vds during rerun failed vm: null >2014-04-10 16:10:55,595 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) [ecbeb05] vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.83.216 >2014-04-10 16:10:55,620 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) [ecbeb05] Rerun vm 5ad91579-e7e9-4ca3-af75-2aa157c818f9. Called from vds 10.66.83.216 >2014-04-10 16:10:55,635 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [ecbeb05] Correlation ID: 24cf2ed7, Job ID: 49f6cfa8-c5e2-4707-8882-74494d8818f5, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 on Host 10.66.83.216. >2014-04-10 16:10:55,661 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [ecbeb05] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:10:55,669 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-48) [ecbeb05] START, IsVmDuringInitiatingVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 55676b2e >2014-04-10 16:10:55,670 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-48) [ecbeb05] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 55676b2e >2014-04-10 16:10:55,676 WARN [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [ecbeb05] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT >2014-04-10 16:10:55,676 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [ecbeb05] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:10:55,701 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [ecbeb05] Correlation ID: 24cf2ed7, Job ID: 49f6cfa8-c5e2-4707-8882-74494d8818f5, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 (User: admin@internal). >2014-04-10 16:15:07,106 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-14) Running command: LoginUserCommand internal: false. >2014-04-10 16:15:07,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 16:15:07,212 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-14) [46b0a772] Running command: LogoutUserCommand internal: false. >2014-04-10 16:15:07,327 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [46b0a772] Correlation ID: 46b0a772, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-10 16:15:26,986 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-13) Running command: LoginUserCommand internal: false. >2014-04-10 16:15:27,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 16:15:27,083 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-13) [3cd6f4d9] Running command: LogoutUserCommand internal: false. >2014-04-10 16:15:27,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) [3cd6f4d9] Correlation ID: 3cd6f4d9, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-10 16:24:32,564 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-15) [625ae34b] Running command: AddVdsCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 16:24:32,593 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 16:24:32,606 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Lock freed to object EngineLock [exclusiveLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: REGISTER_VDS >, sharedLocks= ] >2014-04-10 16:24:32,607 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Cannot get vdsManager for vdsid=74fba051-b65c-411c-9114-b754f98401b1 >2014-04-10 16:24:32,609 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] START, RemoveVdsVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 35438422 >2014-04-10 16:24:32,610 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Cannot get vdsManager for vdsid=74fba051-b65c-411c-9114-b754f98401b1 >2014-04-10 16:24:32,610 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] FINISH, RemoveVdsVDSCommand, log id: 35438422 >2014-04-10 16:24:32,610 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Cannot get vdsManager for vdsid=74fba051-b65c-411c-9114-b754f98401b1 >2014-04-10 16:24:32,612 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] START, AddVdsVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 1fbd33fc >2014-04-10 16:24:32,612 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] AddVds - entered , starting logic to add VDS 74fba051-b65c-411c-9114-b754f98401b1 >2014-04-10 16:24:32,614 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] AddVds - VDS 74fba051-b65c-411c-9114-b754f98401b1 was added, will try to add it to the resource manager >2014-04-10 16:24:32,614 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Entered VdsManager constructor >2014-04-10 16:24:32,630 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Initialize vdsBroker (10.66.106.40,54,321) >2014-04-10 16:24:32,631 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-15) [2c1ab5e] VDS 74fba051-b65c-411c-9114-b754f98401b1 was added to the Resource Manager >2014-04-10 16:24:32,631 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-15) [2c1ab5e] FINISH, AddVdsVDSCommand, log id: 1fbd33fc >2014-04-10 16:24:32,638 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-10 16:24:32,665 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [2c1ab5e] Correlation ID: 625ae34b, Job ID: 904e88c7-40b7-4b60-8e05-af9d8567f96b, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was added by admin@internal. >2014-04-10 16:24:32,674 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [6f6164ed] Lock Acquired to object EngineLock [exclusiveLocks= key: 74fba051-b65c-411c-9114-b754f98401b1 value: VDS >, sharedLocks= ] >2014-04-10 16:24:32,690 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [6f6164ed] Running command: InstallVdsCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 16:24:32,690 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [6f6164ed] Before Installation host 74fba051-b65c-411c-9114-b754f98401b1, 10.66.106.40 >2014-04-10 16:24:32,695 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [6f6164ed] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, status=Installing, nonOperationalReason=NONE), log id: 399a9ee7 >2014-04-10 16:24:32,707 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [6f6164ed] FINISH, SetVdsStatusVDSCommand, log id: 399a9ee7 >2014-04-10 16:24:32,782 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-48) [6f6164ed] Installation 10.66.106.40: Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd >2014-04-10 16:24:32,799 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [6f6164ed] Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Connected to host 10.66.106.40 with SSH key fingerprint: 1d:ff:7b:fc:2f:43:9a:94:83:21:3d:97:76:47:ea:bd. >2014-04-10 16:24:32,815 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-48) [6f6164ed] Installation of 10.66.106.40. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-04-10 16:24:32,830 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-48) SSH execute root@10.66.106.40 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-04-10 16:24:33,738 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Initializing >2014-04-10 16:24:33,757 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Initializing. >2014-04-10 16:24:33,771 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment setup >2014-04-10 16:24:33,782 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment setup. >2014-04-10 16:24:33,782 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment packages setup >2014-04-10 16:24:33,790 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment packages setup. >2014-04-10 16:24:35,635 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-75) Initializing Host: 10.66.106.40 >2014-04-10 16:24:39,038 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Programs detection >2014-04-10 16:24:39,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Programs detection. >2014-04-10 16:24:39,056 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Environment customization >2014-04-10 16:24:39,073 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Environment customization. >2014-04-10 16:24:39,087 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Logs at host located at: '/tmp/ovirt-host-deploy-20140410162450.log' >2014-04-10 16:24:39,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Logs at host located at: '/tmp/ovirt-host-deploy-20140410162450.log'. >2014-04-10 16:24:39,177 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.66.106.40 reports unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 >2014-04-10 16:24:39,205 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082 to Host 10.66.106.40 >2014-04-10 16:24:39,274 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Setup validation >2014-04-10 16:24:39,289 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Setup validation. >2014-04-10 16:24:39,404 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Hardware supports virtualization >2014-04-10 16:24:39,414 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Hardware supports virtualization. >2014-04-10 16:24:39,428 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction setup >2014-04-10 16:24:39,440 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction setup. >2014-04-10 16:24:39,449 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-10 16:24:39,464 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-10 16:24:39,465 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Package installation >2014-04-10 16:24:39,473 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Package installation. >2014-04-10 16:24:42,475 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Misc configuration >2014-04-10 16:24:42,531 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Misc configuration. >2014-04-10 16:24:42,531 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Setting time >2014-04-10 16:24:42,547 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Setting time. >2014-04-10 16:24:45,317 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Enrolling certificate >2014-04-10 16:24:45,330 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Enrolling certificate. >2014-04-10 16:24:46,489 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Transaction commit >2014-04-10 16:24:46,505 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Transaction commit. >2014-04-10 16:24:46,530 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Closing up >2014-04-10 16:24:46,547 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Closing up. >2014-04-10 16:24:47,696 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stopping libvirtd >2014-04-10 16:24:47,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stopping libvirtd. >2014-04-10 16:24:47,714 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Starting vdsm >2014-04-10 16:24:47,722 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Starting vdsm. >2014-04-10 16:24:49,962 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Pre-termination >2014-04-10 16:24:49,997 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Pre-termination. >2014-04-10 16:24:50,007 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410162450-10.66.106.40-6f6164ed.log' >2014-04-10 16:24:50,021 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140410162450-10.66.106.40-6f6164ed.log'. >2014-04-10 16:24:50,399 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.66.106.40: Stage: Termination >2014-04-10 16:24:50,413 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6f6164ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.66.106.40. Stage: Termination. >2014-04-10 16:24:50,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [6f6164ed] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 16:24:50,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [6f6164ed] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 16:24:50,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [6f6164ed] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 16:24:50,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [6f6164ed] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 16:24:51,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [6f6164ed] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 16:24:51,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-48) [6f6164ed] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-04-10 16:24:52,375 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-48) [6f6164ed] Engine managed to communicate with VDSM agent on host 10.66.106.40 >2014-04-10 16:24:52,558 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [6f6164ed] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, status=Initializing, nonOperationalReason=NONE), log id: 794c74ba >2014-04-10 16:24:52,563 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [6f6164ed] FINISH, SetVdsStatusVDSCommand, log id: 794c74ba >2014-04-10 16:24:52,563 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [6f6164ed] After Installation host 10.66.106.40, VDS >2014-04-10 16:24:52,580 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [6f6164ed] Correlation ID: 6f6164ed, Job ID: 904e88c7-40b7-4b60-8e05-af9d8567f96b, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 installed >2014-04-10 16:24:52,588 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-48) [6f6164ed] Lock freed to object EngineLock [exclusiveLocks= key: 74fba051-b65c-411c-9114-b754f98401b1 value: VDS >, sharedLocks= ] >2014-04-10 16:24:53,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40]), log id: 26873bdd >2014-04-10 16:24:53,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GetHardwareInfoVDSCommand, log id: 26873bdd >2014-04-10 16:24:53,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40]), log id: 53060480 >2014-04-10 16:24:53,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GetHardwareInfoVDSCommand, log id: 53060480 >2014-04-10 16:24:53,963 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.40. >2014-04-10 16:24:53,969 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-54) [74ca8ff] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 16:24:53,973 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-54) [75bef237] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 16:24:54,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-54) [75bef237] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e13f09e >2014-04-10 16:24:54,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-54) [75bef237] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 4e13f09e >2014-04-10 16:24:54,319 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-54) [75bef237] Host 10.66.106.40 storage connection was succeeded >2014-04-10 16:24:54,328 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-49) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion = 3), log id: 43c8e831 >2014-04-10 16:24:57,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-49) FINISH, ConnectStoragePoolVDSCommand, log id: 43c8e831 >2014-04-10 16:24:57,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-54) [75bef237] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 644ac78f >2014-04-10 16:24:58,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-54) [75bef237] FINISH, SetMOMPolicyParametersVDSCommand, log id: 644ac78f >2014-04-10 16:24:58,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) [75bef237] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-10 16:24:58,096 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-54) [3abe4fa2] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 16:24:58,102 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-54) [7dac8568] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 16:25:10,227 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 16:25:23,607 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [dd6b625] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-10 16:25:23,651 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [dd6b625] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 16:25:23,726 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [dd6b625] Correlation ID: dd6b625, Job ID: f3650e4a-f3a8-4288-8d99-8e47e371167c, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was created by admin@internal. >2014-04-10 16:25:23,735 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [dd6b625] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-10 16:25:24,064 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-48) [2baeae57] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-10 16:25:24,104 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-48) [74d5c327] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 Type: VM >2014-04-10 16:25:24,107 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-13) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-10 16:25:24,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [74d5c327] Correlation ID: 74d5c327, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm2. (User: admin@internal) >2014-04-10 16:25:24,160 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-15) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-10 16:25:24,168 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [74d5c327] Correlation ID: 2baeae57, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm2. (User: admin@internal) >2014-04-10 16:25:30,821 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-7) [5646167c] Lock Acquired to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM_DISK_BOOT >, sharedLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >] >2014-04-10 16:25:30,850 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-7) [5646167c] Running command: AddDiskCommand internal: false. Entities affected : ID: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 Type: VM, ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 16:25:30,936 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-7) [5cc082e7] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 16:25:30,961 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-7) [5cc082e7] Lock freed to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM_DISK_BOOT >, sharedLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >] >2014-04-10 16:25:30,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [5cc082e7] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = 87eb91bf-dc8e-4391-82e1-68d5c321787b, imageSizeInBytes = 2147483648, volumeFormat = RAW, newImageId = 75d8c1ab-d3d5-4c8a-8e78-948f0354114d, newImageDescription = ), log id: 2e9018dc >2014-04-10 16:25:30,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [5cc082e7] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-10 16:25:30,962 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [5cc082e7] -- createVolume parameters: > sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=87eb91bf-dc8e-4391-82e1-68d5c321787b > size=2,147,483,648 bytes > volFormat=RAW > volType=Sparse > volUUID=75d8c1ab-d3d5-4c8a-8e78-948f0354114d > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-10 16:25:31,334 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [5cc082e7] FINISH, CreateImageVDSCommand, return: 75d8c1ab-d3d5-4c8a-8e78-948f0354114d, log id: 2e9018dc >2014-04-10 16:25:31,405 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-7) [5cc082e7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 548d81e5-7ea4-4e58-bf54-bfb93b5fd6e6 >2014-04-10 16:25:31,405 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-7) [5cc082e7] CommandMultiAsyncTasks::AttachTask: Attaching task 36690e30-0876-47e0-b4d4-592f26f0ae61 to command 548d81e5-7ea4-4e58-bf54-bfb93b5fd6e6. >2014-04-10 16:25:31,461 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-7) [5cc082e7] Adding task 36690e30-0876-47e0-b4d4-592f26f0ae61 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 16:25:31,778 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [5cc082e7] Correlation ID: 5646167c, Job ID: 6c2dd177-afda-4ade-b4bd-a9d9be424550, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm2_Disk1 was initiated on VM vm2 by admin@internal. >2014-04-10 16:25:31,778 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-7) [5cc082e7] BaseAsyncTask::StartPollingTask: Starting to poll task 36690e30-0876-47e0-b4d4-592f26f0ae61. >2014-04-10 16:25:36,699 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-2) [3fad9d46] Lock Acquired to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:25:36,710 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [3fad9d46] START, IsVmDuringInitiatingVDSCommand( vmId = f1ae6634-10d0-47fe-a4fb-d05ab0893d70), log id: 2e59c4cf >2014-04-10 16:25:36,710 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [3fad9d46] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 2e59c4cf >2014-04-10 16:25:36,714 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-2) [3fad9d46] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_DISKS_LOCKED,$diskAliases vm2_Disk1 >2014-04-10 16:25:36,714 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-2) [3fad9d46] Lock freed to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:25:38,573 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-27) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-10 16:25:38,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-27) Failed in HSMGetAllTasksStatusesVDS method >2014-04-10 16:25:38,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-27) Error code GeneralException and error message VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/87eb91bf-dc8e-4391-82e1-68d5c321787b' >2014-04-10 16:25:38,583 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-27) SPMAsyncTask::PollTask: Polling task 36690e30-0876-47e0-b4d4-592f26f0ae61 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. >2014-04-10 16:25:38,610 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-27) BaseAsyncTask::LogEndTaskFailure: Task 36690e30-0876-47e0-b4d4-592f26f0ae61 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: >-- Result: cleanSuccess >-- Message: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/87eb91bf-dc8e-4391-82e1-68d5c321787b', >-- Exception: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/87eb91bf-dc8e-4391-82e1-68d5c321787b' >2014-04-10 16:25:38,610 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-27) CommandAsyncTask::EndActionIfNecessary: All tasks of command 548d81e5-7ea4-4e58-bf54-bfb93b5fd6e6 has ended -> executing EndAction >2014-04-10 16:25:38,610 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-27) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 548d81e5-7ea4-4e58-bf54-bfb93b5fd6e6): calling EndAction . >2014-04-10 16:25:38,611 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-10 16:25:38,635 ERROR [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-48) [5646167c] Ending command with failure: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-10 16:25:38,642 ERROR [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-48) [5cc082e7] Ending command with failure: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-10 16:25:38,760 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 5646167c, Job ID: 6c2dd177-afda-4ade-b4bd-a9d9be424550, Call Stack: null, Custom Event ID: -1, Message: Operation Add-Disk failed to complete. >2014-04-10 16:25:38,760 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-10 16:25:38,760 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-10 16:25:38,801 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 36690e30-0876-47e0-b4d4-592f26f0ae61 >2014-04-10 16:25:38,802 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 36690e30-0876-47e0-b4d4-592f26f0ae61), log id: 1a100cc1 >2014-04-10 16:25:38,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, taskId=36690e30-0876-47e0-b4d4-592f26f0ae61), log id: 13b56045 >2014-04-10 16:25:38,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 13b56045 >2014-04-10 16:25:38,847 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 1a100cc1 >2014-04-10 16:25:38,868 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task 36690e30-0876-47e0-b4d4-592f26f0ae61 from DataBase >2014-04-10 16:25:38,868 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 548d81e5-7ea4-4e58-bf54-bfb93b5fd6e6 >2014-04-10 16:25:44,256 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-8) [19b61d08] Lock Acquired to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:25:44,264 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-8) [19b61d08] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VM_CANNOT_RUN_FROM_DISK_WITHOUT_DISK >2014-04-10 16:25:44,264 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-8) [19b61d08] Lock freed to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:25:53,903 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-12) [1c7d05b5] Lock Acquired to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:25:53,912 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-12) [1c7d05b5] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VM_CANNOT_RUN_FROM_DISK_WITHOUT_DISK >2014-04-10 16:25:53,912 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-12) [1c7d05b5] Lock freed to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:26:16,243 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-7) [5000a302] Lock Acquired to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:26:16,296 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [5000a302] Running command: RemoveVmCommand internal: false. Entities affected : ID: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 Type: VM >2014-04-10 16:26:16,297 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [5000a302] START, SetVmStatusVDSCommand( vmId = f1ae6634-10d0-47fe-a4fb-d05ab0893d70, status = ImageLocked), log id: 55fa5601 >2014-04-10 16:26:16,302 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [5000a302] FINISH, SetVmStatusVDSCommand, log id: 55fa5601 >2014-04-10 16:26:16,329 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [5000a302] Lock freed to object EngineLock [exclusiveLocks= key: f1ae6634-10d0-47fe-a4fb-d05ab0893d70 value: VM >, sharedLocks= ] >2014-04-10 16:26:16,363 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [5000a302] Correlation ID: 5000a302, Job ID: 2ca278e3-2268-4bd4-aa66-715816b72cf7, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was successfully removed. >2014-04-10 16:26:27,500 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-9) [4497ca2d] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-10 16:26:27,545 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-9) [4497ca2d] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 16:26:27,678 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [4497ca2d] Correlation ID: 4497ca2d, Job ID: 1983677a-4c03-474d-b38a-d84fac4809df, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was created by admin@internal. >2014-04-10 16:26:27,687 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-9) [4497ca2d] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-04-10 16:26:28,242 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-49) [6aae9165] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-10 16:26:28,286 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-49) [691a1d5] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM >2014-04-10 16:26:28,361 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [691a1d5] Correlation ID: 691a1d5, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm2. (User: admin@internal) >2014-04-10 16:26:28,387 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [691a1d5] Correlation ID: 6aae9165, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm2. (User: admin@internal) >2014-04-10 16:26:28,520 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-11) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-10 16:26:28,648 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-8) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-10 16:26:35,812 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) [1784c4ef] Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM_DISK_BOOT >, sharedLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >] >2014-04-10 16:26:35,836 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) [1784c4ef] Running command: AddDiskCommand internal: false. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM, ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:26:35,919 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-1) [2b3a35fb] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:26:35,944 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-1) [2b3a35fb] Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM_DISK_BOOT >, sharedLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >] >2014-04-10 16:26:35,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [2b3a35fb] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = fe90abc5-8638-40e8-b394-9082b3217731, imageSizeInBytes = 2147483648, volumeFormat = RAW, newImageId = 7879e1b7-c238-4222-95eb-e922c5cf80dc, newImageDescription = ), log id: 4e93fcc >2014-04-10 16:26:35,945 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [2b3a35fb] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-10 16:26:35,945 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [2b3a35fb] -- createVolume parameters: > sdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=fe90abc5-8638-40e8-b394-9082b3217731 > size=2,147,483,648 bytes > volFormat=RAW > volType=Sparse > volUUID=7879e1b7-c238-4222-95eb-e922c5cf80dc > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-10 16:26:36,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-1) [2b3a35fb] FINISH, CreateImageVDSCommand, return: 7879e1b7-c238-4222-95eb-e922c5cf80dc, log id: 4e93fcc >2014-04-10 16:26:36,404 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-1) [2b3a35fb] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 6695f2cb-4724-4993-8ca7-58d4aa5a6b3f >2014-04-10 16:26:36,404 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-1) [2b3a35fb] CommandMultiAsyncTasks::AttachTask: Attaching task e3c792ed-e889-4236-ae8a-64ca3ed266d8 to command 6695f2cb-4724-4993-8ca7-58d4aa5a6b3f. >2014-04-10 16:26:36,461 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-1) [2b3a35fb] Adding task e3c792ed-e889-4236-ae8a-64ca3ed266d8 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 16:26:36,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [2b3a35fb] Correlation ID: 1784c4ef, Job ID: 4d0e6030-5393-4774-9816-3ab70027f102, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm2_Disk1 was initiated on VM vm2 by admin@internal. >2014-04-10 16:26:36,717 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-1) [2b3a35fb] BaseAsyncTask::StartPollingTask: Starting to poll task e3c792ed-e889-4236-ae8a-64ca3ed266d8. >2014-04-10 16:26:38,615 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-84) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-10 16:26:38,624 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-84) SPMAsyncTask::PollTask: Polling task e3c792ed-e889-4236-ae8a-64ca3ed266d8 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 16:26:38,652 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-84) BaseAsyncTask::OnTaskEndSuccess: Task e3c792ed-e889-4236-ae8a-64ca3ed266d8 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 16:26:38,652 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-84) CommandAsyncTask::EndActionIfNecessary: All tasks of command 6695f2cb-4724-4993-8ca7-58d4aa5a6b3f has ended -> executing EndAction >2014-04-10 16:26:38,652 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-84) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 6695f2cb-4724-4993-8ca7-58d4aa5a6b3f): calling EndAction . >2014-04-10 16:26:38,653 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-10 16:26:38,669 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-48) [1784c4ef] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-10 16:26:38,686 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-48) [2b3a35fb] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-10 16:26:38,702 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [2b3a35fb] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = fe90abc5-8638-40e8-b394-9082b3217731, imageId = 7879e1b7-c238-4222-95eb-e922c5cf80dc), log id: 31c34389 >2014-04-10 16:26:38,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-48) [2b3a35fb] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a2d38925, log id: 31c34389 >2014-04-10 16:26:38,794 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 1784c4ef, Job ID: 4d0e6030-5393-4774-9816-3ab70027f102, Call Stack: null, Custom Event ID: -1, Message: The disk vm2_Disk1 was successfully added to VM vm2. >2014-04-10 16:26:38,794 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-10 16:26:38,794 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-10 16:26:38,802 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e3c792ed-e889-4236-ae8a-64ca3ed266d8 >2014-04-10 16:26:38,802 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = e3c792ed-e889-4236-ae8a-64ca3ed266d8), log id: 17ab208b >2014-04-10 16:26:38,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, taskId=e3c792ed-e889-4236-ae8a-64ca3ed266d8), log id: 63e591d0 >2014-04-10 16:26:38,846 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 63e591d0 >2014-04-10 16:26:38,846 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 17ab208b >2014-04-10 16:26:38,869 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task e3c792ed-e889-4236-ae8a-64ca3ed266d8 from DataBase >2014-04-10 16:26:38,869 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 6695f2cb-4724-4993-8ca7-58d4aa5a6b3f >2014-04-10 16:26:51,174 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-14) [561f41bd] Lock Acquired to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:26:51,267 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [561f41bd] Running command: RemoveVmCommand internal: false. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 16:26:51,268 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [561f41bd] START, SetVmStatusVDSCommand( vmId = 5ad91579-e7e9-4ca3-af75-2aa157c818f9, status = ImageLocked), log id: 20c6008c >2014-04-10 16:26:51,273 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-48) [561f41bd] FINISH, SetVmStatusVDSCommand, log id: 20c6008c >2014-04-10 16:26:51,284 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) [561f41bd] Lock freed to object EngineLock [exclusiveLocks= key: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 value: VM >, sharedLocks= ] >2014-04-10 16:26:51,314 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-48) [33839d95] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 5ad91579-e7e9-4ca3-af75-2aa157c818f9 Type: VM >2014-04-10 16:26:51,317 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-48) [ccb03bc] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-10 16:26:51,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-48) [ccb03bc] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = 409d768f-348d-4a6d-a68b-62d87a5870af, postZeros = false, forceDelete = false), log id: 5f4582d3 >2014-04-10 16:26:51,655 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-48) [ccb03bc] FINISH, DeleteImageGroupVDSCommand, log id: 5f4582d3 >2014-04-10 16:26:51,721 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) [ccb03bc] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ee791921-7149-4f9f-aba9-397c55a3956c >2014-04-10 16:26:51,722 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-48) [ccb03bc] CommandMultiAsyncTasks::AttachTask: Attaching task d34ec59a-5238-4c3d-bf08-124acdcd0949 to command ee791921-7149-4f9f-aba9-397c55a3956c. >2014-04-10 16:26:51,777 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-48) [ccb03bc] Adding task d34ec59a-5238-4c3d-bf08-124acdcd0949 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 16:26:52,061 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [ccb03bc] Correlation ID: 561f41bd, Job ID: e40d66c3-e2fa-4395-b0d6-9bfb400b1c7c, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was successfully removed. >2014-04-10 16:26:52,061 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) [ccb03bc] BaseAsyncTask::StartPollingTask: Starting to poll task d34ec59a-5238-4c3d-bf08-124acdcd0949. >2014-04-10 16:26:57,093 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-1) [1576206b] Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 16:26:57,104 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [1576206b] START, IsVmDuringInitiatingVDSCommand( vmId = af1debb5-7b64-4d09-8455-850ddba3e546), log id: 7a158372 >2014-04-10 16:26:57,104 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [1576206b] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7a158372 >2014-04-10 16:26:57,210 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [1576206b] Running command: RunVmCommand internal: false. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM >2014-04-10 16:26:57,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [1576206b] START, IsoPrefixVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 4b9fdf94 >2014-04-10 16:26:57,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [1576206b] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 4b9fdf94 >2014-04-10 16:26:57,347 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [1576206b] START, CreateVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, vm=VM [vm2]), log id: 58c20f34 >2014-04-10 16:26:57,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [1576206b] START, CreateVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, vm=VM [vm2]), log id: 76e18865 >2014-04-10 16:26:57,439 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [1576206b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=af1debb5-7b64-4d09-8455-850ddba3e546,devices=[Ljava.util.HashMap;@4e0e43a3,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={} >2014-04-10 16:26:57,439 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [1576206b] FINISH, CreateVDSCommand, log id: 76e18865 >2014-04-10 16:26:57,452 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [1576206b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 58c20f34 >2014-04-10 16:26:57,453 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [1576206b] Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 16:26:57,461 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [1576206b] Correlation ID: 1576206b, Job ID: 749b7068-252b-446e-b9e7-0f21e0c5d387, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was started by admin@internal (Host: 10.66.106.40). >2014-04-10 16:26:58,654 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-04-10 16:26:58,663 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) SPMAsyncTask::PollTask: Polling task d34ec59a-5238-4c3d-bf08-124acdcd0949 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 16:26:58,678 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) BaseAsyncTask::OnTaskEndSuccess: Task d34ec59a-5238-4c3d-bf08-124acdcd0949 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 16:26:58,678 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndActionIfNecessary: All tasks of command ee791921-7149-4f9f-aba9-397c55a3956c has ended -> executing EndAction >2014-04-10 16:26:58,678 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: ee791921-7149-4f9f-aba9-397c55a3956c): calling EndAction . >2014-04-10 16:26:58,678 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-10 16:26:58,702 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-48) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-10 16:26:58,705 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-10 16:26:58,705 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-10 16:26:58,711 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d34ec59a-5238-4c3d-bf08-124acdcd0949 >2014-04-10 16:26:58,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = d34ec59a-5238-4c3d-bf08-124acdcd0949), log id: 1f1fec06 >2014-04-10 16:26:58,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) START, HSMClearTaskVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, taskId=d34ec59a-5238-4c3d-bf08-124acdcd0949), log id: 68c08de0 >2014-04-10 16:26:58,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 68c08de0 >2014-04-10 16:26:58,757 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 1f1fec06 >2014-04-10 16:26:58,777 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task d34ec59a-5238-4c3d-bf08-124acdcd0949 from DataBase >2014-04-10 16:26:58,778 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ee791921-7149-4f9f-aba9-397c55a3956c >2014-04-10 16:26:59,958 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from WaitForLaunch --> PoweringUp >2014-04-10 16:26:59,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) START, FullListVdsCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40], vmIds=[af1debb5-7b64-4d09-8455-850ddba3e546]), log id: 71a56b51 >2014-04-10 16:26:59,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@2328cd21, log id: 71a56b51 >2014-04-10 16:27:02,430 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-21) Setting new tasks map. The map contains now 2 tasks >2014-04-10 16:27:58,089 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from PoweringUp --> Up >2014-04-10 16:27:58,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) Correlation ID: 1576206b, Job ID: 749b7068-252b-446e-b9e7-0f21e0c5d387, Call Stack: null, Custom Event ID: -1, Message: VM vm2 started on Host 10.66.106.40 >2014-04-10 16:28:02,431 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) [472a160c] Setting new tasks map. The map contains now 0 tasks >2014-04-10 16:28:02,432 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) [472a160c] Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-10 16:28:59,087 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 in problem. vds: 10.66.106.40 >2014-04-10 16:28:59,088 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 in problem. vds: 10.66.106.40 >2014-04-10 16:30:00,626 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from Up --> NotResponding >2014-04-10 16:30:00,765 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm2 is not responding. >2014-04-10 16:30:03,907 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-80) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from NotResponding --> Up >2014-04-10 16:30:41,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.83.216 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 16:32:08,101 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from Up --> NotResponding >2014-04-10 16:32:08,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm2 is not responding. >2014-04-10 16:33:00,697 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) [29d39d31] VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from NotResponding --> Up >2014-04-10 16:33:32,006 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-17) [1ab3b076] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 16:33:32,030 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-48) [1ab3b076] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 16:33:32,033 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [1ab3b076] START, SetVdsStatusVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 73199116 >2014-04-10 16:33:32,057 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [1ab3b076] VDS 10.66.83.216 is spm and moved from up calling ResetIrs. >2014-04-10 16:33:32,058 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-48) [1ab3b076] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 7c543dbd-143a-473f-9095-a0257d455417, ignoreStopFailed = false), log id: 40a86c96 >2014-04-10 16:33:32,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-48) [1ab3b076] START, SpmStopVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 1ae27009 >2014-04-10 16:33:32,071 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-48) [1ab3b076] SpmStopVDSCommand::Stopping SPM on vds 10.66.83.216, pool id f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 16:33:32,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-48) [1ab3b076] FINISH, SpmStopVDSCommand, log id: 1ae27009 >2014-04-10 16:33:32,176 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-48) [1ab3b076] FINISH, ResetIrsVDSCommand, log id: 40a86c96 >2014-04-10 16:33:32,176 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-48) [1ab3b076] FINISH, SetVdsStatusVDSCommand, log id: 73199116 >2014-04-10 16:33:32,176 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-48) [1ab3b076] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 16:33:32,226 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-48) [1ab3b076] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 16:33:32,243 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [1ab3b076] Correlation ID: 1ab3b076, Job ID: 1a42cbd5-9be8-442c-9513-4c2fc4300ae3, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.83.216 was switched to Maintenance mode by admin@internal. >2014-04-10 16:33:32,828 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-38) [60c81cea] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 16:33:32,852 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 7c543dbd-143a-473f-9095-a0257d455417 : 10.66.83.216 >2014-04-10 16:33:32,854 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-38) [60c81cea] Correlation ID: 60c81cea, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting status to Non Responsive. >2014-04-10 16:33:32,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) Clearing cache of pool: f721168f-5edd-4f5f-8976-591eb93f960e for problematic entities of VDS: 10.66.83.216. >2014-04-10 16:33:32,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-90) START, DisconnectStoragePoolVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 1), log id: 5fc19ae8 >2014-04-10 16:33:42,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, DisconnectStoragePoolVDSCommand, log id: 5fc19ae8 >2014-04-10 16:33:42,909 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-90) [49f31e30] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 16:33:42,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-90) [49f31e30] START, DisconnectStorageServerVDSCommand(HostName = 10.66.83.216, HostId = 7c543dbd-143a-473f-9095-a0257d455417, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7a4ab3ef >2014-04-10 16:33:46,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-90) [49f31e30] FINISH, DisconnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 7a4ab3ef >2014-04-10 16:33:46,283 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-17) [7de8b416] Lock Acquired to object EngineLock [exclusiveLocks= key: 7c543dbd-143a-473f-9095-a0257d455417 value: VDS >, sharedLocks= ] >2014-04-10 16:33:46,289 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [7de8b416] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 7c543dbd-143a-473f-9095-a0257d455417 Type: VDS >2014-04-10 16:33:46,344 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [7de8b416] START, RemoveVdsVDSCommand( HostId = 7c543dbd-143a-473f-9095-a0257d455417), log id: 396e8362 >2014-04-10 16:33:46,344 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-49) [7de8b416] vdsManager::disposing >2014-04-10 16:33:46,344 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-49) [7de8b416] FINISH, RemoveVdsVDSCommand, log id: 396e8362 >2014-04-10 16:33:46,349 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [7de8b416] Correlation ID: 7de8b416, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.83.216 was removed by admin@internal. >2014-04-10 16:33:46,350 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-49) [7de8b416] Lock freed to object EngineLock [exclusiveLocks= key: 7c543dbd-143a-473f-9095-a0257d455417 value: VDS >, sharedLocks= ] >2014-04-10 16:33:59,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) starting ProcessDomainRecovery for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 >2014-04-10 16:33:59,140 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 was reported by all hosts in status UP as problematic. Not moving the domain to NonOperational because it is being reconstructed now. >2014-04-10 16:33:59,189 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-47) [2dd3e661] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:33:59,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-47) [2dd3e661] START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2), log id: 1eecbcd0 >2014-04-10 16:34:58,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-38) [60c81cea] Command SpmStatusVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Error validating master storage domain: ('MD read error',) >2014-04-10 16:34:58,325 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-38) [60c81cea] hostFromVds::selectedVds - 10.66.106.40, spmStatus returned null! >2014-04-10 16:34:58,325 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-38) [60c81cea] IrsBroker::Failed::GetStoragePoolInfoVDS >2014-04-10 16:34:58,326 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-38) [60c81cea] Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Error validating master storage domain: ('MD read error',) >2014-04-10 16:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) Autorecovering 1 storage domains >2014-04-10 16:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) Autorecovering storage domains id: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 >2014-04-10 16:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [72f8820a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [72f8820a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:35 PM >2014-04-10 16:35:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [1a373660] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:35:00,031 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [1a373660] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3e3fc05b >2014-04-10 16:36:00,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [1a373660] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 3e3fc05b >2014-04-10 16:36:00,051 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [72f8820a] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:36 PM >2014-04-10 16:36:59,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-47) [2dd3e661] Command DisconnectStoragePoolVDS execution failed. Exception: VDSNetworkException: java.util.concurrent.TimeoutException >2014-04-10 16:36:59,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-47) [2dd3e661] FINISH, DisconnectStoragePoolVDSCommand, log id: 1eecbcd0 >2014-04-10 16:36:59,252 ERROR [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-47) [2dd3e661] Command org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022) >2014-04-10 16:36:59,255 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-47) [2dd3e661] Command [id=4d09000f-9975-4d18-a6c1-45a61b9c85e4]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: EntityStatusSnapshot [id=storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, status=Unknown]. >2014-04-10 16:36:59,257 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-47) [2dd3e661] Command [id=4d09000f-9975-4d18-a6c1-45a61b9c85e4]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76. >2014-04-10 16:36:59,258 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-47) [2dd3e661] Command [id=4d09000f-9975-4d18-a6c1-45a61b9c85e4]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=65eafe2b-4fa9-4ea1-a869-7deb5afd4654. >2014-04-10 16:36:59,297 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [2dd3e661] Correlation ID: 2dd3e661, Job ID: 013ffe18-886b-4e5b-bb75-fd772c768fd6, Call Stack: null, Custom Event ID: -1, Message: Failed to Reconstruct Master Domain for Data Center NFS_shyu. >2014-04-10 16:36:59,306 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-49) Finished reconstruct for pool f721168f-5edd-4f5f-8976-591eb93f960e. Clearing event queue >2014-04-10 16:36:59,307 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-49) The following operation Event [eventType=RECONSTRUCT, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=65eafe2b-4fa9-4ea1-a869-7deb5afd4654, vdsId=null, description=IrsBrokerCommand.startReconstruct()] was cancelled, because of reconstruct was run before >2014-04-10 16:36:59,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) starting ProcessDomainRecovery for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 >2014-04-10 16:36:59,376 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 was reported by all hosts in status UP as problematic. Moving the domain to NonOperational. >2014-04-10 16:36:59,398 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-47) [53faf4ce] Lock Acquired to object EngineLock [exclusiveLocks= key: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 value: STORAGE >, sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 16:36:59,415 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-47) [53faf4ce] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 Type: Storage >2014-04-10 16:36:59,432 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-47) [53faf4ce] Lock freed to object EngineLock [exclusiveLocks= key: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 value: STORAGE >, sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 16:36:59,457 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-47) [53faf4ce] Correlation ID: 53faf4ce, Job ID: 6108af1e-f7ac-4520-9063-b6ac7c3401fa, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain4 (Data Center NFS_shyu) was deactivated by system because it's not visible by any of the hosts. >2014-04-10 16:37:02,497 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 in problem. vds: 10.66.106.40 >2014-04-10 16:37:02,499 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 in problem. vds: 10.66.106.40 >2014-04-10 16:37:10,168 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-25) [1befbc1e] Start refreshing all users data >2014-04-10 16:37:11,408 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-04-10 16:37:17,729 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-47) domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 in problem. vds: 10.66.106.40 >2014-04-10 16:37:58,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-60) Command SpmStatusVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Error validating master storage domain: ('MD read error',) >2014-04-10 16:37:58,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-60) hostFromVds::selectedVds - 10.66.106.40, spmStatus returned null! >2014-04-10 16:37:58,484 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-60) IrsBroker::Failed::GetStoragePoolInfoVDS >2014-04-10 16:37:58,484 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-60) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Error validating master storage domain: ('MD read error',) >2014-04-10 16:37:58,557 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-49) [42b34cda] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:37:58,626 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2), log id: 1a6f6ed5 >2014-04-10 16:38:03,336 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-45) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from Up --> NotResponding >2014-04-10 16:38:03,398 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-45) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm2 is not responding. >2014-04-10 16:38:50,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] Failed in DisconnectStoragePoolVDS method >2014-04-10 16:38:50,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] Error code StoragePoolUnknown and error message VDSGenericException: VDSErrorException: Failed to DisconnectStoragePoolVDS, error = Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',) >2014-04-10 16:38:50,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] Command org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=309, mMessage=Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)]] >2014-04-10 16:38:50,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] HostName = 10.66.106.40 >2014-04-10 16:38:50,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] Command DisconnectStoragePoolVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to DisconnectStoragePoolVDS, error = Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',) >2014-04-10 16:38:50,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-49) [42b34cda] FINISH, DisconnectStoragePoolVDSCommand, log id: 1a6f6ed5 >2014-04-10 16:38:50,523 ERROR [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-49) [42b34cda] Command org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to DisconnectStoragePoolVDS, error = Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',) (Failed with error StoragePoolUnknown and code 309) >2014-04-10 16:38:50,525 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-49) [42b34cda] Command [id=59b0c9d2-1f87-492b-ba69-b57385032c18]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: EntityStatusSnapshot [id=storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, status=Unknown]. >2014-04-10 16:38:50,527 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-49) [42b34cda] Command [id=59b0c9d2-1f87-492b-ba69-b57385032c18]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76. >2014-04-10 16:38:50,529 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-49) [42b34cda] Command [id=59b0c9d2-1f87-492b-ba69-b57385032c18]: Compensating CHANGED_ENTITY of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: id=dbec8cee-b5e4-4011-9dd5-7c122389a878. >2014-04-10 16:38:50,575 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-46) Finished reconstruct for pool f721168f-5edd-4f5f-8976-591eb93f960e. Clearing event queue >2014-04-10 16:39:02,965 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-16) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from NotResponding --> Up >2014-04-10 16:39:58,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-73) Command SpmStatusVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Error validating master storage domain: ('MD read error',) >2014-04-10 16:39:58,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-73) hostFromVds::selectedVds - 10.66.106.40, spmStatus returned null! >2014-04-10 16:39:58,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-73) IrsBroker::Failed::GetStoragePoolInfoVDS >2014-04-10 16:39:58,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-73) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Error validating master storage domain: ('MD read error',) >2014-04-10 16:39:58,540 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-46) [78659dcf] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:39:58,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-46) [78659dcf] START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2), log id: 7cb18523 >2014-04-10 16:39:58,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-46) [78659dcf] FINISH, DisconnectStoragePoolVDSCommand, log id: 7cb18523 >2014-04-10 16:39:58,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-46) [78659dcf] START, ReconstructMasterVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vdsSpmId = 2, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storagePoolName = NFS_shyu, masterDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, masterVersion = 6, domainsList = [{ domainId: 55cb7668-7c5e-4553-b263-c6f3f86b358f, status: Unknown };{ domainId: dbec8cee-b5e4-4011-9dd5-7c122389a878, status: Unknown };{ domainId: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654, status: InActive };{ domainId: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, status: InActive };{ domainId: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b, status: Maintenance };]), log id: 1f2e7bdc >2014-04-10 16:40:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-10) [2f699e05] Autorecovering 2 storage domains >2014-04-10 16:40:00,064 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-10) [2f699e05] Autorecovering storage domains id: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 >2014-04-10 16:40:00,064 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [7d3c7f70] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 Type: Storage >2014-04-10 16:40:00,065 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [7d3c7f70] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:40 PM >2014-04-10 16:40:00,079 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [51ccbae3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:40:00,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [51ccbae3] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2096b534 >2014-04-10 16:41:00,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [51ccbae3] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 2096b534 >2014-04-10 16:41:00,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [7d3c7f70] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:41 PM >2014-04-10 16:41:00,117 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-10) [7d3c7f70] Autorecovering storage domains id: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 >2014-04-10 16:41:00,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [3ae99cbf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:41:00,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [3ae99cbf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:41 PM >2014-04-10 16:41:00,128 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [5d1e7287] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:41:00,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5d1e7287] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6c8018e >2014-04-10 16:41:00,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] hostFromVds::selectedVds - 10.66.106.40, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-10 16:41:00,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, masterVersion = 6), log id: 19f9f185 >2014-04-10 16:41:23,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-46) [78659dcf] FINISH, ReconstructMasterVDSCommand, log id: 1f2e7bdc >2014-04-10 16:41:23,462 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [78659dcf] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=55cb7668-7c5e-4553-b263-c6f3f86b358f, masterVersion=6), log id: 55676fed >2014-04-10 16:42:00,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [5d1e7287] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 6c8018e >2014-04-10 16:42:00,644 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [3ae99cbf] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:42 PM >2014-04-10 16:42:25,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] FINISH, ConnectStoragePoolVDSCommand, log id: 19f9f185 >2014-04-10 16:42:30,107 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] hostFromVds::Connected host to pool - selectedVds - 10.66.106.40, spmStatus Free, storage pool NFS_shyu >2014-04-10 16:42:30,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] starting spm on vds 10.66.106.40, storage pool NFS_shyu, prevId -1, LVER -1 >2014-04-10 16:42:30,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] START, SpmStartVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 21fb0df7 >2014-04-10 16:43:30,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [78659dcf] FINISH, RefreshStoragePoolVDSCommand, log id: 55676fed >2014-04-10 16:43:30,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] spmStart polling started: taskId = 14cef35a-8e4f-401f-8b32-f346397180b1 >2014-04-10 16:43:30,301 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-4-thread-46) [78659dcf] START, MarkPoolInReconstructModeVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 1a47e35e >2014-04-10 16:43:30,303 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-46) [78659dcf] clear domain error-timers for pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 16:43:30,303 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-46) [78659dcf] clearing cache for problematic entities in pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 16:43:30,303 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-4-thread-46) [78659dcf] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 1a47e35e >2014-04-10 16:43:30,317 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [78659dcf] Correlation ID: 78659dcf, Job ID: 4c0aa121-2afd-4b6f-84a8-f96970ef2e80, Call Stack: null, Custom Event ID: -1, Message: Reconstruct Master Domain for Data Center NFS_shyu completed. >2014-04-10 16:43:30,325 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-44) Finished reconstruct for pool f721168f-5edd-4f5f-8976-591eb93f960e. Clearing event queue >2014-04-10 16:43:30,325 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-44) The following operation Event [eventType=DOMAINFAILOVER, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, vdsId=null, description=] was cancelled, because of reconstruct was run before >2014-04-10 16:43:30,325 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-44) The following operation Event [eventType=DOMAINFAILOVER, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=55cb7668-7c5e-4553-b263-c6f3f86b358f, vdsId=null, description=] was cancelled, because of reconstruct was run before >2014-04-10 16:43:30,325 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-44) The following operation Event [eventType=DOMAINFAILOVER, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=dbec8cee-b5e4-4011-9dd5-7c122389a878, vdsId=null, description=] was cancelled, because of reconstruct was run before >2014-04-10 16:44:58,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] spmStart polling ended: taskId = 14cef35a-8e4f-401f-8b32-f346397180b1 task status = finished >2014-04-10 16:44:59,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] spmStart polling ended, spm status: SPM >2014-04-10 16:44:59,002 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, taskId=14cef35a-8e4f-401f-8b32-f346397180b1), log id: 7941786a >2014-04-10 16:44:59,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] FINISH, HSMClearTaskVDSCommand, log id: 7941786a >2014-04-10 16:44:59,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@54f1e60e, log id: 21fb0df7 >2014-04-10 16:44:59,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-25) [1befbc1e] Initialize Irs proxy from vds: 10.66.106.40 >2014-04-10 16:44:59,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) [1befbc1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.106.40 (Address: 10.66.106.40). >2014-04-10 16:44:59,073 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-46) [1befbc1e] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 6b6b05fd >2014-04-10 16:44:59,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-46) [1befbc1e] -- executeIrsBrokerCommand: Attempting on storage pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 16:44:59,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-46) [1befbc1e] START, HSMGetAllTasksInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 42dcb59d >2014-04-10 16:44:59,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-46) [1befbc1e] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 42dcb59d >2014-04-10 16:44:59,159 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-46) [1befbc1e] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6b6b05fd >2014-04-10 16:44:59,159 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) [1befbc1e] Discovered no tasks on Storage Pool NFS_shyu >2014-04-10 16:45:00,180 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) Autorecovering 2 storage domains >2014-04-10 16:45:00,180 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) Autorecovering storage domains id: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 >2014-04-10 16:45:00,180 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [a110ee9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 Type: Storage >2014-04-10 16:45:00,180 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [a110ee9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:45 PM >2014-04-10 16:45:00,198 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-46) [2162fb9f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:45:00,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [2162fb9f] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d5afd2c >2014-04-10 16:45:07,947 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from Up --> NotResponding >2014-04-10 16:45:07,979 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-73) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm2 is not responding. >2014-04-10 16:46:00,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [2162fb9f] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 2d5afd2c >2014-04-10 16:46:00,262 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [a110ee9] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:46 PM >2014-04-10 16:46:00,265 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [a110ee9] Autorecovering storage domains id: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 >2014-04-10 16:46:00,265 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [45b0eed6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:46:00,265 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [45b0eed6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:46 PM >2014-04-10 16:46:00,277 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-46) [2734db78] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:46:00,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [2734db78] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 289589f9 >2014-04-10 16:46:03,492 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) VM vm2 af1debb5-7b64-4d09-8455-850ddba3e546 moved from NotResponding --> Up >2014-04-10 16:46:15,737 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-50) [786556db] Running command: StopVmCommand internal: false. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM >2014-04-10 16:46:15,744 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [786556db] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, force=false, secondsToWait=0, gracefully=false), log id: 3400795 >2014-04-10 16:46:15,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [786556db] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, force=false, secondsToWait=0, gracefully=false), log id: 2742e495 >2014-04-10 16:47:00,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [2734db78] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 289589f9 >2014-04-10 16:47:00,308 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [45b0eed6] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:47 PM >2014-04-10 16:49:01,365 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-50) [786556db] FINISH, DestroyVDSCommand, log id: 2742e495 >2014-04-10 16:49:01,411 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-50) [786556db] FINISH, DestroyVmVDSCommand, return: Down, log id: 3400795 >2014-04-10 16:49:01,433 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [786556db] Correlation ID: 786556db, Job ID: c461dd65-9e6a-44ac-9ae6-ddb039af3c1d, Call Stack: null, Custom Event ID: -1, Message: VM vm2 powered off by admin@internal (Host: 10.66.106.40). >2014-04-10 16:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) Autorecovering 2 storage domains >2014-04-10 16:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) Autorecovering storage domains id: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 >2014-04-10 16:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [5a0edb94] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 Type: Storage >2014-04-10 16:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [5a0edb94] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:50 PM >2014-04-10 16:50:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-48) [2194e9d0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:50:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [2194e9d0] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 137692fd >2014-04-10 16:50:36,130 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-17) [670cbdb2] Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 16:50:36,189 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-17) [670cbdb2] START, IsVmDuringInitiatingVDSCommand( vmId = af1debb5-7b64-4d09-8455-850ddba3e546), log id: 1e547e3 >2014-04-10 16:50:36,189 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-17) [670cbdb2] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1e547e3 >2014-04-10 16:50:36,192 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-17) [670cbdb2] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL >2014-04-10 16:50:36,192 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-17) [670cbdb2] Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 16:51:00,044 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [2194e9d0] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0}, log id: 137692fd >2014-04-10 16:51:00,047 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [5a0edb94] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:51 PM >2014-04-10 16:51:00,049 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [5a0edb94] Autorecovering storage domains id: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 >2014-04-10 16:51:00,049 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [1b343828] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 Type: Storage >2014-04-10 16:51:00,049 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [1b343828] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 4:51 PM >2014-04-10 16:51:00,063 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-48) [19a48c43] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 16:51:00,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [19a48c43] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 325ba739 >2014-04-10 16:51:07,541 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-1) [c8b8c52] Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 16:51:07,575 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [c8b8c52] START, IsVmDuringInitiatingVDSCommand( vmId = af1debb5-7b64-4d09-8455-850ddba3e546), log id: fc2aa10 >2014-04-10 16:51:07,576 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [c8b8c52] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: fc2aa10 >2014-04-10 16:51:07,578 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-1) [c8b8c52] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL >2014-04-10 16:51:07,578 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-1) [c8b8c52] Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 16:52:00,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-48) [19a48c43] FINISH, ConnectStorageServerVDSCommand, return: {46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 325ba739 >2014-04-10 16:52:00,091 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [1b343828] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 4:52 PM >2014-04-10 16:53:11,707 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-33) Storage Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 was reported by Host 10.66.106.40 as Active in Pool f721168f-5edd-4f5f-8976-591eb93f960e, moving to active status >2014-04-10 16:53:11,716 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-33) Storage Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 was reported by Host 10.66.106.40 as Active in Pool f721168f-5edd-4f5f-8976-591eb93f960e, moving to active status >2014-04-10 16:55:13,407 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 17:04:11,347 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-15) [5f6576a1] Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 17:04:11,356 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-15) [5f6576a1] START, IsVmDuringInitiatingVDSCommand( vmId = af1debb5-7b64-4d09-8455-850ddba3e546), log id: 65a2cad >2014-04-10 17:04:11,356 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-15) [5f6576a1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 65a2cad >2014-04-10 17:04:11,433 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [5f6576a1] Running command: RunVmCommand internal: false. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM >2014-04-10 17:04:11,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [5f6576a1] START, IsoPrefixVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 2afe73ac >2014-04-10 17:04:11,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-48) [5f6576a1] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111, log id: 2afe73ac >2014-04-10 17:04:11,553 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [5f6576a1] START, CreateVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, vm=VM [vm2]), log id: 487f54f5 >2014-04-10 17:04:11,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [5f6576a1] START, CreateVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, vm=VM [vm2]), log id: 5f57a841 >2014-04-10 17:04:11,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [5f6576a1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=af1debb5-7b64-4d09-8455-850ddba3e546,devices=[Ljava.util.HashMap;@664d389d,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={device_fa4d059c-ddab-4c3a-8509-341559f8e558=VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fa4d059c-ddab-4c3a-8509-341559f8e558, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1=VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fd181a61-26b0-4601-9939-7a2b02bcbfc1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27da=VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=29f87ea5-36e2-4c03-a68b-cb50443d27da, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617=VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=e54df04e-31c0-4569-a0d7-42d5a8528617, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1device_14708876-1be3-4f9e-94fe-12cebd1e1388=VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=14708876-1be3-4f9e-94fe-12cebd1e1388, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-04-10 17:04:11,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-48) [5f6576a1] FINISH, CreateVDSCommand, log id: 5f57a841 >2014-04-10 17:04:11,650 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-48) [5f6576a1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 487f54f5 >2014-04-10 17:04:11,650 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) [5f6576a1] Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 17:04:11,660 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) [5f6576a1] Correlation ID: 5f6576a1, Job ID: a4c486bb-d56f-4d1f-b5d3-7533a0930c63, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was started by admin@internal (Host: 10.66.106.40). >2014-04-10 17:04:13,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-97) START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=af1debb5-7b64-4d09-8455-850ddba3e546, force=false, secondsToWait=0, gracefully=false), log id: 4747b2c7 >2014-04-10 17:04:14,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, DestroyVDSCommand, log id: 4747b2c7 >2014-04-10 17:04:14,293 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm2 is down. Exit message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc': No such file or directory. >2014-04-10 17:04:14,293 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) Running on vds during rerun failed vm: null >2014-04-10 17:04:14,295 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) vm vm2 running in db and not running in vds - add to rerun treatment. vds 10.66.106.40 >2014-04-10 17:04:14,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) START, FullListVdsCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40], vmIds=[af1debb5-7b64-4d09-8455-850ddba3e546]), log id: 37d3e3e3 >2014-04-10 17:04:14,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@4734e325, log id: 37d3e3e3 >2014-04-10 17:04:14,330 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-97) Rerun vm af1debb5-7b64-4d09-8455-850ddba3e546. Called from vds 10.66.106.40 >2014-04-10 17:04:14,343 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 5f6576a1, Job ID: a4c486bb-d56f-4d1f-b5d3-7533a0930c63, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm2 on Host 10.66.106.40. >2014-04-10 17:04:14,369 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 17:04:14,376 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-48) START, IsVmDuringInitiatingVDSCommand( vmId = af1debb5-7b64-4d09-8455-850ddba3e546), log id: 3ffcd996 >2014-04-10 17:04:14,377 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-48) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 3ffcd996 >2014-04-10 17:04:14,409 WARN [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT >2014-04-10 17:04:14,409 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-48) Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 17:04:14,443 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-48) Correlation ID: 5f6576a1, Job ID: a4c486bb-d56f-4d1f-b5d3-7533a0930c63, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm2 (User: admin@internal). >2014-04-10 17:25:26,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [6079cede] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 17:37:10,172 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-19) Start refreshing all users data >2014-04-10 17:37:11,411 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-04-10 17:37:11,412 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 17:37:11,462 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, UpdateVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 7f3ba155 >2014-04-10 17:37:11,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, UpdateVMVDSCommand, log id: 7f3ba155 >2014-04-10 17:37:11,585 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 17:37:11,585 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 17:37:11,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 17:37:11,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 17:37:11,590 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, RemoveVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = e7983b62-8992-42a8-afd7-f7b815d80bbb), log id: 763e177d >2014-04-10 17:37:11,604 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, RemoveVMVDSCommand, log id: 763e177d >2014-04-10 17:37:11,605 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, RemoveVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = c9ccfdfe-0f0d-4c96-8bd7-47723067081a), log id: 603e323e >2014-04-10 17:37:11,617 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, RemoveVMVDSCommand, log id: 603e323e >2014-04-10 17:37:11,618 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, RemoveVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = a3a055b8-512e-47e3-95ec-2a8cfd338eb4), log id: 1354b5cf >2014-04-10 17:37:11,630 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, RemoveVMVDSCommand, log id: 1354b5cf >2014-04-10 17:37:11,630 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, RemoveVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f), log id: 1e6c32f3 >2014-04-10 17:37:11,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, RemoveVMVDSCommand, log id: 1e6c32f3 >2014-04-10 17:37:11,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, RemoveVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 5ad91579-e7e9-4ca3-af75-2aa157c818f9), log id: 5184ff1f >2014-04-10 17:37:11,655 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, RemoveVMVDSCommand, log id: 5184ff1f >2014-04-10 17:37:11,655 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) START, RemoveVMVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = f1ae6634-10d0-47fe-a4fb-d05ab0893d70), log id: 72897608 >2014-04-10 17:37:11,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, RemoveVMVDSCommand, log id: 72897608 >2014-04-10 17:37:11,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 17:37:13,030 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-15) [467f77fe] Running command: LogoutUserCommand internal: false. >2014-04-10 17:37:13,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [467f77fe] Correlation ID: 467f77fe, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-10 17:55:38,241 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-85) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 18:07:14,371 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-14) [2b891a78] Running command: LogoutUserCommand internal: false. >2014-04-10 18:07:14,395 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-14) [2b891a78] Correlation ID: 2b891a78, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-04-10 18:25:50,205 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 18:37:10,177 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-93) Start refreshing all users data >2014-04-10 18:37:11,678 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Attempting to update VMs/Templates Ovf. >2014-04-10 18:37:11,681 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Attempting to update VM OVFs in Data Center NFS_shyu >2014-04-10 18:37:11,695 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Successfully updated VM OVFs in Data Center NFS_shyu >2014-04-10 18:37:11,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Attempting to update template OVFs in Data Center NFS_shyu >2014-04-10 18:37:11,698 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Successfully updated templates OVFs in Data Center NFS_shyu >2014-04-10 18:37:11,698 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Attempting to remove unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 18:37:11,701 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) [40980259] Successfully removed unneeded template/vm OVFs in Data Center NFS_shyu >2014-04-10 18:41:53,378 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-04-10 18:41:53,383 WARN [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-04-10 18:41:53,384 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-04-10 18:41:53,384 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-04-10 18:41:53,385 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-04-10 18:41:53,385 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-04-10 18:41:53,385 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-04-10 18:41:53,385 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_AJP_PORT" is "8702". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_APPS" is "engine.ear redhat-support-plugin-rhev.ear". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-04-10 18:41:53,386 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_HOST" is "localhost". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_PORT" is "5432". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_SECURED" is "False". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_SSL" is "false". >2014-04-10 18:41:53,387 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DB_USER" is "engine". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_FQDN" is "rhevm3.3-shyu.nay.redhat.com". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_GROUP" is "ovirt". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-04-10 18:41:53,388 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_HTTP_PORT" is "None". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PERM_MAX" is "256m". >2014-04-10 18:41:53,389 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PERM_MIN" is "256m". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-04-10 18:41:53,390 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_STOP_TIME" is "10". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_USER" is "ovirt". >2014-04-10 18:41:53,391 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-04-10 18:41:53,392 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-04-10 18:41:53,392 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-04-10 18:41:53,392 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-04-10 18:41:53,392 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 40) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-04-10 18:41:54,203 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Start initializing Backend >2014-04-10 18:41:55,041 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Running ovirt-engine 3.3.1-0.48.el6ev >2014-04-10 18:41:55,044 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 41) Start initializing dictionaries >2014-04-10 18:41:55,048 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 41) Finished initializing dictionaries >2014-04-10 18:41:55,050 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 41) Start initializing AuditLogCleanupManager >2014-04-10 18:41:55,050 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 41) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-04-10 18:41:55,115 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 41) Finished initializing AuditLogCleanupManager >2014-04-10 18:41:55,122 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 41) Start initializing TagsDirector >2014-04-10 18:41:55,149 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 41) Tag root added to tree >2014-04-10 18:41:55,208 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 41) Finished initializing TagsDirector >2014-04-10 18:41:55,214 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 41) Start initializing IsoDomainListSyncronizer >2014-04-10 18:41:55,228 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 41) Finished initializing IsoDomainListSyncronizer >2014-04-10 18:41:55,288 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 41) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-04-10 18:41:55,621 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Completed initializing handlers >2014-04-10 18:41:55,622 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Start initializing ErrorTranslatorImpl >2014-04-10 18:41:55,637 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-04-10 18:41:55,638 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Finished initializing ErrorTranslatorImpl >2014-04-10 18:41:55,638 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Start initializing ErrorTranslatorImpl >2014-04-10 18:41:55,639 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 41) Finished initializing ErrorTranslatorImpl >2014-04-10 18:41:55,640 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 41) Mark incomplete jobs as UNKNOWN >2014-04-10 18:41:55,694 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 41) Start initializing JobRepositoryCleanupManager >2014-04-10 18:41:55,695 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 41) Finished initializing JobRepositoryCleanupManager >2014-04-10 18:41:55,697 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 41) Start initializing AutoRecoveryManager >2014-04-10 18:41:55,698 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 41) Finished initializing AutoRecoveryManager >2014-04-10 18:41:55,701 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 41) Start initializing ExecutionMessageDirector >2014-04-10 18:41:55,705 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 41) Finished initializing ExecutionMessageDirector >2014-04-10 18:41:55,752 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Start initializing UsersDomainsCacheManagerService >2014-04-10 18:41:55,763 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Start initializing DbUserCacheManager >2014-04-10 18:41:55,776 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Finished initializing DbUserCacheManager >2014-04-10 18:41:55,776 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Finished initializing UsersDomainsCacheManagerService >2014-04-10 18:41:55,805 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 41) Initialization of AsyncTaskManager completed successfully. >2014-04-10 18:41:55,812 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 41) Start initializing ResourceManager >2014-04-10 18:41:55,839 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-1) Start refreshing all users data >2014-04-10 18:41:56,082 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 41) Entered VdsManager constructor >2014-04-10 18:41:56,143 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 41) Initialize vdsBroker (10.66.106.40,54,321) >2014-04-10 18:41:56,560 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 41) VDS 74fba051-b65c-411c-9114-b754f98401b1 was added to the Resource Manager >2014-04-10 18:41:56,629 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 41) Finished initializing ResourceManager >2014-04-10 18:41:56,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 41) Initialization of OvfDataUpdater completed successfully. >2014-04-10 18:41:56,651 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Start scheduling to enable vds load balancer >2014-04-10 18:41:56,652 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Finished scheduling to enable vds load balancer >2014-04-10 18:41:56,700 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(13cd719c): Start initializing >2014-04-10 18:41:56,708 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 41) Init VM custom properties utilities >2014-04-10 18:41:56,709 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 41) Init device custom properties utilities >2014-04-10 18:41:56,716 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Initializing Scheduling manager >2014-04-10 18:41:56,773 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(13cd719c): Finished initializing >2014-04-10 18:41:56,789 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) External scheduler disabled, discovery skipped >2014-04-10 18:41:56,789 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 41) Initialized Scheduling manager >2014-04-10 18:41:56,790 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 41) Initializing DWH Heart Beat >2014-04-10 18:42:00,576 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40]), log id: 20bb99a0 >2014-04-10 18:42:00,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GetHardwareInfoVDSCommand, log id: 20bb99a0 >2014-04-10 18:42:00,772 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: UNASSIGNED not exist in string table >2014-04-10 18:42:00,774 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-04-10 18:42:00,775 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-04-10 18:42:00,775 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-04-10 18:42:00,776 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-04-10 18:42:00,776 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: DWH_STOPPED not exist in string table >2014-04-10 18:42:00,776 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: DWH_STARTED not exist in string table >2014-04-10 18:42:00,776 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: DWH_ERROR not exist in string table >2014-04-10 18:42:00,789 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-04-10 18:42:00,789 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-04-10 18:42:00,789 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-04-10 18:42:00,789 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-04-10 18:42:00,789 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-04-10 18:42:00,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-04-10 18:42:00,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-04-10 18:42:00,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-04-10 18:42:00,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_EXTEND_DISK_SIZE_UPDATE_VM_FAILURE not have severity. Assumed Normal >2014-04-10 18:42:00,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-04-10 18:42:00,790 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-04-10 18:42:00,791 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-04-10 18:42:00,791 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-04-10 18:42:00,791 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_UPDATED_MOM_POLICIES not have severity. Assumed Normal >2014-04-10 18:42:00,791 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_TO_UPDATE_MOM_POLICIES not have severity. Assumed Normal >2014-04-10 18:42:00,873 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.40. >2014-04-10 18:42:01,472 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 18:42:01,593 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-3) Initializing Host: 10.66.106.40 >2014-04-10 18:42:01,871 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-3) [1884cf23] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 18:42:06,663 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-9) [7f4c8759] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 18:42:06,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-9) [7f4c8759] Correlation ID: 7f4c8759, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting status to Non Responsive. >2014-04-10 18:42:06,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-9) [7f4c8759] hostFromVds::selectedVds - 10.66.106.40, spmStatus SPM, storage pool NFS_shyu >2014-04-10 18:42:06,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-9) [7f4c8759] Initialize Irs proxy from vds: 10.66.106.40 >2014-04-10 18:42:06,938 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-9) [7f4c8759] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.106.40 (Address: 10.66.106.40). >2014-04-10 18:42:07,109 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-10) [7f4c8759] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 20174d4a >2014-04-10 18:42:07,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-10) [7f4c8759] -- executeIrsBrokerCommand: Attempting on storage pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 18:42:07,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-10) [7f4c8759] START, HSMGetAllTasksInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 56e095d3 >2014-04-10 18:42:07,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-10) [7f4c8759] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 56e095d3 >2014-04-10 18:42:07,271 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-10) [7f4c8759] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 20174d4a >2014-04-10 18:42:07,272 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-10) [7f4c8759] Discovered no tasks on Storage Pool NFS_shyu >2014-04-10 18:42:22,812 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-2) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-04-10 18:42:22,831 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-2) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-04-10 18:42:32,440 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginAdminUserCommand internal: false. >2014-04-10 18:42:32,503 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 18:42:35,715 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginUserCommand internal: false. >2014-04-10 18:42:35,745 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-04-10 18:43:14,886 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-3) [390e611e] Lock Acquired to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 18:43:15,189 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-49) [390e611e] Running command: RemoveVmCommand internal: false. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM >2014-04-10 18:43:15,236 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-49) [390e611e] START, SetVmStatusVDSCommand( vmId = af1debb5-7b64-4d09-8455-850ddba3e546, status = ImageLocked), log id: 6e3cb001 >2014-04-10 18:43:15,267 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-49) [390e611e] FINISH, SetVmStatusVDSCommand, log id: 6e3cb001 >2014-04-10 18:43:15,282 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-49) [390e611e] Lock freed to object EngineLock [exclusiveLocks= key: af1debb5-7b64-4d09-8455-850ddba3e546 value: VM >, sharedLocks= ] >2014-04-10 18:43:15,537 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-49) [9a8f0c9] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: af1debb5-7b64-4d09-8455-850ddba3e546 Type: VM >2014-04-10 18:43:15,598 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-49) [45ec87b5] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-10 18:43:15,725 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-49) [45ec87b5] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, imageGroupId = fe90abc5-8638-40e8-b394-9082b3217731, postZeros = false, forceDelete = false), log id: 8862a55 >2014-04-10 18:43:15,989 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-49) [45ec87b5] FINISH, DeleteImageGroupVDSCommand, log id: 8862a55 >2014-04-10 18:43:16,191 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) [45ec87b5] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 823db556-22ff-4531-9a77-a2d1a130f822 >2014-04-10 18:43:16,192 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-49) [45ec87b5] CommandMultiAsyncTasks::AttachTask: Attaching task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 to command 823db556-22ff-4531-9a77-a2d1a130f822. >2014-04-10 18:43:16,224 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-49) [45ec87b5] Adding task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 18:43:16,440 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [45ec87b5] Correlation ID: 390e611e, Job ID: cfa04739-1089-4f70-b984-4aa68a2522cb, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was successfully removed. >2014-04-10 18:43:16,441 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) [45ec87b5] BaseAsyncTask::StartPollingTask: Starting to poll task 3dbc2fba-0d3c-473d-afca-ee32615bdae8. >2014-04-10 18:43:25,856 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-98) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-10 18:43:25,897 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 18:43:26,014 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 18:43:26,015 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-98) CommandAsyncTask::EndActionIfNecessary: All tasks of command 823db556-22ff-4531-9a77-a2d1a130f822 has ended -> executing EndAction >2014-04-10 18:43:26,017 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-98) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 823db556-22ff-4531-9a77-a2d1a130f822): calling EndAction . >2014-04-10 18:43:26,020 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-10 18:43:26,131 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-49) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-10 18:43:26,135 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-10 18:43:26,135 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-10 18:43:26,172 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 >2014-04-10 18:43:26,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 3dbc2fba-0d3c-473d-afca-ee32615bdae8), log id: 72378041 >2014-04-10 18:43:26,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, taskId=3dbc2fba-0d3c-473d-afca-ee32615bdae8), log id: 3de4b8a2 >2014-04-10 18:43:26,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 3de4b8a2 >2014-04-10 18:43:26,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 72378041 >2014-04-10 18:43:26,222 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 from DataBase >2014-04-10 18:43:26,223 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-49) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 823db556-22ff-4531-9a77-a2d1a130f822 >2014-04-10 18:43:48,557 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-1) [5afdaa2e] Lock Acquired to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-04-10 18:43:48,635 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-1) [5afdaa2e] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: eb01a3cf-3a1d-4bbd-9ae9-bac04512ec71 Type: VdsGroups >2014-04-10 18:43:48,886 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [5afdaa2e] Correlation ID: 5afdaa2e, Job ID: 7d8d32ba-7971-4019-a350-02895f525003, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was created by admin@internal. >2014-04-10 18:43:48,903 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-1) [5afdaa2e] Lock freed to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-04-10 18:43:49,092 INFO [org.ovirt.engine.core.bll.network.vm.AddVmInterfaceCommand] (pool-4-thread-50) [602e7e57] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM, ID: 51aa8dab-ee59-4d2c-8b3a-3509f2e88850 Type: VnicProfile >2014-04-10 18:43:49,151 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-6) MultipleActionsRunner of type UpdateVmInterface invoked with no actions >2014-04-10 18:43:49,222 INFO [org.ovirt.engine.core.bll.network.vm.ActivateDeactivateVmNicCommand] (pool-4-thread-50) [5b900d16] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 18:43:49,227 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (ajp-/127.0.0.1:8702-9) MultipleActionsRunner of type RemoveVmInterface invoked with no actions >2014-04-10 18:43:49,277 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [5b900d16] Correlation ID: 5b900d16, Call Stack: null, Custom Event ID: -1, Message: Network Interface nic1 (VirtIO) was plugged to VM vm1. (User: admin@internal) >2014-04-10 18:43:49,311 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [5b900d16] Correlation ID: 602e7e57, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was added to VM vm1. (User: admin@internal) >2014-04-10 18:43:54,300 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [fdd9c03] Lock Acquired to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM_DISK_BOOT >, sharedLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >] >2014-04-10 18:43:54,344 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [fdd9c03] Running command: AddDiskCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM, ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 18:43:54,482 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [3c959e75] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 18:43:54,544 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [3c959e75] Lock freed to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM_DISK_BOOT >, sharedLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >] >2014-04-10 18:43:54,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c959e75] START, CreateImageVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = ca8224e3-4aff-4e35-87f6-c12059aeb202, imageSizeInBytes = 5368709120, volumeFormat = RAW, newImageId = 24018d18-27a2-462e-94df-c84585e4a0df, newImageDescription = ), log id: 4fe88889 >2014-04-10 18:43:54,547 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c959e75] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-04-10 18:43:54,547 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c959e75] -- createVolume parameters: > sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 > spUUID=f721168f-5edd-4f5f-8976-591eb93f960e > imgGUID=ca8224e3-4aff-4e35-87f6-c12059aeb202 > size=5,368,709,120 bytes > volFormat=RAW > volType=Sparse > volUUID=24018d18-27a2-462e-94df-c84585e4a0df > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2014-04-10 18:43:54,608 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c959e75] FINISH, CreateImageVDSCommand, return: 24018d18-27a2-462e-94df-c84585e4a0df, log id: 4fe88889 >2014-04-10 18:43:54,668 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-5) [3c959e75] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 8f3371d5-6750-4dd3-935b-0b2a49c48012 >2014-04-10 18:43:54,668 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [3c959e75] CommandMultiAsyncTasks::AttachTask: Attaching task 239abfeb-962e-4489-8931-bc77e49bef3b to command 8f3371d5-6750-4dd3-935b-0b2a49c48012. >2014-04-10 18:43:54,685 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [3c959e75] Adding task 239abfeb-962e-4489-8931-bc77e49bef3b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 18:43:54,743 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [3c959e75] Correlation ID: fdd9c03, Job ID: ac64c35e-c662-461c-be6c-580320c25d8f, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm1_Disk1 was initiated on VM vm1 by admin@internal. >2014-04-10 18:43:54,744 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [3c959e75] BaseAsyncTask::StartPollingTask: Starting to poll task 239abfeb-962e-4489-8931-bc77e49bef3b. >2014-04-10 18:43:56,022 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-32) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-04-10 18:43:56,037 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-32) SPMAsyncTask::PollTask: Polling task 239abfeb-962e-4489-8931-bc77e49bef3b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 18:43:56,060 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-32) BaseAsyncTask::OnTaskEndSuccess: Task 239abfeb-962e-4489-8931-bc77e49bef3b (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 18:43:56,062 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-32) CommandAsyncTask::EndActionIfNecessary: All tasks of command 8f3371d5-6750-4dd3-935b-0b2a49c48012 has ended -> executing EndAction >2014-04-10 18:43:56,062 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-32) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 8f3371d5-6750-4dd3-935b-0b2a49c48012): calling EndAction . >2014-04-10 18:43:56,063 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2014-04-10 18:43:56,094 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-4-thread-50) [fdd9c03] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-04-10 18:43:56,113 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-4-thread-50) [3c959e75] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-04-10 18:43:56,138 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [3c959e75] START, GetImageInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = ca8224e3-4aff-4e35-87f6-c12059aeb202, imageId = 24018d18-27a2-462e-94df-c84585e4a0df), log id: 72d3ac93 >2014-04-10 18:43:56,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-4-thread-50) [3c959e75] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@d4091438, log id: 72d3ac93 >2014-04-10 18:43:56,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) Correlation ID: fdd9c03, Job ID: ac64c35e-c662-461c-be6c-580320c25d8f, Call Stack: null, Custom Event ID: -1, Message: The disk vm1_Disk1 was successfully added to VM vm1. >2014-04-10 18:43:56,260 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2014-04-10 18:43:56,260 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2014-04-10 18:43:56,268 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 239abfeb-962e-4489-8931-bc77e49bef3b >2014-04-10 18:43:56,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 239abfeb-962e-4489-8931-bc77e49bef3b), log id: 56d3626f >2014-04-10 18:43:56,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, taskId=239abfeb-962e-4489-8931-bc77e49bef3b), log id: 65828e30 >2014-04-10 18:43:56,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 65828e30 >2014-04-10 18:43:56,291 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 56d3626f >2014-04-10 18:43:56,302 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 239abfeb-962e-4489-8931-bc77e49bef3b from DataBase >2014-04-10 18:43:56,302 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 8f3371d5-6750-4dd3-935b-0b2a49c48012 >2014-04-10 18:44:03,229 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [321c53d2] Lock Acquired to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 18:44:03,250 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [321c53d2] START, IsVmDuringInitiatingVDSCommand( vmId = 350aed0d-0065-47c3-81db-3ae5dc8dbf53), log id: dabde6a >2014-04-10 18:44:03,251 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [321c53d2] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: dabde6a >2014-04-10 18:44:03,368 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [321c53d2] Running command: RunVmCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 18:44:03,466 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [321c53d2] START, IsoPrefixVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 8ac103a >2014-04-10 18:44:03,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-50) [321c53d2] FINISH, IsoPrefixVDSCommand, return: , log id: 8ac103a >2014-04-10 18:44:03,512 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [321c53d2] START, CreateVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, vm=VM [vm1]), log id: 490aca19 >2014-04-10 18:44:03,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [321c53d2] START, CreateVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, vm=VM [vm1]), log id: 516a28f5 >2014-04-10 18:44:03,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [321c53d2] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53,devices=[Ljava.util.HashMap;@26dce003,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={} >2014-04-10 18:44:03,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-50) [321c53d2] FINISH, CreateVDSCommand, log id: 516a28f5 >2014-04-10 18:44:03,701 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-50) [321c53d2] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 490aca19 >2014-04-10 18:44:03,702 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-50) [321c53d2] Lock freed to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 18:44:03,727 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [321c53d2] Correlation ID: 321c53d2, Job ID: e15e063a-395e-46af-b2b0-4a6caa8b327c, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.106.40). >2014-04-10 18:44:05,233 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) VM vm1 350aed0d-0065-47c3-81db-3ae5dc8dbf53 moved from WaitForLaunch --> PoweringUp >2014-04-10 18:44:05,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-44) START, FullListVdsCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40], vmIds=[350aed0d-0065-47c3-81db-3ae5dc8dbf53]), log id: dc562f0 >2014-04-10 18:44:05,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-44) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@19e281a0, log id: dc562f0 >2014-04-10 18:44:55,784 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-99) Setting new tasks map. The map contains now 1 tasks >2014-04-10 18:45:03,842 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) VM vm1 350aed0d-0065-47c3-81db-3ae5dc8dbf53 moved from PoweringUp --> Up >2014-04-10 18:45:03,876 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) Correlation ID: 321c53d2, Job ID: e15e063a-395e-46af-b2b0-4a6caa8b327c, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host 10.66.106.40 >2014-04-10 18:45:25,785 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Setting new tasks map. The map contains now 0 tasks >2014-04-10 18:45:25,786 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-10 18:47:09,324 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 in problem. vds: 10.66.106.40 >2014-04-10 18:47:09,327 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 in problem. vds: 10.66.106.40 >2014-04-10 18:48:34,206 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler_Worker-7) Command GetStatsVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-04-10 18:48:34,206 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-18) Command SpmStatusVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-04-10 18:48:34,211 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) vds::refreshVdsStats Failed getVdsStats, vds = 74fba051-b65c-411c-9114-b754f98401b1 : 10.66.106.40, error = VDSNetworkException: java.net.SocketException: Connection reset >2014-04-10 18:48:34,213 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-18) [33d74f3d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 18:48:34,230 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Failed to refresh VDS , vds = 74fba051-b65c-411c-9114-b754f98401b1 : 10.66.106.40, VDS Network Error, continuing. >java.net.SocketException: Connection reset >2014-04-10 18:48:34,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [33d74f3d] Correlation ID: 33d74f3d, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting Data Center status to Non Responsive (On host 10.66.106.40, Error: Network error during communication with the Host.). >2014-04-10 18:48:34,258 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [33d74f3d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2014-04-10 18:48:37,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSInfoReturnForXmlRpc@31f24018 >2014-04-10 18:48:37,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) HostName = 10.66.106.40 >2014-04-10 18:48:37,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) Command GetCapabilitiesVDS execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-04-10 18:48:37,352 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-41) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:42) > at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:16) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >, Custom Event ID: -1, Message: Host 10.66.106.40 is initializing. Message: Recovering from crash or Initializing >2014-04-10 18:48:37,352 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-41) Failed to refresh VDS , vds = 74fba051-b65c-411c-9114-b754f98401b1 : 10.66.106.40, error = Recovering from crash or Initializing, continuing. >2014-04-10 18:48:40,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GetHardwareInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40]), log id: 67b4b367 >2014-04-10 18:48:40,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GetHardwareInfoVDSCommand, log id: 67b4b367 >2014-04-10 18:48:40,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-45) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.66.106.40. >2014-04-10 18:48:40,604 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-45) Cancelling the recovery from crash timer for VDS 74fba051-b65c-411c-9114-b754f98401b1 because vds started initializing >2014-04-10 18:48:40,619 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-45) [bee3019] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 18:48:40,630 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-45) [575cc023] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 18:48:40,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-45) [575cc023] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2dbc2b87 >2014-04-10 18:48:44,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-47) Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-04-10 18:48:44,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-47) HostName = 10.66.106.40 >2014-04-10 18:48:44,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-47) Command HSMGetAllTasksStatusesVDS execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-04-10 18:50:40,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-45) [575cc023] FINISH, ConnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 2dbc2b87 >2014-04-10 18:50:40,897 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-45) [575cc023] Host 10.66.106.40 storage connection was succeeded >2014-04-10 18:50:40,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, masterVersion = 6), log id: b6fca13 >2014-04-10 18:51:44,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=304, mMessage=Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f']] >2014-04-10 18:51:44,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) HostName = 10.66.106.40 >2014-04-10 18:51:44,278 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f' >2014-04-10 18:51:44,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-4-thread-50) FINISH, ConnectStoragePoolVDSCommand, log id: b6fca13 >2014-04-10 18:51:44,278 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (pool-4-thread-50) Could not connect host 10.66.106.40 to pool NFS_shyu, as the master domain is in inactive/unknown status - not failing the operation >2014-04-10 18:51:44,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-45) [575cc023] START, SetMOMPolicyParametersVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 365a4a30 >2014-04-10 18:51:44,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-45) [575cc023] FINISH, SetMOMPolicyParametersVDSCommand, log id: 365a4a30 >2014-04-10 18:51:44,439 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-45) [575cc023] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host 10.66.106.40. >2014-04-10 18:51:44,486 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-45) [1302d6b6] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 18:51:44,494 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-45) [4a19fd68] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 18:51:44,522 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654:NFS_shyu_domain4 in problem. vds: 10.66.106.40 >2014-04-10 18:51:44,526 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-49) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:NFS_shyu_domain3 in problem. vds: 10.66.106.40 >2014-04-10 18:51:44,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-97) hostFromVds::selectedVds - 10.66.106.40, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-10 18:51:44,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-97) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f, masterVersion = 6), log id: 2140ce0a >2014-04-10 18:52:09,330 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) starting ProcessDomainRecovery for domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 >2014-04-10 18:52:09,408 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878:NFS_shyu_domain1 was reported by all hosts in status UP as problematic. Moving the domain to NonOperational. >2014-04-10 18:52:09,463 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-50) [1394cc60] Lock Acquired to object EngineLock [exclusiveLocks= key: dbec8cee-b5e4-4011-9dd5-7c122389a878 value: STORAGE >, sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 18:52:09,489 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-50) [1394cc60] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 18:52:09,515 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (pool-4-thread-50) [1394cc60] Lock freed to object EngineLock [exclusiveLocks= key: dbec8cee-b5e4-4011-9dd5-7c122389a878 value: STORAGE >, sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 18:52:09,557 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [1394cc60] Correlation ID: 1394cc60, Job ID: 82f0da01-c429-4f75-8607-1ecfcb48a0ec, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain1 (Data Center NFS_shyu) was deactivated by system because it's not visible by any of the hosts. >2014-04-10 18:52:09,576 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) starting ProcessDomainRecovery for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 >2014-04-10 18:52:09,645 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f:NFS_shyu_domain2 was reported by all hosts in status UP as problematic. Not moving the domain to NonOperational because it is being reconstructed now. >2014-04-10 18:52:09,815 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-4-thread-50) [318f801] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 18:52:09,926 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-50) [318f801] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 74fba051-b65c-411c-9114-b754f98401b1, ignoreStopFailed = true), log id: 7e204e2c >2014-04-10 18:52:09,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [318f801] START, SpmStopVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 3e8da294 >2014-04-10 18:52:09,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (pool-4-thread-50) [318f801] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM: ()]] > >2014-04-10 18:52:09,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (pool-4-thread-50) [318f801] HostName = 10.66.106.40 >2014-04-10 18:52:09,953 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (pool-4-thread-50) [318f801] Command HSMGetAllTasksStatusesVDS execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: () >2014-04-10 18:52:09,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [318f801] FINISH, SpmStopVDSCommand, log id: 3e8da294 >2014-04-10 18:52:09,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-50) [318f801] FINISH, ResetIrsVDSCommand, log id: 7e204e2c >2014-04-10 18:52:09,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-50) [318f801] START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2), log id: 7b0b0011 >2014-04-10 18:52:09,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (pool-4-thread-50) [318f801] FINISH, DisconnectStoragePoolVDSCommand, log id: 7b0b0011 >2014-04-10 18:52:09,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-50) [318f801] START, ReconstructMasterVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vdsSpmId = 2, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storagePoolName = NFS_shyu, masterDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion = 7, domainsList = [{ domainId: 22e307a4-41f0-4c25-8c1a-ef6aa5117e2b, status: Maintenance };{ domainId: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, status: Unknown };{ domainId: 65eafe2b-4fa9-4ea1-a869-7deb5afd4654, status: Unknown };{ domainId: dbec8cee-b5e4-4011-9dd5-7c122389a878, status: InActive };{ domainId: 55cb7668-7c5e-4553-b263-c6f3f86b358f, status: InActive };]), log id: 86dce55 >2014-04-10 18:52:47,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-97) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=304, mMessage=Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f']] >2014-04-10 18:52:47,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-97) HostName = 10.66.106.40 >2014-04-10 18:52:47,074 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-97) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f' >2014-04-10 18:52:47,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, ConnectStoragePoolVDSCommand, log id: 2140ce0a >2014-04-10 18:52:47,074 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-97) IrsBroker::Failed::GetStoragePoolInfoVDS >2014-04-10 18:52:47,074 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-97) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f' >2014-04-10 18:52:57,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-71) hostFromVds::selectedVds - 10.66.106.40, spmStatus Unknown_Pool, storage pool NFS_shyu >2014-04-10 18:52:57,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-71) START, ConnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2, masterDomainId = f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion = 7), log id: 555177 >2014-04-10 18:54:12,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ReconstructMasterVDSCommand] (pool-4-thread-50) [318f801] FINISH, ReconstructMasterVDSCommand, log id: 86dce55 >2014-04-10 18:54:12,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [318f801] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion=7), log id: 31f06a2a >2014-04-10 18:55:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) Autorecovering 2 storage domains >2014-04-10 18:55:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) Autorecovering storage domains id: dbec8cee-b5e4-4011-9dd5-7c122389a878 >2014-04-10 18:55:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [567b5e96] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 18:55:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [567b5e96] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 6:55 PM >2014-04-10 18:55:00,057 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-45) [26f5804c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 18:55:00,064 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-45) [26f5804c] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f89d6cc >2014-04-10 18:55:16,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, ConnectStoragePoolVDSCommand, log id: 555177 >2014-04-10 18:56:16,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-45) [26f5804c] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 7f89d6cc >2014-04-10 18:56:16,188 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [567b5e96] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 6:56 PM >2014-04-10 18:56:16,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-71) hostFromVds::Connected host to pool - selectedVds - 10.66.106.40, spmStatus Free, storage pool NFS_shyu >2014-04-10 18:56:16,208 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [567b5e96] Autorecovering storage domains id: 55cb7668-7c5e-4553-b263-c6f3f86b358f >2014-04-10 18:56:16,210 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [26dce09e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 18:56:16,210 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [26dce09e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 6:56 PM >2014-04-10 18:56:16,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-71) starting spm on vds 10.66.106.40, storage pool NFS_shyu, prevId -1, LVER -1 >2014-04-10 18:56:16,232 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-46) [553ef988] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 18:56:16,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-71) START, SpmStartVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 52e3d675 >2014-04-10 18:56:16,241 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [553ef988] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2b8374ad >2014-04-10 18:56:18,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-47) [318f801] FINISH, RefreshStoragePoolVDSCommand, log id: 31f06a2a >2014-04-10 18:56:18,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-71) spmStart polling started: taskId = e7c56099-afb9-407a-991d-cb6b72ddd351 >2014-04-10 18:56:18,658 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-4-thread-50) [318f801] START, MarkPoolInReconstructModeVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 43d1c3f7 >2014-04-10 18:56:18,658 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) [318f801] clear domain error-timers for pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 18:56:18,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-50) [318f801] clearing cache for problematic entities in pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 18:56:18,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-4-thread-50) [318f801] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 43d1c3f7 >2014-04-10 18:56:18,787 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [318f801] Correlation ID: 318f801, Job ID: 3f012338-a038-4537-9c26-c6a15f6c5cca, Call Stack: null, Custom Event ID: -1, Message: Reconstruct Master Domain for Data Center NFS_shyu completed. >2014-04-10 18:56:18,821 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-49) Finished reconstruct for pool f721168f-5edd-4f5f-8976-591eb93f960e. Clearing event queue >2014-04-10 18:56:18,822 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-49) The following operation Event [eventType=RECONSTRUCT, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, vdsId=null, description=IrsBrokerCommand.startReconstruct()] was cancelled, because of reconstruct was run before >2014-04-10 18:56:18,822 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-4-thread-49) The following operation Event [eventType=DOMAINMONITORING, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e, domainId=null, vdsId=74fba051-b65c-411c-9114-b754f98401b1, description=] was cancelled, because of reconstruct was run before >2014-04-10 18:57:18,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-46) [553ef988] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 2b8374ad >2014-04-10 18:57:18,641 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [26dce09e] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 6:57 PM >2014-04-10 18:58:33,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-71) spmStart polling ended: taskId = e7c56099-afb9-407a-991d-cb6b72ddd351 task status = finished >2014-04-10 18:58:33,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-71) spmStart polling ended, spm status: SPM >2014-04-10 18:58:33,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-71) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, taskId=e7c56099-afb9-407a-991d-cb6b72ddd351), log id: 4e2a9940 >2014-04-10 18:58:33,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, HSMClearTaskVDSCommand, log id: 4e2a9940 >2014-04-10 18:58:33,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@58f7cac7, log id: 52e3d675 >2014-04-10 18:58:33,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-71) Initialize Irs proxy from vds: 10.66.106.40 >2014-04-10 18:58:33,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host 10.66.106.40 (Address: 10.66.106.40). >2014-04-10 18:58:33,732 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-46) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false), log id: 31e1f1b9 >2014-04-10 18:58:33,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-46) -- executeIrsBrokerCommand: Attempting on storage pool f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 18:58:33,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-46) START, HSMGetAllTasksInfoVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 152dba9e >2014-04-10 18:58:33,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (pool-4-thread-46) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 152dba9e >2014-04-10 18:58:33,812 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (pool-4-thread-46) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 31e1f1b9 >2014-04-10 18:58:33,812 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-46) Discovered no tasks on Storage Pool NFS_shyu >2014-04-10 18:58:49,837 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-46) [4c7647d0] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 18:58:49,841 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-46) [4c7647d0] Entered (VM vm1). >2014-04-10 18:58:49,841 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (pool-4-thread-46) [4c7647d0] Sending shutdown command for VM vm1. >2014-04-10 18:58:49,848 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [4c7647d0] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, force=false, secondsToWait=30, gracefully=true), log id: 1a829bf2 >2014-04-10 18:58:49,854 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [4c7647d0] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, force=false, secondsToWait=30, gracefully=true), log id: d1925d2 >2014-04-10 18:58:49,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [4c7647d0] FINISH, DestroyVDSCommand, log id: d1925d2 >2014-04-10 18:58:49,878 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [4c7647d0] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 1a829bf2 >2014-04-10 18:58:49,912 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [4c7647d0] Correlation ID: 4c7647d0, Job ID: 780bcce6-b537-4580-87d9-c321ea97a935, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin@internal on VM vm1 (Host: 10.66.106.40). >2014-04-10 18:59:55,736 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-4-thread-46) [690093bc] Running command: StopVmCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 18:59:55,745 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [690093bc] START, DestroyVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, force=false, secondsToWait=0, gracefully=false), log id: 55f382bc >2014-04-10 18:59:55,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [690093bc] START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, force=false, secondsToWait=0, gracefully=false), log id: 28ea97f7 >2014-04-10 19:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) Autorecovering 2 storage domains >2014-04-10 19:00:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) Autorecovering storage domains id: dbec8cee-b5e4-4011-9dd5-7c122389a878 >2014-04-10 19:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [eaabeb7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 19:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [eaabeb7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 7:00 PM >2014-04-10 19:00:00,033 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [5598b9c6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 19:00:00,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [5598b9c6] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 78db426b >2014-04-10 19:01:00,069 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [5598b9c6] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 78db426b >2014-04-10 19:01:00,071 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [eaabeb7] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 7:01 PM >2014-04-10 19:01:00,075 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [eaabeb7] Autorecovering storage domains id: 55cb7668-7c5e-4553-b263-c6f3f86b358f >2014-04-10 19:01:00,076 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [3bae4b09] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 19:01:00,076 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [3bae4b09] ConnectDomainToStorage. Before Connect all hosts to pool. Time:4/10/14 7:01 PM >2014-04-10 19:01:00,092 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-50) [1047a8b0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 19:01:00,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [1047a8b0] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1055ddc3 >2014-04-10 19:02:00,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-50) [1047a8b0] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 1055ddc3 >2014-04-10 19:02:00,139 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [3bae4b09] ConnectDomainToStorage. After Connect all hosts to pool. Time:4/10/14 7:02 PM >2014-04-10 19:02:48,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-4-thread-46) [690093bc] FINISH, DestroyVDSCommand, log id: 28ea97f7 >2014-04-10 19:02:48,972 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-4-thread-46) [690093bc] FINISH, DestroyVmVDSCommand, return: Down, log id: 55f382bc >2014-04-10 19:02:48,997 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [690093bc] Correlation ID: 690093bc, Job ID: bafe9b2a-2f7c-4945-8ceb-4495d900126f, Call Stack: null, Custom Event ID: -1, Message: VM vm1 powered off by admin@internal (Host: 10.66.106.40). >2014-04-10 19:02:59,521 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [5b588c0f] Lock Acquired to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:02:59,536 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [5b588c0f] START, IsVmDuringInitiatingVDSCommand( vmId = 350aed0d-0065-47c3-81db-3ae5dc8dbf53), log id: 4f9e0dad >2014-04-10 19:02:59,537 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [5b588c0f] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4f9e0dad >2014-04-10 19:02:59,540 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [5b588c0f] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_STORAGE_DOMAIN_STATUS_ILLEGAL >2014-04-10 19:02:59,540 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-10) [5b588c0f] Lock freed to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:03:41,324 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [714ba2cd] Lock Acquired to object EngineLock [exclusiveLocks= key: 55cb7668-7c5e-4553-b263-c6f3f86b358f value: STORAGE >, sharedLocks= ] >2014-04-10 19:03:41,424 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-46) [714ba2cd] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 55cb7668-7c5e-4553-b263-c6f3f86b358f Type: Storage >2014-04-10 19:03:41,441 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-46) [714ba2cd] Lock freed to object EngineLock [exclusiveLocks= key: 55cb7668-7c5e-4553-b263-c6f3f86b358f value: STORAGE >, sharedLocks= ] >2014-04-10 19:03:41,441 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-46) [714ba2cd] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/10/14 7:03 PM >2014-04-10 19:03:41,448 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-43) [2603568] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 19:03:41,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-43) [2603568] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 55347f6b >2014-04-10 19:03:50,459 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [a43d49a] Lock Acquired to object EngineLock [exclusiveLocks= key: dbec8cee-b5e4-4011-9dd5-7c122389a878 value: STORAGE >, sharedLocks= ] >2014-04-10 19:03:50,539 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [a43d49a] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: dbec8cee-b5e4-4011-9dd5-7c122389a878 Type: Storage >2014-04-10 19:03:50,556 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [a43d49a] Lock freed to object EngineLock [exclusiveLocks= key: dbec8cee-b5e4-4011-9dd5-7c122389a878 value: STORAGE >, sharedLocks= ] >2014-04-10 19:03:50,556 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [a43d49a] ActivateStorage Domain. Before Connect all hosts to pool. Time:4/10/14 7:03 PM >2014-04-10 19:03:50,563 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-4-thread-49) [321d53a7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-04-10 19:03:50,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [321d53a7] START, ConnectStorageServerVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 635ae751 >2014-04-10 19:04:41,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-43) [2603568] FINISH, ConnectStorageServerVDSCommand, return: {8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0}, log id: 55347f6b >2014-04-10 19:04:41,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-4-thread-46) [714ba2cd] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = 55cb7668-7c5e-4553-b263-c6f3f86b358f), log id: 4ef332c7 >2014-04-10 19:04:50,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-4-thread-49) [321d53a7] FINISH, ConnectStorageServerVDSCommand, return: {3a621f65-7d4c-4e19-8f42-a133992d810e=0}, log id: 635ae751 >2014-04-10 19:04:50,595 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-4-thread-50) [a43d49a] START, ActivateStorageDomainVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878), log id: 3a95b104 >2014-04-10 19:05:22,726 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-4-thread-46) [714ba2cd] FINISH, ActivateStorageDomainVDSCommand, log id: 4ef332c7 >2014-04-10 19:05:22,726 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-46) [714ba2cd] ActivateStorage Domain. After Connect all hosts to pool. Time:4/10/14 7:05 PM >2014-04-10 19:05:22,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [714ba2cd] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion=7), log id: 70f3c21b >2014-04-10 19:05:22,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-49) [714ba2cd] FINISH, RefreshStoragePoolVDSCommand, log id: 70f3c21b >2014-04-10 19:05:22,862 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-49) [714ba2cd] Refreshed vds 10.66.106.40 in pool NFS_shyu >2014-04-10 19:05:22,868 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-46) [714ba2cd] ActivateStorage Domain. After change storage pool status in vds. Time:4/10/14 7:05 PM >2014-04-10 19:05:22,893 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-46) [714ba2cd] Correlation ID: 714ba2cd, Job ID: 5e2115f5-3a32-4bf5-b70e-1e10c8e7a008, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain2 (Data Center NFS_shyu) was activated by admin@internal >2014-04-10 19:05:22,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-4-thread-50) [a43d49a] FINISH, ActivateStorageDomainVDSCommand, log id: 3a95b104 >2014-04-10 19:05:22,992 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [a43d49a] ActivateStorage Domain. After Connect all hosts to pool. Time:4/10/14 7:05 PM >2014-04-10 19:05:23,002 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-44) [a43d49a] START, RefreshStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, masterStorageDomainId=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76, masterVersion=7), log id: 34530114 >2014-04-10 19:05:23,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-4-thread-44) [a43d49a] FINISH, RefreshStoragePoolVDSCommand, log id: 34530114 >2014-04-10 19:05:23,020 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-4-thread-44) [a43d49a] Refreshed vds 10.66.106.40 in pool NFS_shyu >2014-04-10 19:05:23,026 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-4-thread-50) [a43d49a] ActivateStorage Domain. After change storage pool status in vds. Time:4/10/14 7:05 PM >2014-04-10 19:05:23,043 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [a43d49a] Correlation ID: a43d49a, Job ID: 6c2dccb4-9a5c-4426-a59a-4e032193c1ed, Call Stack: null, Custom Event ID: -1, Message: Storage Domain NFS_shyu_domain1 (Data Center NFS_shyu) was activated by admin@internal >2014-04-10 19:05:54,733 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-2) [1768f22c] Lock Acquired to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:05:54,745 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [1768f22c] START, IsVmDuringInitiatingVDSCommand( vmId = 350aed0d-0065-47c3-81db-3ae5dc8dbf53), log id: 76e42b29 >2014-04-10 19:05:54,745 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [1768f22c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 76e42b29 >2014-04-10 19:05:54,813 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-44) [1768f22c] Running command: RunVmCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 19:05:54,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-44) [1768f22c] START, IsoPrefixVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId=f721168f-5edd-4f5f-8976-591eb93f960e), log id: 59b66f26 >2014-04-10 19:05:54,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (pool-4-thread-44) [1768f22c] FINISH, IsoPrefixVDSCommand, return: , log id: 59b66f26 >2014-04-10 19:05:54,910 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-44) [1768f22c] START, CreateVmVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, vm=VM [vm1]), log id: 7bd57bea >2014-04-10 19:05:54,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-44) [1768f22c] START, CreateVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, vm=VM [vm1]), log id: 30cd1446 >2014-04-10 19:05:54,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-44) [1768f22c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53,devices=[Ljava.util.HashMap;@3987b6b5,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8=VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=3f4abec1-fd21-4c3d-8f71-b1110fc649d8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8=VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6cdevice_2f8a9f72-f5aa-4562-85a6-f4d4be037f46=VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=2f8a9f72-f5aa-4562-85a6-f4d4be037f46, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_d4971727-a68a-4a36-9ce7-a977cadc3484=VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=d4971727-a68a-4a36-9ce7-a977cadc3484, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6c=VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=1b191d45-c2db-4105-86ba-e11fae154a6c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-04-10 19:05:54,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-4-thread-44) [1768f22c] FINISH, CreateVDSCommand, log id: 30cd1446 >2014-04-10 19:05:54,999 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-4-thread-44) [1768f22c] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7bd57bea >2014-04-10 19:05:54,999 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-44) [1768f22c] Lock freed to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:05:55,007 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) [1768f22c] Correlation ID: 1768f22c, Job ID: 960e12d2-ba90-4759-8945-bdbee2e50ace, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin@internal (Host: 10.66.106.40). >2014-04-10 19:05:57,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-92) START, DestroyVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, force=false, secondsToWait=0, gracefully=false), log id: 116a824f >2014-04-10 19:05:57,880 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, DestroyVDSCommand, log id: 116a824f >2014-04-10 19:05:57,907 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-92) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM vm1 is down. Exit message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df': No such file or directory. >2014-04-10 19:05:57,907 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) Running on vds during rerun failed vm: null >2014-04-10 19:05:57,910 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) vm vm1 running in db and not running in vds - add to rerun treatment. vds 10.66.106.40 >2014-04-10 19:05:57,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-92) START, FullListVdsCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, vds=Host[10.66.106.40], vmIds=[350aed0d-0065-47c3-81db-3ae5dc8dbf53]), log id: 2c71cc93 >2014-04-10 19:05:57,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-92) FINISH, FullListVdsCommand, return: [Ljava.util.HashMap;@632dddb0, log id: 2c71cc93 >2014-04-10 19:05:57,950 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) Rerun vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53. Called from vds 10.66.106.40 >2014-04-10 19:05:57,965 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) Correlation ID: 1768f22c, Job ID: 960e12d2-ba90-4759-8945-bdbee2e50ace, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 on Host 10.66.106.40. >2014-04-10 19:05:57,998 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-44) Lock Acquired to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:05:58,006 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-44) START, IsVmDuringInitiatingVDSCommand( vmId = 350aed0d-0065-47c3-81db-3ae5dc8dbf53), log id: 60eb71d2 >2014-04-10 19:05:58,007 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (pool-4-thread-44) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 60eb71d2 >2014-04-10 19:05:58,014 WARN [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-44) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT >2014-04-10 19:05:58,014 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-4-thread-44) Lock freed to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:05:58,040 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) Correlation ID: 1768f22c, Job ID: 960e12d2-ba90-4759-8945-bdbee2e50ace, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM vm1 (User: admin@internal). >2014-04-10 19:12:12,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-29) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Available swap memory of host 10.66.106.40 [1023 MB] is under defined threshold [1024 MB]. >2014-04-10 19:25:15,750 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (ajp-/127.0.0.1:8702-7) [416fae3a] Lock Acquired to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:25:15,833 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [416fae3a] Running command: RemoveVmCommand internal: false. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 19:25:15,834 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [416fae3a] START, SetVmStatusVDSCommand( vmId = 350aed0d-0065-47c3-81db-3ae5dc8dbf53, status = ImageLocked), log id: 6519449a >2014-04-10 19:25:15,842 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-4-thread-50) [416fae3a] FINISH, SetVmStatusVDSCommand, log id: 6519449a >2014-04-10 19:25:15,850 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) [416fae3a] Lock freed to object EngineLock [exclusiveLocks= key: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 value: VM >, sharedLocks= ] >2014-04-10 19:25:15,920 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (pool-4-thread-50) [bb76303] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 350aed0d-0065-47c3-81db-3ae5dc8dbf53 Type: VM >2014-04-10 19:25:15,939 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-4-thread-50) [1d434f69] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-04-10 19:25:15,951 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [1d434f69] START, DeleteImageGroupVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, storageDomainId = dbec8cee-b5e4-4011-9dd5-7c122389a878, imageGroupId = ca8224e3-4aff-4e35-87f6-c12059aeb202, postZeros = false, forceDelete = false), log id: 716cd72b >2014-04-10 19:25:16,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-4-thread-50) [1d434f69] FINISH, DeleteImageGroupVDSCommand, log id: 716cd72b >2014-04-10 19:25:16,474 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) [1d434f69] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0b3432b8-baa5-4343-8bc1-5ddee417f4e1 >2014-04-10 19:25:16,474 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (pool-4-thread-50) [1d434f69] CommandMultiAsyncTasks::AttachTask: Attaching task 25272c28-b513-4f48-8b10-d532026aed1b to command 0b3432b8-baa5-4343-8bc1-5ddee417f4e1. >2014-04-10 19:25:16,517 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-4-thread-50) [1d434f69] Adding task 25272c28-b513-4f48-8b10-d532026aed1b (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-04-10 19:25:16,751 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [1d434f69] Correlation ID: 416fae3a, Job ID: 7d643370-759b-4b8c-a382-bbd760bde487, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was successfully removed. >2014-04-10 19:25:16,752 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) [1d434f69] BaseAsyncTask::StartPollingTask: Starting to poll task 25272c28-b513-4f48-8b10-d532026aed1b. >2014-04-10 19:25:17,723 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-33) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-04-10 19:25:17,735 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) SPMAsyncTask::PollTask: Polling task 25272c28-b513-4f48-8b10-d532026aed1b (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-04-10 19:25:17,751 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) BaseAsyncTask::OnTaskEndSuccess: Task 25272c28-b513-4f48-8b10-d532026aed1b (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-04-10 19:25:17,752 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) CommandAsyncTask::EndActionIfNecessary: All tasks of command 0b3432b8-baa5-4343-8bc1-5ddee417f4e1 has ended -> executing EndAction >2014-04-10 19:25:17,753 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: 0b3432b8-baa5-4343-8bc1-5ddee417f4e1): calling EndAction . >2014-04-10 19:25:17,753 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveVm, executionIndex: 0 >2014-04-10 19:25:17,776 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (pool-4-thread-50) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-04-10 19:25:17,779 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm completed, handling the result. >2014-04-10 19:25:17,779 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveVm succeeded, clearing tasks. >2014-04-10 19:25:17,792 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 25272c28-b513-4f48-8b10-d532026aed1b >2014-04-10 19:25:17,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, taskId = 25272c28-b513-4f48-8b10-d532026aed1b), log id: 57d85839 >2014-04-10 19:25:17,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) START, HSMClearTaskVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, taskId=25272c28-b513-4f48-8b10-d532026aed1b), log id: 3c88333d >2014-04-10 19:25:17,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-4-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 3c88333d >2014-04-10 19:25:17,838 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-4-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 57d85839 >2014-04-10 19:25:17,859 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-4-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 25272c28-b513-4f48-8b10-d532026aed1b from DataBase >2014-04-10 19:25:17,859 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-4-thread-50) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0b3432b8-baa5-4343-8bc1-5ddee417f4e1 >2014-04-10 19:25:27,879 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-10) [1cb38793] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 19:25:27,927 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-50) [1cb38793] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 19:25:27,933 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [1cb38793] START, SetVdsStatusVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 43a8ce8d >2014-04-10 19:25:27,933 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [1cb38793] VDS 10.66.106.40 is spm and moved from up calling resetIrs. >2014-04-10 19:25:27,933 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-50) [1cb38793] START, ResetIrsVDSCommand( storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, ignoreFailoverLimit = false, vdsId = 74fba051-b65c-411c-9114-b754f98401b1, ignoreStopFailed = false), log id: 1e19afdc >2014-04-10 19:25:27,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [1cb38793] START, SpmStopVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e), log id: 60cf60f6 >2014-04-10 19:25:27,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [1cb38793] SpmStopVDSCommand::Stopping SPM on vds 10.66.106.40, pool id f721168f-5edd-4f5f-8976-591eb93f960e >2014-04-10 19:25:28,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-4-thread-50) [1cb38793] FINISH, SpmStopVDSCommand, log id: 60cf60f6 >2014-04-10 19:25:28,051 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-4-thread-50) [1cb38793] FINISH, ResetIrsVDSCommand, log id: 1e19afdc >2014-04-10 19:25:28,066 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-50) [1cb38793] FINISH, SetVdsStatusVDSCommand, log id: 43a8ce8d >2014-04-10 19:25:28,067 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-50) [1cb38793] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: f721168f-5edd-4f5f-8976-591eb93f960e value: POOL >] >2014-04-10 19:25:28,150 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-50) [1cb38793] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 19:25:28,166 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [1cb38793] Correlation ID: 1cb38793, Job ID: 3962c837-84f2-46e9-b452-188f0d1e42c5, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was switched to Maintenance mode by admin@internal. >2014-04-10 19:25:29,164 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-52) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 74fba051-b65c-411c-9114-b754f98401b1 : 10.66.106.40 >2014-04-10 19:25:29,213 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-44) Clearing cache of pool: f721168f-5edd-4f5f-8976-591eb93f960e for problematic entities of VDS: 10.66.106.40. >2014-04-10 19:25:29,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-52) START, DisconnectStoragePoolVDSCommand(HostName = 10.66.106.40, HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, vds_spm_id = 2), log id: 17eab552 >2014-04-10 19:25:29,549 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-50) [5656838b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 19:25:29,575 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-50) [5656838b] Correlation ID: 5656838b, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center NFS_shyu. Setting status to Non Responsive. >2014-04-10 19:25:34,900 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-7) [7c128c07] Lock Acquired to object EngineLock [exclusiveLocks= key: 74fba051-b65c-411c-9114-b754f98401b1 value: VDS >, sharedLocks= ] >2014-04-10 19:25:34,914 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-44) [7c128c07] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 74fba051-b65c-411c-9114-b754f98401b1 Type: VDS >2014-04-10 19:25:34,979 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-44) [7c128c07] START, RemoveVdsVDSCommand( HostId = 74fba051-b65c-411c-9114-b754f98401b1), log id: 646a60e8 >2014-04-10 19:25:37,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, DisconnectStoragePoolVDSCommand, log id: 17eab552 >2014-04-10 19:25:37,246 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-52) [37d92ffd] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: f721168f-5edd-4f5f-8976-591eb93f960e Type: StoragePool >2014-04-10 19:25:37,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-52) [37d92ffd] START, DisconnectStorageServerVDSCommand( HostId = 74fba051-b65c-411c-9114-b754f98401b1, storagePoolId = f721168f-5edd-4f5f-8976-591eb93f960e, storageType = NFS, connectionList = [{ id: 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 91be9ed1-835c-4cdc-9c93-592be4f65bbf, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 3a621f65-7d4c-4e19-8f42-a133992d810e, connection: 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f, connection: 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 167c688f >2014-04-10 19:25:39,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-52) [37d92ffd] FINISH, DisconnectStorageServerVDSCommand, return: {91be9ed1-835c-4cdc-9c93-592be4f65bbf=0, 3a621f65-7d4c-4e19-8f42-a133992d810e=0, 8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd=0, 46cdcaf4-01f2-41fa-9c4b-ae154da2f00f=0}, log id: 167c688f >2014-04-10 19:25:39,733 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-44) [7c128c07] vdsManager::disposing >2014-04-10 19:25:39,734 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-44) [7c128c07] FINISH, RemoveVdsVDSCommand, log id: 646a60e8 >2014-04-10 19:25:39,741 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-44) [7c128c07] Correlation ID: 7c128c07, Call Stack: null, Custom Event ID: -1, Message: Host 10.66.106.40 was removed by admin@internal. >2014-04-10 19:25:39,742 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-44) [7c128c07] Lock freed to object EngineLock [exclusiveLocks= key: 74fba051-b65c-411c-9114-b754f98401b1 value: VDS >, sharedLocks= ] >2014-04-10 19:26:26,170 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) Setting new tasks map. The map contains now 0 tasks >2014-04-10 19:26:26,170 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) Cleared all tasks of pool f721168f-5edd-4f5f-8976-591eb93f960e. >2014-04-10 19:41:55,865 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-60) Start refreshing all users data >2014-04-10 19:41:56,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf.
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1086210
:
884913
| 884915