Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 925778 Details for
Bug 1128776
Can't change a vm disk's storage domain from a file domain to a block domain when creating a template from a vm
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Engine log file
engine.log (text/x-log), 690.52 KB, created by
Idan Shaby
on 2014-08-11 14:19:29 UTC
(
hide
)
Description:
Engine log file
Filename:
MIME Type:
Creator:
Idan Shaby
Created:
2014-08-11 14:19:29 UTC
Size:
690.52 KB
patch
obsolete
>2014-08-11 15:29:44,247 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Loaded file "/home/ishaby/ovirt-engine/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-08-11 15:29:44,248 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) The file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-08-11 15:29:44,249 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-08-11 15:29:44,250 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-08-11 15:29:44,252 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-08-11 15:29:44,253 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-08-11 15:29:44,254 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_AJP_ENABLED" is "false". >2014-08-11 15:29:44,254 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_AJP_PORT" is "None". >2014-08-11 15:29:44,255 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". >2014-08-11 15:29:44,255 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_CACHE" is "/home/ishaby/ovirt-engine/var/cache/ovirt-engine". >2014-08-11 15:29:44,256 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-08-11 15:29:44,257 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-08-11 15:29:44,257 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-08-11 15:29:44,258 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-08-11 15:29:44,258 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_HOST" is "localhost". >2014-08-11 15:29:44,259 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-08-11 15:29:44,259 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-08-11 15:29:44,260 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-08-11 15:29:44,260 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_PORT" is "5432". >2014-08-11 15:29:44,261 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_SECURED" is "False". >2014-08-11 15:29:44,261 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-08-11 15:29:44,263 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-08-11 15:29:44,264 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DB_USER" is "engine". >2014-08-11 15:29:44,264 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DEBUG_ADDRESS" is "127.0.0.1:8787". >2014-08-11 15:29:44,265 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_DOC" is "/home/ishaby/ovirt-engine/share/doc/ovirt-engine". >2014-08-11 15:29:44,265 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_ETC" is "/home/ishaby/ovirt-engine/etc/ovirt-engine". >2014-08-11 15:29:44,266 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_EXTENSION_PATH" is "/home/ishaby/ovirt-engine/share/ovirt-engine/extensions.d:/home/ishaby/ovirt-engine/etc/ovirt-engine/extensions.d". >2014-08-11 15:29:44,267 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_FQDN" is "localhost.localdomain". >2014-08-11 15:29:44,267 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_GROUP" is "ovirt". >2014-08-11 15:29:44,268 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-08-11 15:29:44,268 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-08-11 15:29:44,269 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HTTPS_ENABLED" is "true". >2014-08-11 15:29:44,269 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HTTPS_PORT" is "8443". >2014-08-11 15:29:44,270 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-08-11 15:29:44,270 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HTTP_ENABLED" is "true". >2014-08-11 15:29:44,277 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_HTTP_PORT" is "8080". >2014-08-11 15:29:44,277 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_JAVA_MODULEPATH" is "/home/ishaby/ovirt-engine/share/ovirt-engine/modules". >2014-08-11 15:29:44,278 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/home/ishaby/ovirt-engine/var/log/ovirt-engine/dump"". >2014-08-11 15:29:44,279 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_LOG" is "/home/ishaby/ovirt-engine/var/log/ovirt-engine". >2014-08-11 15:29:44,280 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_LOG_TO_CONSOLE" is "true". >2014-08-11 15:29:44,280 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_MANUAL" is "/home/ishaby/ovirt-engine/share/ovirt-engine/manual". >2014-08-11 15:29:44,281 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PERM_MAX" is "256m". >2014-08-11 15:29:44,283 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PERM_MIN" is "256m". >2014-08-11 15:29:44,284 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine". >2014-08-11 15:29:44,285 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_CA" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/ca.pem". >2014-08-11 15:29:44,286 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_ENGINE_CERT" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/certs/engine.cer". >2014-08-11 15:29:44,287 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_ENGINE_STORE" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/keys/engine.p12". >2014-08-11 15:29:44,288 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-08-11 15:29:44,288 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-08-11 15:29:44,289 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_ENGINE_STORE_TYPE" is "PKCS12". >2014-08-11 15:29:44,289 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_TRUST_STORE" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/.truststore". >2014-08-11 15:29:44,290 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-08-11 15:29:44,291 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PKI_TRUST_STORE_TYPE" is "JKS". >2014-08-11 15:29:44,291 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false "java.security.krb5.conf=/home/ishaby/ovirt-engine/etc/ovirt-engine/krb5.conf"". >2014-08-11 15:29:44,292 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PROXY_ENABLED" is "false". >2014-08-11 15:29:44,293 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-08-11 15:29:44,293 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-08-11 15:29:44,294 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_REPORTS_UI" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine/reports.xml". >2014-08-11 15:29:44,294 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-08-11 15:29:44,295 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_STOP_TIME" is "10". >2014-08-11 15:29:44,296 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_TMP" is "/home/ishaby/ovirt-engine/var/tmp/ovirt-engine". >2014-08-11 15:29:44,296 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_UP_MARK" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine/engine.up". >2014-08-11 15:29:44,297 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-08-11 15:29:44,297 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_USER" is "ovirt". >2014-08-11 15:29:44,311 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_USR" is "/home/ishaby/ovirt-engine/share/ovirt-engine". >2014-08-11 15:29:44,312 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_VAR" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine". >2014-08-11 15:29:44,312 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-08-11 15:29:44,313 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "JBOSS_HOME" is "/usr/share/jboss-as". >2014-08-11 15:29:44,313 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "JBOSS_RUNTIME" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine/jboss_runtime". >2014-08-11 15:29:44,314 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-5) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-08-11 15:29:44,621 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Start initializing Backend >2014-08-11 15:29:44,870 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-1) Loaded file /home/ishaby/ovirt-engine/etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-08-11 15:29:45,074 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Running ovirt-engine 3.5.0.0 >2014-08-11 15:29:45,075 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-1) Start initializing dictionaries >2014-08-11 15:29:45,077 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-1) Finished initializing dictionaries >2014-08-11 15:29:45,077 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Start initializing AuditLogCleanupManager >2014-08-11 15:29:45,078 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-08-11 15:29:45,092 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Finished initializing AuditLogCleanupManager >2014-08-11 15:29:45,093 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Start initializing CommandEntityCleanupManager >2014-08-11 15:29:45,094 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Setting command entity cleanup manager to run at: 35 35 3 * * ? >2014-08-11 15:29:45,095 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Finished initializing CommandEntityCleanupManager >2014-08-11 15:29:45,097 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Start initializing TagsDirector >2014-08-11 15:29:45,106 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Tag root added to tree >2014-08-11 15:29:45,114 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Finished initializing TagsDirector >2014-08-11 15:29:45,114 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-1) Start initializing IsoDomainListSyncronizer >2014-08-11 15:29:45,118 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-1) Finished initializing IsoDomainListSyncronizer >2014-08-11 15:29:45,191 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Completed initializing handlers >2014-08-11 15:29:45,211 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Start initializing ErrorTranslatorImpl >2014-08-11 15:29:45,226 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-08-11 15:29:45,227 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Finished initializing ErrorTranslatorImpl >2014-08-11 15:29:45,228 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Start initializing ErrorTranslatorImpl >2014-08-11 15:29:45,228 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Finished initializing ErrorTranslatorImpl >2014-08-11 15:29:45,229 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Mark incomplete jobs as UNKNOWN >2014-08-11 15:29:45,281 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-1) Start initializing JobRepositoryCleanupManager >2014-08-11 15:29:45,282 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-1) Finished initializing JobRepositoryCleanupManager >2014-08-11 15:29:45,282 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-1) Start initializing AutoRecoveryManager >2014-08-11 15:29:45,283 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-1) Finished initializing AutoRecoveryManager >2014-08-11 15:29:45,285 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-1) Start initializing ExecutionMessageDirector >2014-08-11 15:29:45,287 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-1) Finished initializing ExecutionMessageDirector >2014-08-11 15:29:45,323 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-1) Start of enabled extensions list >2014-08-11 15:29:45,323 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-1) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' >2014-08-11 15:29:45,324 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-1) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' >2014-08-11 15:29:45,325 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-1) End of enabled extensions list >2014-08-11 15:29:45,396 INFO [org.ovirt.engine.core.bll.aaa.DbUserCacheManager] (MSC service thread 1-3) Start initializing DbUserCacheManager >2014-08-11 15:29:45,397 INFO [org.ovirt.engine.core.bll.aaa.DbUserCacheManager] (MSC service thread 1-3) Finished initializing DbUserCacheManager >2014-08-11 15:29:45,438 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-1) Principal admin::internal synchronized >2014-08-11 15:29:45,529 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-3) Initialization of AsyncTaskManager completed successfully. >2014-08-11 15:29:45,530 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-3) Start initializing ResourceManager >2014-08-11 15:29:45,595 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-3) Entered VdsManager constructor >2014-08-11 15:29:45,612 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-3) Initialize vdsBroker (vdshost1,54,321) >2014-08-11 15:29:45,690 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-3) VDS ccc5aec0-8b3c-4089-89ea-52185b3f390b was added to the Resource Manager >2014-08-11 15:29:45,691 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-3) Entered VdsManager constructor >2014-08-11 15:29:45,700 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-3) Initialize vdsBroker (vdshost2,54,321) >2014-08-11 15:29:45,705 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-3) VDS eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8 was added to the Resource Manager >2014-08-11 15:29:45,726 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-3) Finished initializing ResourceManager >2014-08-11 15:29:45,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-3) Initialization of OvfDataUpdater completed successfully. >2014-08-11 15:29:45,730 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) Start scheduling to enable vds load balancer >2014-08-11 15:29:45,730 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) Finished scheduling to enable vds load balancer >2014-08-11 15:29:45,731 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) Start HA Reservation check >2014-08-11 15:29:45,731 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) Finished HA Reservation check >2014-08-11 15:29:45,736 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-3) Init VM custom properties utilities >2014-08-11 15:29:45,737 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-3) Init device custom properties utilities >2014-08-11 15:29:45,739 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) Initializing Scheduling manager >2014-08-11 15:29:45,762 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) External scheduler disabled, discovery skipped >2014-08-11 15:29:45,762 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-3) Initialized Scheduling manager >2014-08-11 15:29:45,763 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-3) Initializing DWH Heart Beat >2014-08-11 15:29:45,764 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-3) DWH Heart Beat initialized >2014-08-11 15:29:45,783 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges >2014-08-11 15:29:45,784 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 150 >2014-08-11 15:29:45,784 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolPerDc] (org.ovirt.thread.pool-8-thread-1) successfully initialized >2014-08-11 15:29:49,367 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetHardwareInfoVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8]), log id: 7c9454dd >2014-08-11 15:29:49,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetHardwareInfoVDSCommand, log id: 7c9454dd >2014-08-11 15:29:49,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, vds=Host[vdshost1,ccc5aec0-8b3c-4089-89ea-52185b3f390b]), log id: 246e33e3 >2014-08-11 15:29:49,530 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 246e33e3 >2014-08-11 15:29:49,544 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Cannot convert the string Host ${VdsName} is not responding. It will stay in Connecting state for a grace period of ${Seconds} seconds and after that an attempt to fence the host will be issued. to AuditLogType, the key does not exist in the AuditLogType declared types >2014-08-11 15:29:49,548 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: UNASSIGNED not exist in string table >2014-08-11 15:29:49,549 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-08-11 15:29:49,550 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-08-11 15:29:49,550 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-08-11 15:29:49,550 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-08-11 15:29:49,551 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_NOT_RESTARTED_DUE_TO_POLICY not exist in string table >2014-08-11 15:29:49,551 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-08-11 15:29:49,552 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-08-11 15:29:49,552 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-08-11 15:29:49,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_HOST_IN_CONNECTING_STATE not exist in string table >2014-08-11 15:29:49,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-08-11 15:29:49,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_STOPPED not exist in string table >2014-08-11 15:29:49,554 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_STARTED not exist in string table >2014-08-11 15:29:49,554 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_ERROR not exist in string table >2014-08-11 15:29:49,554 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_REMOVE_AUDIT_LOG not exist in string table >2014-08-11 15:29:49,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_REMOVE_AUDIT_LOG_FAILED not exist in string table >2014-08-11 15:29:49,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_CLEAR_ALL_DISMISSED_AUDIT_LOG not exist in string table >2014-08-11 15:29:49,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_CLEAR_ALL_DISMISSED_AUDIT_LOG_FAILED not exist in string table >2014-08-11 15:29:49,698 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host vdshost1 does not enforce SELinux. >2014-08-11 15:29:49,698 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Host vdshost1 does not report SELinux enforcement information. >2014-08-11 15:29:49,716 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Initializing Host: vdshost2 >2014-08-11 15:29:49,779 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [165888a2] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8 Type: VDS >2014-08-11 15:29:49,879 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: vdshost1 >2014-08-11 15:29:49,891 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [2b61066a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: ccc5aec0-8b3c-4089-89ea-52185b3f390b Type: VDS >2014-08-11 15:29:55,745 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-21) [21b786f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 45dd52dc-0e1c-4321-8a19-f4a0b735410f Type: StoragePool >2014-08-11 15:29:55,756 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-21) [21b786f] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain 565441d8-3f84-4c1e-8f78-90e903087208 status from Active to Unknown, reason : null >2014-08-11 15:29:55,766 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-21) [21b786f] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain 762836c3-cb5b-49cf-963d-08cc79137189 status from Active to Unknown, reason : null >2014-08-11 15:29:55,766 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-23) [4f48868d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 9e763f98-5d93-4677-b9ac-f0b5504c123f Type: StoragePool >2014-08-11 15:29:55,773 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-21) [21b786f] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain a499025c-18cf-410b-9163-29fc62d44ba4 status from Active to Unknown, reason : null >2014-08-11 15:29:55,774 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-21) [21b786f] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain 9aac3d1c-aca8-47f8-95a9-4d9996313f87 status from Active to Unknown, reason : null >2014-08-11 15:29:55,777 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-23) [4f48868d] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain 22f5f897-a094-417c-8545-86c72e865ef3 status from Active to Unknown, reason : null >2014-08-11 15:29:55,779 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-23) [4f48868d] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain c2214465-94f1-48a5-bde6-ebaafa3daba4 status from Active to Unknown, reason : null >2014-08-11 15:29:55,780 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-23) [4f48868d] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain d93bea2b-6772-4daf-9a0b-68eef7bcf385 status from Active to Unknown, reason : null >2014-08-11 15:29:55,781 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-23) [4f48868d] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain 41ddf26d-701b-4e99-843c-16db1a5dd84c status from Active to Unknown, reason : null >2014-08-11 15:29:55,915 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [21b786f] Correlation ID: 21b786f, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center dc2. Setting status to Non Responsive. >2014-08-11 15:29:55,923 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [4f48868d] Correlation ID: 4f48868d, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center dc1. Setting status to Non Responsive. >2014-08-11 15:29:56,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [4f48868d] hostFromVds::selectedVds - vdshost1, spmStatus SPM, storage pool dc1 >2014-08-11 15:29:56,030 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-21) [21b786f] hostFromVds::selectedVds - vdshost2, spmStatus SPM, storage pool dc2 >2014-08-11 15:29:56,040 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [4f48868d] Initialize Irs proxy from vds: vdshost1 >2014-08-11 15:29:56,048 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-21) [21b786f] Initialize Irs proxy from vds: vdshost2 >2014-08-11 15:29:56,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [4f48868d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host vdshost1 (Address: vdshost1). >2014-08-11 15:29:56,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4f48868d] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 9e763f98-5d93-4677-b9ac-f0b5504c123f, ignoreFailoverLimit = false), log id: 4caef30c >2014-08-11 15:29:56,073 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [21b786f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host vdshost2 (Address: vdshost2). >2014-08-11 15:29:56,084 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [21b786f] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false), log id: 3b813820 >2014-08-11 15:29:56,177 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-30) [30b0d4ea] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 41ddf26d-701b-4e99-843c-16db1a5dd84c Type: Storage >2014-08-11 15:29:56,192 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4f48868d] -- executeIrsBrokerCommand: Attempting on storage pool 9e763f98-5d93-4677-b9ac-f0b5504c123f >2014-08-11 15:29:56,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4f48868d] START, HSMGetAllTasksInfoVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b), log id: 292ca921 >2014-08-11 15:29:56,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-30) [30b0d4ea] START, GetVGInfoVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, VGID=ySBXsV-7G81-q9Ht-9U49-R3x1-9SOR-gZxjpA), log id: 7a47cef5 >2014-08-11 15:29:56,199 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-33) [7b35e696] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 15:29:56,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [7b35e696] START, GetVGInfoVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, VGID=70yYYL-Kykz-akKK-G70S-qI1K-WwWh-NIMHiM), log id: 5f0e5b7b >2014-08-11 15:29:56,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4f48868d] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 292ca921 >2014-08-11 15:29:56,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4f48868d] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 4caef30c >2014-08-11 15:29:56,207 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) [4f48868d] Discovered no tasks on Storage Pool dc1 >2014-08-11 15:29:56,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-30) [30b0d4ea] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600a09803753795a64244531644f777a, physicalVolumeId=w9cCS7-0hfD-7Vdx-p3eD-knlJ-cEyT-wmO0if, volumeGroupId=ySBXsV-7G81-q9Ht-9U49-R3x1-9SOR-gZxjpA, serial=SNETAPP_LUN_C-Mode_7SyZd_E1dOwz, lunMapping=0, vendorId=NETAPP, productId=LUN C-Mode, _lunConnections=[{ id: null, connection: 10.35.19.161, iqn: iqn.1992-08.com.netapp:sn.82749f0181ee11e3bcf9123478563412:vs.6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=50, vendorName=NETAPP, pathsDictionary={sdba=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=41ddf26d-701b-4e99-843c-16db1a5dd84c, storageDomainName=null]], log id: 7a47cef5 >2014-08-11 15:29:56,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [21b786f] -- executeIrsBrokerCommand: Attempting on storage pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f >2014-08-11 15:29:56,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-33) [7b35e696] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600a09803753795a64244531644f7832, physicalVolumeId=yj5CGQ-hanH-DrTs-5465-Lmy2-re2c-wTKW2T, volumeGroupId=70yYYL-Kykz-akKK-G70S-qI1K-WwWh-NIMHiM, serial=SNETAPP_LUN_C-Mode_7SyZd_E1dOx2, lunMapping=1, vendorId=NETAPP, productId=LUN C-Mode, _lunConnections=[{ id: null, connection: 10.35.19.161, iqn: iqn.1992-08.com.netapp:sn.82749f0181ee11e3bcf9123478563412:vs.6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=50, vendorName=NETAPP, pathsDictionary={sdab=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a499025c-18cf-410b-9163-29fc62d44ba4, storageDomainName=null]], log id: 5f0e5b7b >2014-08-11 15:29:56,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [21b786f] START, HSMGetAllTasksInfoVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8), log id: 9e80d3c >2014-08-11 15:29:56,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [21b786f] FINISH, HSMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@1f1cec46], log id: 9e80d3c >2014-08-11 15:29:56,303 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [21b786f] FINISH, SPMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@1f1cec46], log id: 3b813820 >2014-08-11 15:29:56,308 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-28) [21b786f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 109e67cf-49e0-43d6-9a74-e967660c9150 >2014-08-11 15:29:56,309 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-28) [21b786f] CommandMultiAsyncTasks::AttachTask: Attaching task 32f88b00-1211-4f64-b553-405f435be6ec to command 109e67cf-49e0-43d6-9a74-e967660c9150. >2014-08-11 15:29:56,340 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-28) [21b786f] Adding task 32f88b00-1211-4f64-b553-405f435be6ec (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:29:56,406 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-28) [21b786f] BaseAsyncTask::startPollingTask: Starting to poll task 32f88b00-1211-4f64-b553-405f435be6ec. >2014-08-11 15:29:56,407 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-28) [21b786f] Discovered 1 tasks on Storage Pool dc2, 1 added to manager. >2014-08-11 15:30:05,399 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-47) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-11 15:30:05,407 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) SPMAsyncTask::PollTask: Polling task 32f88b00-1211-4f64-b553-405f435be6ec (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:30:05,440 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-47) BaseAsyncTask::onTaskEndSuccess: Task 32f88b00-1211-4f64-b553-405f435be6ec (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:30:05,441 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) CommandAsyncTask::endActionIfNecessary: All tasks of command 109e67cf-49e0-43d6-9a74-e967660c9150 has ended -> executing endAction >2014-08-11 15:30:05,441 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-47) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 109e67cf-49e0-43d6-9a74-e967660c9150): calling endAction . >2014-08-11 15:30:05,442 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-08-11 15:30:05,482 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-6) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-08-11 15:30:05,483 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-08-11 15:30:05,484 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-08-11 15:30:05,498 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-6) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 32f88b00-1211-4f64-b553-405f435be6ec >2014-08-11 15:30:05,500 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 32f88b00-1211-4f64-b553-405f435be6ec), log id: 4d10d48d >2014-08-11 15:30:05,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=32f88b00-1211-4f64-b553-405f435be6ec), log id: 2d692086 >2014-08-11 15:30:05,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) FINISH, HSMClearTaskVDSCommand, log id: 2d692086 >2014-08-11 15:30:05,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-6) FINISH, SPMClearTaskVDSCommand, log id: 4d10d48d >2014-08-11 15:30:05,882 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-6) BaseAsyncTask::removeTaskFromDB: Removed task 32f88b00-1211-4f64-b553-405f435be6ec from DataBase >2014-08-11 15:30:05,882 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-6) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 109e67cf-49e0-43d6-9a74-e967660c9150 >2014-08-11 15:30:33,006 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-1) Running command: LoginUserCommand internal: false. >2014-08-11 15:30:33,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:30:35,027 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-1) [5cbbb120] Running command: LogoutUserCommand internal: false. >2014-08-11 15:30:35,074 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) [5cbbb120] Correlation ID: 5cbbb120, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:30:39,102 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (http--0.0.0.0-8080-1) Running command: LoginAdminUserCommand internal: false. >2014-08-11 15:30:39,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:30:57,627 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-2) [38222c12] Lock Acquired to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:30:57,708 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-2) [38222c12] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: e9d52ee1-5e46-4a89-803d-2f8259b8f981 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-08-11 15:30:57,850 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-2) [38222c12] Correlation ID: 38222c12, Job ID: 066dfaa5-10a0-4558-a4b0-b87573739792, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was created by admin. >2014-08-11 15:30:57,883 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-2) [38222c12] Lock freed to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:30:58,677 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (http--0.0.0.0-8080-2) [1e008ed0] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b Type: VMAction group CONFIGURE_VM_NETWORK with role type USER >2014-08-11 15:31:07,879 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-1) [3da9274a] Lock Acquired to object EngineLock [exclusiveLocks= key: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b value: VM_DISK_BOOT >, sharedLocks= key: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b value: VM >] >2014-08-11 15:31:07,950 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-1) [3da9274a] Running command: AddDiskCommand internal: false. Entities affected : ID: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: StorageAction group CREATE_DISK with role type USER >2014-08-11 15:31:08,100 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-1) [345089fa] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 15:31:08,134 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-1) [345089fa] Lock freed to object EngineLock [exclusiveLocks= key: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b value: VM_DISK_BOOT >, sharedLocks= key: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b value: VM >] >2014-08-11 15:31:08,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-1) [345089fa] START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8eff65a7-caec-4815-96a9-97611191d4b9, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 7e3a884a-1555-4e19-8f6b-3517a62ac5c6, newImageDescription = ), log id: 3fa45718 >2014-08-11 15:31:08,139 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-1) [345089fa] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:31:08,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-1) [345089fa] FINISH, CreateImageVDSCommand, return: 7e3a884a-1555-4e19-8f6b-3517a62ac5c6, log id: 3fa45718 >2014-08-11 15:31:08,293 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-1) [345089fa] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0ef81bb4-2c31-4831-928a-d98c2df008a2 >2014-08-11 15:31:08,293 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-1) [345089fa] CommandMultiAsyncTasks::AttachTask: Attaching task 76261516-4d0f-4c40-8b8b-216869abf4fe to command 0ef81bb4-2c31-4831-928a-d98c2df008a2. >2014-08-11 15:31:08,325 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-1) [345089fa] Adding task 76261516-4d0f-4c40-8b8b-216869abf4fe (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:31:08,392 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) [345089fa] Correlation ID: 3da9274a, Job ID: 2e85388e-a52c-47f3-b319-840ce483c942, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm1_Disk1 was initiated on VM vm1 by admin. >2014-08-11 15:31:08,393 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-1) [345089fa] BaseAsyncTask::startPollingTask: Starting to poll task 76261516-4d0f-4c40-8b8b-216869abf4fe. >2014-08-11 15:31:15,472 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-50) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-08-11 15:31:15,489 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) SPMAsyncTask::PollTask: Polling task 76261516-4d0f-4c40-8b8b-216869abf4fe (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:31:15,559 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) BaseAsyncTask::onTaskEndSuccess: Task 76261516-4d0f-4c40-8b8b-216869abf4fe (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:31:15,559 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-50) CommandAsyncTask::endActionIfNecessary: All tasks of command 0ef81bb4-2c31-4831-928a-d98c2df008a2 has ended -> executing endAction >2014-08-11 15:31:15,560 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-50) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 0ef81bb4-2c31-4831-928a-d98c2df008a2): calling endAction . >2014-08-11 15:31:15,560 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-11 15:31:15,560 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-49) Setting new tasks map. The map contains now 1 tasks >2014-08-11 15:31:15,601 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-2) [3da9274a] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-11 15:31:15,617 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-2) [345089fa] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-11 15:31:15,627 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-2) [345089fa] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8eff65a7-caec-4815-96a9-97611191d4b9, imageId = 7e3a884a-1555-4e19-8f6b-3517a62ac5c6), log id: 7ae5d9ae >2014-08-11 15:31:15,649 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-2) [345089fa] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@766f9b51, log id: 7ae5d9ae >2014-08-11 15:31:15,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-2) Correlation ID: 3da9274a, Call Stack: null, Custom Event ID: -1, Message: The disk vm1_Disk1 was successfully added to VM vm1. >2014-08-11 15:31:15,718 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-11 15:31:15,719 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-11 15:31:15,734 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 76261516-4d0f-4c40-8b8b-216869abf4fe >2014-08-11 15:31:15,735 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 76261516-4d0f-4c40-8b8b-216869abf4fe), log id: 671bd70a >2014-08-11 15:31:15,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=76261516-4d0f-4c40-8b8b-216869abf4fe), log id: 4fd9c151 >2014-08-11 15:31:15,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 4fd9c151 >2014-08-11 15:31:15,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 671bd70a >2014-08-11 15:31:15,767 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task 76261516-4d0f-4c40-8b8b-216869abf4fe from DataBase >2014-08-11 15:31:15,768 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0ef81bb4-2c31-4831-928a-d98c2df008a2 >2014-08-11 15:31:25,684 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (http--0.0.0.0-8080-1) Running command: AddVmTemplateCommand internal: false. Entities affected : ID: 45dd52dc-0e1c-4321-8a19-f4a0b735410f Type: StoragePoolAction group CREATE_TEMPLATE with role type USER >2014-08-11 15:31:25,689 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-1) START, SetVmStatusVDSCommand( vmId = 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b, status = ImageLocked, exit status = Normal), log id: 43a8a05b >2014-08-11 15:31:25,699 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-1) FINISH, SetVmStatusVDSCommand, log id: 43a8a05b >2014-08-11 15:31:25,743 INFO [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (http--0.0.0.0-8080-1) [6b9c4841] Running command: CreateImageTemplateCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 15:31:25,754 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8080-1) [6b9c4841] START, CopyImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8eff65a7-caec-4815-96a9-97611191d4b9, imageId = 7e3a884a-1555-4e19-8f6b-3517a62ac5c6, dstImageGroupId = f4bbc15f-9c65-4da8-9c2a-4191b0484a34, vmId = 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b, dstImageId = 4fee62f8-4f38-4b4b-ba9b-555dc6741750, imageDescription = Active VM, dstStorageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, copyVolumeType = SharedVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false), log id: 5b96af61 >2014-08-11 15:31:25,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8080-1) [6b9c4841] -- executeIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2014-08-11 15:31:25,759 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8080-1) [6b9c4841] -- copyImage parameters: > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > vmGUID=0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b > srcImageGUID=8eff65a7-caec-4815-96a9-97611191d4b9 > srcVolUUID=7e3a884a-1555-4e19-8f6b-3517a62ac5c6 > dstImageGUID=f4bbc15f-9c65-4da8-9c2a-4191b0484a34 > dstVolUUID=4fee62f8-4f38-4b4b-ba9b-555dc6741750 > descr=Active VM > dstSdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 >2014-08-11 15:31:26,312 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8080-1) [6b9c4841] Command CopyImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8eff65a7-caec-4815-96a9-97611191d4b9, imageId = 7e3a884a-1555-4e19-8f6b-3517a62ac5c6, dstImageGroupId = f4bbc15f-9c65-4da8-9c2a-4191b0484a34, vmId = 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b, dstImageId = 4fee62f8-4f38-4b4b-ba9b-555dc6741750, imageDescription = Active VM, dstStorageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, copyVolumeType = SharedVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Incorrect Volume format: ('RAW',) >2014-08-11 15:31:26,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8080-1) [6b9c4841] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 5b96af61 >2014-08-11 15:31:26,316 ERROR [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (http--0.0.0.0-8080-1) [6b9c4841] Command org.ovirt.engine.core.bll.CreateImageTemplateCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Incorrect Volume format: ('RAW',) (Failed with error IncorrectFormat and code 202) >2014-08-11 15:31:26,391 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-1) [6b9c4841] Removed task bcab0e26-8b81-465a-b335-396016c94a6f from DataBase >2014-08-11 15:31:26,402 ERROR [org.ovirt.engine.core.bll.CreateImageTemplateCommand] (http--0.0.0.0-8080-1) Transaction rolled-back for command: org.ovirt.engine.core.bll.CreateImageTemplateCommand. >2014-08-11 15:31:26,403 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (http--0.0.0.0-8080-1) transaction rolled back >2014-08-11 15:31:26,403 ERROR [org.ovirt.engine.core.bll.AddVmTemplateCommand] (http--0.0.0.0-8080-1) Command org.ovirt.engine.core.bll.AddVmTemplateCommand throw Vdc Bll exception. With error message VdcBLLException: IncorrectFormat (Failed with error IncorrectFormat and code 202) >2014-08-11 15:31:26,406 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (http--0.0.0.0-8080-1) Command [id=a76b331b-b1d0-49f4-8b54-c032ea56304a]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmTemplate; snapshot: 9d2591fd-8d9f-44b7-9088-ecba5a68dc8d. >2014-08-11 15:31:26,415 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (http--0.0.0.0-8080-1) Command [id=a76b331b-b1d0-49f4-8b54-c032ea56304a]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.VmDynamic; snapshot: EntityStatusSnapshot [id=0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b, status=Down]. >2014-08-11 15:31:26,443 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) Correlation ID: 3eba50ad, Job ID: 04b9d880-8c3b-47c7-8bf2-8a0ecad37095, Call Stack: null, Custom Event ID: -1, Message: Failed to complete creation of Template template from VM vm1. >2014-08-11 15:34:57,607 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/home/ishaby/ovirt-engine/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-08-11 15:34:57,608 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) The file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-08-11 15:34:57,609 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-08-11 15:34:57,610 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-08-11 15:34:57,611 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-08-11 15:34:57,612 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/home/ishaby/ovirt-engine/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-08-11 15:34:57,613 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_AJP_ENABLED" is "false". >2014-08-11 15:34:57,622 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_AJP_PORT" is "None". >2014-08-11 15:34:57,623 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". >2014-08-11 15:34:57,623 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_CACHE" is "/home/ishaby/ovirt-engine/var/cache/ovirt-engine". >2014-08-11 15:34:57,624 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-08-11 15:34:57,625 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-08-11 15:34:57,636 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-08-11 15:34:57,637 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-08-11 15:34:57,637 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_HOST" is "localhost". >2014-08-11 15:34:57,638 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-08-11 15:34:57,638 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-08-11 15:34:57,639 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-08-11 15:34:57,639 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_PORT" is "5432". >2014-08-11 15:34:57,640 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_SECURED" is "False". >2014-08-11 15:34:57,640 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-08-11 15:34:57,641 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-08-11 15:34:57,641 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_USER" is "engine". >2014-08-11 15:34:57,642 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DEBUG_ADDRESS" is "127.0.0.1:8787". >2014-08-11 15:34:57,642 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DOC" is "/home/ishaby/ovirt-engine/share/doc/ovirt-engine". >2014-08-11 15:34:57,643 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_ETC" is "/home/ishaby/ovirt-engine/etc/ovirt-engine". >2014-08-11 15:34:57,644 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_EXTENSION_PATH" is "/home/ishaby/ovirt-engine/share/ovirt-engine/extensions.d:/home/ishaby/ovirt-engine/etc/ovirt-engine/extensions.d". >2014-08-11 15:34:57,644 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_FQDN" is "localhost.localdomain". >2014-08-11 15:34:57,645 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_GROUP" is "ovirt". >2014-08-11 15:34:57,645 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-08-11 15:34:57,646 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-08-11 15:34:57,646 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTPS_ENABLED" is "true". >2014-08-11 15:34:57,647 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTPS_PORT" is "8443". >2014-08-11 15:34:57,647 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-08-11 15:34:57,648 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTP_ENABLED" is "true". >2014-08-11 15:34:57,648 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTP_PORT" is "8080". >2014-08-11 15:34:57,649 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_JAVA_MODULEPATH" is "/home/ishaby/ovirt-engine/share/ovirt-engine/modules". >2014-08-11 15:34:57,650 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/home/ishaby/ovirt-engine/var/log/ovirt-engine/dump"". >2014-08-11 15:34:57,650 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_LOG" is "/home/ishaby/ovirt-engine/var/log/ovirt-engine". >2014-08-11 15:34:57,651 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_LOG_TO_CONSOLE" is "true". >2014-08-11 15:34:57,651 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_MANUAL" is "/home/ishaby/ovirt-engine/share/ovirt-engine/manual". >2014-08-11 15:34:57,652 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PERM_MAX" is "256m". >2014-08-11 15:34:57,652 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PERM_MIN" is "256m". >2014-08-11 15:34:57,653 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine". >2014-08-11 15:34:57,653 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_CA" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/ca.pem". >2014-08-11 15:34:57,653 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_CERT" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/certs/engine.cer". >2014-08-11 15:34:57,654 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/keys/engine.p12". >2014-08-11 15:34:57,654 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-08-11 15:34:57,655 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-08-11 15:34:57,655 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE_TYPE" is "PKCS12". >2014-08-11 15:34:57,655 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_TRUST_STORE" is "/home/ishaby/ovirt-engine/etc/pki/ovirt-engine/.truststore". >2014-08-11 15:34:57,656 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-08-11 15:34:57,656 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_TRUST_STORE_TYPE" is "JKS". >2014-08-11 15:34:57,657 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false "java.security.krb5.conf=/home/ishaby/ovirt-engine/etc/ovirt-engine/krb5.conf"". >2014-08-11 15:34:57,657 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROXY_ENABLED" is "false". >2014-08-11 15:34:57,657 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-08-11 15:34:57,669 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-08-11 15:34:57,669 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_UI" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine/reports.xml". >2014-08-11 15:34:57,669 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-08-11 15:34:57,670 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_STOP_TIME" is "10". >2014-08-11 15:34:57,670 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_TMP" is "/home/ishaby/ovirt-engine/var/tmp/ovirt-engine". >2014-08-11 15:34:57,671 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_UP_MARK" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine/engine.up". >2014-08-11 15:34:57,671 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-08-11 15:34:57,671 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_USER" is "ovirt". >2014-08-11 15:34:57,673 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_USR" is "/home/ishaby/ovirt-engine/share/ovirt-engine". >2014-08-11 15:34:57,674 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_VAR" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine". >2014-08-11 15:34:57,674 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-08-11 15:34:57,675 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "JBOSS_HOME" is "/usr/share/jboss-as". >2014-08-11 15:34:57,675 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "JBOSS_RUNTIME" is "/home/ishaby/ovirt-engine/var/lib/ovirt-engine/jboss_runtime". >2014-08-11 15:34:57,676 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-08-11 15:34:57,979 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-4) Start initializing Backend >2014-08-11 15:34:58,175 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-4) Loaded file /home/ishaby/ovirt-engine/etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-08-11 15:34:58,341 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-4) Running ovirt-engine 3.5.0.0 >2014-08-11 15:34:58,341 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-4) Start initializing dictionaries >2014-08-11 15:34:58,344 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-4) Finished initializing dictionaries >2014-08-11 15:34:58,344 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-4) Start initializing AuditLogCleanupManager >2014-08-11 15:34:58,345 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-4) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-08-11 15:34:58,361 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-4) Finished initializing AuditLogCleanupManager >2014-08-11 15:34:58,362 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-4) Start initializing CommandEntityCleanupManager >2014-08-11 15:34:58,362 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-4) Setting command entity cleanup manager to run at: 35 35 3 * * ? >2014-08-11 15:34:58,363 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-4) Finished initializing CommandEntityCleanupManager >2014-08-11 15:34:58,365 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-4) Start initializing TagsDirector >2014-08-11 15:34:58,375 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-4) Tag root added to tree >2014-08-11 15:34:58,384 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-4) Finished initializing TagsDirector >2014-08-11 15:34:58,385 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-4) Start initializing IsoDomainListSyncronizer >2014-08-11 15:34:58,390 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-4) Finished initializing IsoDomainListSyncronizer >2014-08-11 15:34:58,444 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-4) Completed initializing handlers >2014-08-11 15:34:58,464 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-4) Start initializing ErrorTranslatorImpl >2014-08-11 15:34:58,471 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-4) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-08-11 15:34:58,472 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-4) Finished initializing ErrorTranslatorImpl >2014-08-11 15:34:58,472 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-4) Start initializing ErrorTranslatorImpl >2014-08-11 15:34:58,473 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-4) Finished initializing ErrorTranslatorImpl >2014-08-11 15:34:58,473 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-4) Mark incomplete jobs as UNKNOWN >2014-08-11 15:34:58,517 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-4) Start initializing JobRepositoryCleanupManager >2014-08-11 15:34:58,517 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-4) Finished initializing JobRepositoryCleanupManager >2014-08-11 15:34:58,518 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-4) Start initializing AutoRecoveryManager >2014-08-11 15:34:58,519 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-4) Finished initializing AutoRecoveryManager >2014-08-11 15:34:58,521 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-4) Start initializing ExecutionMessageDirector >2014-08-11 15:34:58,523 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-4) Finished initializing ExecutionMessageDirector >2014-08-11 15:34:58,557 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-4) Start of enabled extensions list >2014-08-11 15:34:58,557 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-4) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' >2014-08-11 15:34:58,558 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-4) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' >2014-08-11 15:34:58,559 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-4) End of enabled extensions list >2014-08-11 15:34:58,628 INFO [org.ovirt.engine.core.bll.aaa.DbUserCacheManager] (MSC service thread 1-1) Start initializing DbUserCacheManager >2014-08-11 15:34:58,630 INFO [org.ovirt.engine.core.bll.aaa.DbUserCacheManager] (MSC service thread 1-1) Finished initializing DbUserCacheManager >2014-08-11 15:34:58,639 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-1) Initialization of AsyncTaskManager completed successfully. >2014-08-11 15:34:58,640 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) Start initializing ResourceManager >2014-08-11 15:34:58,688 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Entered VdsManager constructor >2014-08-11 15:34:58,711 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Initialize vdsBroker (vdshost1,54,321) >2014-08-11 15:34:58,874 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) VDS ccc5aec0-8b3c-4089-89ea-52185b3f390b was added to the Resource Manager >2014-08-11 15:34:58,875 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Entered VdsManager constructor >2014-08-11 15:34:58,894 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Initialize vdsBroker (vdshost2,54,321) >2014-08-11 15:34:58,899 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) VDS eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8 was added to the Resource Manager >2014-08-11 15:34:58,920 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) Finished initializing ResourceManager >2014-08-11 15:34:58,924 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-1) Initialization of OvfDataUpdater completed successfully. >2014-08-11 15:34:58,924 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Start scheduling to enable vds load balancer >2014-08-11 15:34:58,924 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Finished scheduling to enable vds load balancer >2014-08-11 15:34:58,925 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Start HA Reservation check >2014-08-11 15:34:58,925 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Finished HA Reservation check >2014-08-11 15:34:58,936 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) Init VM custom properties utilities >2014-08-11 15:34:58,937 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) Init device custom properties utilities >2014-08-11 15:34:58,946 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Initializing Scheduling manager >2014-08-11 15:34:58,978 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges >2014-08-11 15:34:58,978 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 150 >2014-08-11 15:34:58,979 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolPerDc] (org.ovirt.thread.pool-8-thread-1) successfully initialized >2014-08-11 15:34:58,984 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) External scheduler disabled, discovery skipped >2014-08-11 15:34:58,984 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Initialized Scheduling manager >2014-08-11 15:34:58,984 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-1) Initializing DWH Heart Beat >2014-08-11 15:34:58,985 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-1) DWH Heart Beat initialized >2014-08-11 15:34:59,007 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-1) Principal admin::internal synchronized >2014-08-11 15:35:02,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GetHardwareInfoVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8]), log id: 737660ac >2014-08-11 15:35:02,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GetHardwareInfoVDSCommand, log id: 737660ac >2014-08-11 15:35:02,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetHardwareInfoVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, vds=Host[vdshost1,ccc5aec0-8b3c-4089-89ea-52185b3f390b]), log id: 53f1cbaf >2014-08-11 15:35:02,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetHardwareInfoVDSCommand, log id: 53f1cbaf >2014-08-11 15:35:02,651 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Cannot convert the string Host ${VdsName} is not responding. It will stay in Connecting state for a grace period of ${Seconds} seconds and after that an attempt to fence the host will be issued. to AuditLogType, the key does not exist in the AuditLogType declared types >2014-08-11 15:35:02,656 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: UNASSIGNED not exist in string table >2014-08-11 15:35:02,656 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-08-11 15:35:02,661 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-08-11 15:35:02,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-08-11 15:35:02,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-08-11 15:35:02,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_NOT_RESTARTED_DUE_TO_POLICY not exist in string table >2014-08-11 15:35:02,663 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-08-11 15:35:02,663 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-08-11 15:35:02,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-08-11 15:35:02,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: VDS_HOST_IN_CONNECTING_STATE not exist in string table >2014-08-11 15:35:02,665 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-08-11 15:35:02,665 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: DWH_STOPPED not exist in string table >2014-08-11 15:35:02,666 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: DWH_STARTED not exist in string table >2014-08-11 15:35:02,666 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: DWH_ERROR not exist in string table >2014-08-11 15:35:02,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_REMOVE_AUDIT_LOG not exist in string table >2014-08-11 15:35:02,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_REMOVE_AUDIT_LOG_FAILED not exist in string table >2014-08-11 15:35:02,668 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_CLEAR_ALL_DISMISSED_AUDIT_LOG not exist in string table >2014-08-11 15:35:02,668 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) AuditLogType: USER_CLEAR_ALL_DISMISSED_AUDIT_LOG_FAILED not exist in string table >2014-08-11 15:35:02,815 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-8) Initializing Host: vdshost2 >2014-08-11 15:35:02,817 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host vdshost1 does not enforce SELinux. >2014-08-11 15:35:02,818 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Host vdshost1 does not report SELinux enforcement information. >2014-08-11 15:35:02,907 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-8) [9a7fcb4] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8 Type: VDS >2014-08-11 15:35:02,945 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) Initializing Host: vdshost1 >2014-08-11 15:35:02,950 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [536f0f8e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: ccc5aec0-8b3c-4089-89ea-52185b3f390b Type: VDS >2014-08-11 15:35:08,939 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 45dd52dc-0e1c-4321-8a19-f4a0b735410f Type: StoragePool >2014-08-11 15:35:08,940 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-22) [7626c070] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 9e763f98-5d93-4677-b9ac-f0b5504c123f Type: StoragePool >2014-08-11 15:35:08,966 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-22) [7626c070] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain 22f5f897-a094-417c-8545-86c72e865ef3 status from Active to Unknown, reason : null >2014-08-11 15:35:08,971 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-22) [7626c070] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain c2214465-94f1-48a5-bde6-ebaafa3daba4 status from Active to Unknown, reason : null >2014-08-11 15:35:08,972 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-22) [7626c070] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain d93bea2b-6772-4daf-9a0b-68eef7bcf385 status from Active to Unknown, reason : null >2014-08-11 15:35:08,975 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain 565441d8-3f84-4c1e-8f78-90e903087208 status from Active to Unknown, reason : null >2014-08-11 15:35:08,976 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-22) [7626c070] Storage Pool 9e763f98-5d93-4677-b9ac-f0b5504c123f - Updating Storage Domain 41ddf26d-701b-4e99-843c-16db1a5dd84c status from Active to Unknown, reason : null >2014-08-11 15:35:08,977 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain 762836c3-cb5b-49cf-963d-08cc79137189 status from Active to Unknown, reason : null >2014-08-11 15:35:08,979 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain a499025c-18cf-410b-9163-29fc62d44ba4 status from Active to Unknown, reason : null >2014-08-11 15:35:08,991 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Storage Pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f - Updating Storage Domain 9aac3d1c-aca8-47f8-95a9-4d9996313f87 status from Active to Unknown, reason : null >2014-08-11 15:35:09,059 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Correlation ID: 1a2462c6, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center dc2. Setting status to Non Responsive. >2014-08-11 15:35:09,076 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [7626c070] Correlation ID: 7626c070, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center dc1. Setting status to Non Responsive. >2014-08-11 15:35:09,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-22) [7626c070] hostFromVds::selectedVds - vdshost1, spmStatus SPM, storage pool dc1 >2014-08-11 15:35:09,196 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-24) [1a2462c6] hostFromVds::selectedVds - vdshost2, spmStatus SPM, storage pool dc2 >2014-08-11 15:35:09,209 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-22) [7626c070] Initialize Irs proxy from vds: vdshost1 >2014-08-11 15:35:09,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Initialize Irs proxy from vds: vdshost2 >2014-08-11 15:35:09,227 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-22) [7626c070] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host vdshost1 (Address: vdshost1). >2014-08-11 15:35:09,234 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) [1a2462c6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host vdshost2 (Address: vdshost2). >2014-08-11 15:35:09,239 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7626c070] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 9e763f98-5d93-4677-b9ac-f0b5504c123f, ignoreFailoverLimit = false), log id: 6b1df169 >2014-08-11 15:35:09,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [1a2462c6] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false), log id: 24989b23 >2014-08-11 15:35:09,364 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-30) [32dba0b6] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 15:35:09,380 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [3ff1930] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 41ddf26d-701b-4e99-843c-16db1a5dd84c Type: Storage >2014-08-11 15:35:09,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-30) [32dba0b6] START, GetVGInfoVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, VGID=70yYYL-Kykz-akKK-G70S-qI1K-WwWh-NIMHiM), log id: 70a9a325 >2014-08-11 15:35:09,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7626c070] -- executeIrsBrokerCommand: Attempting on storage pool 9e763f98-5d93-4677-b9ac-f0b5504c123f >2014-08-11 15:35:09,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7626c070] START, HSMGetAllTasksInfoVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b), log id: 14b4cec7 >2014-08-11 15:35:09,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7626c070] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 14b4cec7 >2014-08-11 15:35:09,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [7626c070] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6b1df169 >2014-08-11 15:35:09,408 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) [7626c070] Discovered no tasks on Storage Pool dc1 >2014-08-11 15:35:09,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-30) [32dba0b6] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600a09803753795a64244531644f7832, physicalVolumeId=yj5CGQ-hanH-DrTs-5465-Lmy2-re2c-wTKW2T, volumeGroupId=70yYYL-Kykz-akKK-G70S-qI1K-WwWh-NIMHiM, serial=SNETAPP_LUN_C-Mode_7SyZd_E1dOx2, lunMapping=1, vendorId=NETAPP, productId=LUN C-Mode, _lunConnections=[{ id: null, connection: 10.35.19.161, iqn: iqn.1992-08.com.netapp:sn.82749f0181ee11e3bcf9123478563412:vs.6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=50, vendorName=NETAPP, pathsDictionary={sdab=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=a499025c-18cf-410b-9163-29fc62d44ba4, storageDomainName=null]], log id: 70a9a325 >2014-08-11 15:35:09,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-31) [3ff1930] START, GetVGInfoVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, VGID=ySBXsV-7G81-q9Ht-9U49-R3x1-9SOR-gZxjpA), log id: 337af227 >2014-08-11 15:35:09,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [1a2462c6] -- executeIrsBrokerCommand: Attempting on storage pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f >2014-08-11 15:35:09,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [1a2462c6] START, HSMGetAllTasksInfoVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8), log id: 8db7b1c >2014-08-11 15:35:09,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-31) [3ff1930] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600a09803753795a64244531644f777a, physicalVolumeId=w9cCS7-0hfD-7Vdx-p3eD-knlJ-cEyT-wmO0if, volumeGroupId=ySBXsV-7G81-q9Ht-9U49-R3x1-9SOR-gZxjpA, serial=SNETAPP_LUN_C-Mode_7SyZd_E1dOwz, lunMapping=0, vendorId=NETAPP, productId=LUN C-Mode, _lunConnections=[{ id: null, connection: 10.35.19.161, iqn: iqn.1992-08.com.netapp:sn.82749f0181ee11e3bcf9123478563412:vs.6, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=50, vendorName=NETAPP, pathsDictionary={sdba=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=41ddf26d-701b-4e99-843c-16db1a5dd84c, storageDomainName=null]], log id: 337af227 >2014-08-11 15:35:09,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [1a2462c6] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 8db7b1c >2014-08-11 15:35:09,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [1a2462c6] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 24989b23 >2014-08-11 15:35:09,476 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-28) [1a2462c6] Discovered no tasks on Storage Pool dc2 >2014-08-11 15:35:11,577 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (http--0.0.0.0-8080-4) Running command: LoginAdminUserCommand internal: false. >2014-08-11 15:35:11,592 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:35:15,311 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-2) Running command: LoginUserCommand internal: false. >2014-08-11 15:35:18,443 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:35:22,689 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (http--0.0.0.0-8080-4) [4c981a5d] Lock Acquired to object EngineLock [exclusiveLocks= key: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b value: VM >, sharedLocks= ] >2014-08-11 15:35:22,893 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-15) [4c981a5d] Running command: RemoveVmCommand internal: false. Entities affected : ID: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b Type: VMAction group DELETE_VM with role type USER >2014-08-11 15:35:22,910 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-15) [4c981a5d] START, SetVmStatusVDSCommand( vmId = 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b, status = ImageLocked, exit status = Normal), log id: 4088e2ed >2014-08-11 15:35:22,931 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-15) [4c981a5d] FINISH, SetVmStatusVDSCommand, log id: 4088e2ed >2014-08-11 15:35:22,943 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-15) [4c981a5d] Lock freed to object EngineLock [exclusiveLocks= key: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b value: VM >, sharedLocks= ] >2014-08-11 15:35:23,012 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-15) [4c63d1df] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 0ba0df03-3cc2-440e-a2fc-e9ad9705fe9b Type: VM >2014-08-11 15:35:23,028 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-15) [44f778d0] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:35:23,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-15) [44f778d0] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8eff65a7-caec-4815-96a9-97611191d4b9, postZeros = false, forceDelete = false), log id: e0ca242 >2014-08-11 15:35:23,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-15) [44f778d0] FINISH, DeleteImageGroupVDSCommand, log id: e0ca242 >2014-08-11 15:35:23,371 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-15) [44f778d0] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command f6734a0f-39f4-4d05-983d-e0c79c45159c >2014-08-11 15:35:23,372 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-15) [44f778d0] CommandMultiAsyncTasks::AttachTask: Attaching task 4effea50-65a9-42f3-bf76-77914a8e6b76 to command f6734a0f-39f4-4d05-983d-e0c79c45159c. >2014-08-11 15:35:23,486 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-15) [44f778d0] Adding task 4effea50-65a9-42f3-bf76-77914a8e6b76 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:35:23,627 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-15) [44f778d0] Correlation ID: 4c981a5d, Job ID: 8c422aac-f674-4367-9bd9-11cc800e1030, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was successfully removed. >2014-08-11 15:35:23,628 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-15) [44f778d0] BaseAsyncTask::startPollingTask: Starting to poll task 4effea50-65a9-42f3-bf76-77914a8e6b76. >2014-08-11 15:35:28,631 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-72) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-11 15:35:28,640 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-72) SPMAsyncTask::PollTask: Polling task 4effea50-65a9-42f3-bf76-77914a8e6b76 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:35:28,738 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-72) BaseAsyncTask::onTaskEndSuccess: Task 4effea50-65a9-42f3-bf76-77914a8e6b76 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:35:28,739 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-72) CommandAsyncTask::endActionIfNecessary: All tasks of command f6734a0f-39f4-4d05-983d-e0c79c45159c has ended -> executing endAction >2014-08-11 15:35:28,740 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-72) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: f6734a0f-39f4-4d05-983d-e0c79c45159c): calling endAction . >2014-08-11 15:35:28,742 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-24) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-08-11 15:35:28,810 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-24) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-08-11 15:35:28,812 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-24) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-08-11 15:35:28,812 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-24) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-08-11 15:35:28,827 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-24) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 4effea50-65a9-42f3-bf76-77914a8e6b76 >2014-08-11 15:35:28,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-24) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 4effea50-65a9-42f3-bf76-77914a8e6b76), log id: 2886bc62 >2014-08-11 15:35:28,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-24) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=4effea50-65a9-42f3-bf76-77914a8e6b76), log id: 4834f55d >2014-08-11 15:35:28,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-24) FINISH, HSMClearTaskVDSCommand, log id: 4834f55d >2014-08-11 15:35:28,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-24) FINISH, SPMClearTaskVDSCommand, log id: 2886bc62 >2014-08-11 15:35:29,011 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-24) BaseAsyncTask::removeTaskFromDB: Removed task 4effea50-65a9-42f3-bf76-77914a8e6b76 from DataBase >2014-08-11 15:35:29,011 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-24) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity f6734a0f-39f4-4d05-983d-e0c79c45159c >2014-08-11 15:35:41,109 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [4a3384d4] Lock Acquired to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:35:41,144 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [4a3384d4] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: e9d52ee1-5e46-4a89-803d-2f8259b8f981 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-08-11 15:35:41,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [4a3384d4] Correlation ID: 4a3384d4, Job ID: 926b646f-20f8-459e-9094-215fe466eda8, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was created by admin. >2014-08-11 15:35:41,261 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [4a3384d4] Lock freed to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:35:41,942 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (http--0.0.0.0-8080-4) [626d37d2] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER >2014-08-11 15:35:48,988 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [a42cbef] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM_DISK_BOOT >, sharedLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >] >2014-08-11 15:35:49,019 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [a42cbef] Running command: AddDiskCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: StorageAction group CREATE_DISK with role type USER >2014-08-11 15:35:49,113 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [473580fd] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 15:35:49,163 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [473580fd] Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM_DISK_BOOT >, sharedLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >] >2014-08-11 15:35:49,165 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [473580fd] START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 290bea6b-dcc9-4cb0-a0be-200e6c613722, newImageDescription = ), log id: 5e9f2325 >2014-08-11 15:35:49,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [473580fd] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:35:49,252 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [473580fd] FINISH, CreateImageVDSCommand, return: 290bea6b-dcc9-4cb0-a0be-200e6c613722, log id: 5e9f2325 >2014-08-11 15:35:49,314 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [473580fd] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 55382e0b-b3b6-46d4-87af-be01c5710cc1 >2014-08-11 15:35:49,315 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [473580fd] CommandMultiAsyncTasks::AttachTask: Attaching task bd871217-ff94-4e7f-8d50-4089dccc0e7f to command 55382e0b-b3b6-46d4-87af-be01c5710cc1. >2014-08-11 15:35:49,345 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [473580fd] Adding task bd871217-ff94-4e7f-8d50-4089dccc0e7f (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:35:49,428 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [473580fd] Correlation ID: a42cbef, Job ID: 44015b2a-c120-45ce-9904-7f76ce31a424, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm1_Disk1 was initiated on VM vm1 by admin. >2014-08-11 15:35:49,429 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [473580fd] BaseAsyncTask::startPollingTask: Starting to poll task bd871217-ff94-4e7f-8d50-4089dccc0e7f. >2014-08-11 15:35:58,749 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-64) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-08-11 15:35:58,755 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-64) SPMAsyncTask::PollTask: Polling task bd871217-ff94-4e7f-8d50-4089dccc0e7f (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:35:58,795 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-64) BaseAsyncTask::onTaskEndSuccess: Task bd871217-ff94-4e7f-8d50-4089dccc0e7f (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:35:58,796 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-64) CommandAsyncTask::endActionIfNecessary: All tasks of command 55382e0b-b3b6-46d4-87af-be01c5710cc1 has ended -> executing endAction >2014-08-11 15:35:58,797 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-64) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 55382e0b-b3b6-46d4-87af-be01c5710cc1): calling endAction . >2014-08-11 15:35:58,798 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-11 15:35:58,812 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-44) [a42cbef] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-11 15:35:58,863 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-44) [473580fd] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-11 15:35:58,866 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-44) [473580fd] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageId = 290bea6b-dcc9-4cb0-a0be-200e6c613722), log id: 26a6dbe >2014-08-11 15:35:58,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-44) [473580fd] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@d4dbc775, log id: 26a6dbe >2014-08-11 15:35:58,945 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) Correlation ID: a42cbef, Call Stack: null, Custom Event ID: -1, Message: The disk vm1_Disk1 was successfully added to VM vm1. >2014-08-11 15:35:58,946 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-11 15:35:58,947 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-11 15:35:58,953 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bd871217-ff94-4e7f-8d50-4089dccc0e7f >2014-08-11 15:35:58,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = bd871217-ff94-4e7f-8d50-4089dccc0e7f), log id: 3ee8645f >2014-08-11 15:35:58,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=bd871217-ff94-4e7f-8d50-4089dccc0e7f), log id: 3f34597a >2014-08-11 15:35:58,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 3f34597a >2014-08-11 15:35:58,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 3ee8645f >2014-08-11 15:35:58,995 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) BaseAsyncTask::removeTaskFromDB: Removed task bd871217-ff94-4e7f-8d50-4089dccc0e7f from DataBase >2014-08-11 15:35:58,996 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 55382e0b-b3b6-46d4-87af-be01c5710cc1 >2014-08-11 15:36:01,231 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [3ab41a0] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:36:01,285 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [3ab41a0] START, IsVmDuringInitiatingVDSCommand( vmId = 850415d1-265a-43c9-ae65-6a11abbb32f7), log id: 64a5c260 >2014-08-11 15:36:01,286 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [3ab41a0] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 64a5c260 >2014-08-11 15:36:01,404 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] Running command: RunVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:36:01,444 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] START, UpdateVmDynamicDataVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@d53d25f0), log id: 3c56a1ff >2014-08-11 15:36:01,454 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] FINISH, UpdateVmDynamicDataVDSCommand, log id: 3c56a1ff >2014-08-11 15:36:01,458 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] START, CreateVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, vm=VM [vm1]), log id: 2c10c51a >2014-08-11 15:36:01,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] START, CreateVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, vm=VM [vm1]), log id: 4e8b39ad >2014-08-11 15:36:01,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=850415d1-265a-43c9-ae65-6a11abbb32f7,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=interleave},maxVCpus=16,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=b9cee75b-2a8a-4a08-9ba2-ae92fdab1831}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=5ec1e01f-1863-48f0-a79e-2685458ef984}, {shared=false, volumeID=290bea6b-dcc9-4cb0-a0be-200e6c613722, index=0, iface=virtio, imageID=8a8a508b-98f0-4c83-94fb-ed45d72abb5f, domainID=9aac3d1c-aca8-47f8-95a9-4d9996313f87, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=45dd52dc-0e1c-4321-8a19-f4a0b735410f, format=raw, type=disk, readonly=false, deviceId=8a8a508b-98f0-4c83-94fb-ed45d72abb5f}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=a14ec2f7-b916-4604-9d98-25a41867c9e3}],vmName=vm1,cpuType=Haswell,fileTransferEnable=true >2014-08-11 15:36:01,553 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] FINISH, CreateVDSCommand, log id: 4e8b39ad >2014-08-11 15:36:01,579 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2c10c51a >2014-08-11 15:36:01,580 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:36:01,604 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-49) [3ab41a0] Correlation ID: 3ab41a0, Job ID: 6c6c83a2-f0ba-43ba-b3ee-3826541fbcc8, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin (Host: vdshost2). >2014-08-11 15:36:05,251 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) VM vm1 850415d1-265a-43c9-ae65-6a11abbb32f7 moved from WaitForLaunch --> PoweringUp >2014-08-11 15:36:05,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-86) START, FullListVdsCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8], vmIds=[850415d1-265a-43c9-ae65-6a11abbb32f7]), log id: 290aed8d >2014-08-11 15:36:05,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-86) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=10.35.0.191, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=1024, display=qxl, pid=3505, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=interleave}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@c71d908, vmName=vm1, fileTransferEnable=true, cpuType=Haswell}], log id: 290aed8d >2014-08-11 15:36:05,288 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) Received a memballoon Device without an address when processing VM 850415d1-265a-43c9-ae65-6a11abbb32f7 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-08-11 15:36:05,288 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) Received a spice Device without an address when processing VM 850415d1-265a-43c9-ae65-6a11abbb32f7 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.191}, device=spice, tlsPort=5901, type=graphics} >2014-08-11 15:36:28,750 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-50) Setting new tasks map. The map contains now 1 tasks >2014-08-11 15:37:03,921 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) VM vm1 850415d1-265a-43c9-ae65-6a11abbb32f7 moved from PoweringUp --> Up >2014-08-11 15:37:04,006 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-60) Correlation ID: 3ab41a0, Job ID: 6c6c83a2-f0ba-43ba-b3ee-3826541fbcc8, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host vdshost2 >2014-08-11 15:37:21,903 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [50d9696c] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:37:22,033 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-41) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:37:22,162 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-41) [ffffdae] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:37:22,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-41) [ffffdae] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = c1169cf9-65a0-428d-b89e-f6447edbad57, newImageDescription = , imageId = 290bea6b-dcc9-4cb0-a0be-200e6c613722, sourceImageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f), log id: 6c59fcfd >2014-08-11 15:37:22,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-41) [ffffdae] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:37:22,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-41) [ffffdae] FINISH, CreateSnapshotVDSCommand, return: c1169cf9-65a0-428d-b89e-f6447edbad57, log id: 6c59fcfd >2014-08-11 15:37:22,285 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-41) [ffffdae] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a >2014-08-11 15:37:22,286 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-41) [ffffdae] CommandMultiAsyncTasks::AttachTask: Attaching task 170a3328-1c5f-430d-a87f-1895952bcf01 to command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a. >2014-08-11 15:37:22,405 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-41) [ffffdae] Adding task 170a3328-1c5f-430d-a87f-1895952bcf01 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:37:22,481 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 728af291-dd74-47f3-8b84-faeb99350a46, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = fcae5812-b868-45e6-b09c-432e7fa4516b, newImageDescription = ), log id: 31a265cc >2014-08-11 15:37:22,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-41) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:37:22,652 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, CreateImageVDSCommand, return: fcae5812-b868-45e6-b09c-432e7fa4516b, log id: 31a265cc >2014-08-11 15:37:22,785 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-41) CommandMultiAsyncTasks::AttachTask: Attaching task 70050b00-7bd4-49f7-9ec1-c391a4aaa709 to command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a. >2014-08-11 15:37:22,913 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-41) Adding task 70050b00-7bd4-49f7-9ec1-c391a4aaa709 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:37:22,933 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 6b14060d-39f6-42cf-a1f0-a14f871b8abe, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 1a58c962-4d0e-4c77-891e-8864395d643c, newImageDescription = ), log id: 475a9012 >2014-08-11 15:37:22,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-41) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:37:23,090 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, CreateImageVDSCommand, return: 1a58c962-4d0e-4c77-891e-8864395d643c, log id: 475a9012 >2014-08-11 15:37:23,164 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-41) CommandMultiAsyncTasks::AttachTask: Attaching task 0dacc279-e1cf-4ce8-8c48-3d036d793e87 to command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a. >2014-08-11 15:37:23,217 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-41) Adding task 0dacc279-e1cf-4ce8-8c48-3d036d793e87 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:37:23,407 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-41) Correlation ID: 50d9696c, Job ID: 318fd9b2-8ef8-4d08-a760-60774ab1b83c, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'vm1' was initiated by admin. >2014-08-11 15:37:23,408 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-41) BaseAsyncTask::startPollingTask: Starting to poll task 170a3328-1c5f-430d-a87f-1895952bcf01. >2014-08-11 15:37:23,408 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-41) BaseAsyncTask::startPollingTask: Starting to poll task 70050b00-7bd4-49f7-9ec1-c391a4aaa709. >2014-08-11 15:37:23,408 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-41) BaseAsyncTask::startPollingTask: Starting to poll task 0dacc279-e1cf-4ce8-8c48-3d036d793e87. >2014-08-11 15:37:28,750 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-31) Setting new tasks map. The map contains now 3 tasks >2014-08-11 15:37:28,803 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-30) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-08-11 15:37:28,809 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-30) SPMAsyncTask::PollTask: Polling task 170a3328-1c5f-430d-a87f-1895952bcf01 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:37:28,850 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-30) BaseAsyncTask::onTaskEndSuccess: Task 170a3328-1c5f-430d-a87f-1895952bcf01 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:37:28,851 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-30) Task with DB Task ID 83140514-a925-4804-af84-9faf8fbaced2 and VDSM Task ID 70050b00-7bd4-49f7-9ec1-c391a4aaa709 is in state Polling. End action for command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a will proceed when all the entitys tasks are completed. >2014-08-11 15:37:28,851 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-30) SPMAsyncTask::PollTask: Polling task 0dacc279-e1cf-4ce8-8c48-3d036d793e87 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:37:28,875 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-30) BaseAsyncTask::onTaskEndSuccess: Task 0dacc279-e1cf-4ce8-8c48-3d036d793e87 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:37:28,876 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-30) Task with DB Task ID 83140514-a925-4804-af84-9faf8fbaced2 and VDSM Task ID 70050b00-7bd4-49f7-9ec1-c391a4aaa709 is in state Polling. End action for command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a will proceed when all the entitys tasks are completed. >2014-08-11 15:37:28,877 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-30) SPMAsyncTask::PollTask: Polling task 70050b00-7bd4-49f7-9ec1-c391a4aaa709 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:37:28,883 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-30) BaseAsyncTask::onTaskEndSuccess: Task 70050b00-7bd4-49f7-9ec1-c391a4aaa709 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:37:28,884 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-30) CommandAsyncTask::endActionIfNecessary: All tasks of command 969ec352-5b05-4ef1-8f6c-0262dcc05c9a has ended -> executing endAction >2014-08-11 15:37:28,885 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-30) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 969ec352-5b05-4ef1-8f6c-0262dcc05c9a): calling endAction . >2014-08-11 15:37:28,892 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-10) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:37:28,975 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-10) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:37:29,004 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7), log id: 33453f27 >2014-08-11 15:37:30,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-10) Failed in SnapshotVDS method >2014-08-11 15:37:30,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-10) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:37:30,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-10) HostName = vdshost2 >2014-08-11 15:37:30,239 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-10) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:37:30,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, SnapshotVDSCommand, log id: 33453f27 >2014-08-11 15:37:30,240 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-10) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:37:30,244 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) Correlation ID: 50d9696c, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap1' for VM 'vm1'. VM restart is recommended. >2014-08-11 15:37:30,292 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-10) [ffffdae] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:37:30,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-10) [ffffdae] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageId = c1169cf9-65a0-428d-b89e-f6447edbad57), log id: 7fb870c3 >2014-08-11 15:37:30,317 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-10) [ffffdae] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@ee513c3c, log id: 7fb870c3 >2014-08-11 15:37:30,337 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-10) Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:37:30,392 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) Correlation ID: 50d9696c, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap1' creation for VM 'vm1'. >2014-08-11 15:37:30,397 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-10) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:37:30,397 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-10) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:37:30,434 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-10) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 70050b00-7bd4-49f7-9ec1-c391a4aaa709 >2014-08-11 15:37:30,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 70050b00-7bd4-49f7-9ec1-c391a4aaa709), log id: 6a853f55 >2014-08-11 15:37:30,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=70050b00-7bd4-49f7-9ec1-c391a4aaa709), log id: 46dad0c2 >2014-08-11 15:37:30,456 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, HSMClearTaskVDSCommand, log id: 46dad0c2 >2014-08-11 15:37:30,456 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, SPMClearTaskVDSCommand, log id: 6a853f55 >2014-08-11 15:37:30,500 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-10) BaseAsyncTask::removeTaskFromDB: Removed task 70050b00-7bd4-49f7-9ec1-c391a4aaa709 from DataBase >2014-08-11 15:37:30,501 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-10) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0dacc279-e1cf-4ce8-8c48-3d036d793e87 >2014-08-11 15:37:30,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 0dacc279-e1cf-4ce8-8c48-3d036d793e87), log id: 17d01dbf >2014-08-11 15:37:30,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=0dacc279-e1cf-4ce8-8c48-3d036d793e87), log id: 6050f2cf >2014-08-11 15:37:30,527 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, HSMClearTaskVDSCommand, log id: 6050f2cf >2014-08-11 15:37:30,527 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, SPMClearTaskVDSCommand, log id: 17d01dbf >2014-08-11 15:37:30,534 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-10) BaseAsyncTask::removeTaskFromDB: Removed task 0dacc279-e1cf-4ce8-8c48-3d036d793e87 from DataBase >2014-08-11 15:37:30,535 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-10) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 170a3328-1c5f-430d-a87f-1895952bcf01 >2014-08-11 15:37:30,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 170a3328-1c5f-430d-a87f-1895952bcf01), log id: 32ee805e >2014-08-11 15:37:30,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=170a3328-1c5f-430d-a87f-1895952bcf01), log id: 482db571 >2014-08-11 15:37:30,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, HSMClearTaskVDSCommand, log id: 482db571 >2014-08-11 15:37:30,601 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, SPMClearTaskVDSCommand, log id: 32ee805e >2014-08-11 15:37:30,609 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-10) BaseAsyncTask::removeTaskFromDB: Removed task 170a3328-1c5f-430d-a87f-1895952bcf01 from DataBase >2014-08-11 15:37:30,610 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-10) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 969ec352-5b05-4ef1-8f6c-0262dcc05c9a >2014-08-11 15:37:34,008 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [377a3128] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:37:34,085 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [377a3128] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: e9d52ee1-5e46-4a89-803d-2f8259b8f981 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-08-11 15:37:34,210 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [377a3128] Correlation ID: 377a3128, Job ID: 4beaa735-1213-492b-8968-3b0b1790563d, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was created by admin. >2014-08-11 15:37:34,227 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [377a3128] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:37:34,722 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (http--0.0.0.0-8080-4) [4864c0ea] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER >2014-08-11 15:37:43,565 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [10513bf2] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM_DISK_BOOT >, sharedLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >] >2014-08-11 15:37:43,618 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [10513bf2] Running command: AddDiskCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: StorageAction group CREATE_DISK with role type USER >2014-08-11 15:37:43,685 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [3092f108] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 15:37:43,702 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [3092f108] Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM_DISK_BOOT >, sharedLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >] >2014-08-11 15:37:43,703 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [3092f108] START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 3ee4cd82-e04c-4ae4-a96d-52d719996809, newImageDescription = ), log id: 331414ed >2014-08-11 15:37:43,709 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [3092f108] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:37:44,005 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [3092f108] FINISH, CreateImageVDSCommand, return: 3ee4cd82-e04c-4ae4-a96d-52d719996809, log id: 331414ed >2014-08-11 15:37:44,056 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [3092f108] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 54a12d7f-b561-4be8-b771-5b0d6b5c045e >2014-08-11 15:37:44,057 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [3092f108] CommandMultiAsyncTasks::AttachTask: Attaching task 0c7af9e8-90f3-4d96-a733-25ac7234b06a to command 54a12d7f-b561-4be8-b771-5b0d6b5c045e. >2014-08-11 15:37:44,077 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [3092f108] Adding task 0c7af9e8-90f3-4d96-a733-25ac7234b06a (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:37:44,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [3092f108] Correlation ID: 10513bf2, Job ID: 00986314-37ee-46b3-b716-635a53b866e7, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm2_Disk1 was initiated on VM vm2 by admin. >2014-08-11 15:37:44,137 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [3092f108] BaseAsyncTask::startPollingTask: Starting to poll task 0c7af9e8-90f3-4d96-a733-25ac7234b06a. >2014-08-11 15:37:48,891 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-92) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-08-11 15:37:48,897 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task 0c7af9e8-90f3-4d96-a733-25ac7234b06a (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:37:48,927 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task 0c7af9e8-90f3-4d96-a733-25ac7234b06a (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:37:48,929 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endActionIfNecessary: All tasks of command 54a12d7f-b561-4be8-b771-5b0d6b5c045e has ended -> executing endAction >2014-08-11 15:37:48,930 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 54a12d7f-b561-4be8-b771-5b0d6b5c045e): calling endAction . >2014-08-11 15:37:48,931 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-11 15:37:48,944 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-7) [10513bf2] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-11 15:37:48,961 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-7) [3092f108] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-11 15:37:48,967 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-7) [3092f108] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageId = 3ee4cd82-e04c-4ae4-a96d-52d719996809), log id: 39cd463a >2014-08-11 15:37:49,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-7) [3092f108] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@8b991db1, log id: 39cd463a >2014-08-11 15:37:49,052 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) Correlation ID: 10513bf2, Call Stack: null, Custom Event ID: -1, Message: The disk vm2_Disk1 was successfully added to VM vm2. >2014-08-11 15:37:49,053 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-11 15:37:49,054 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-11 15:37:49,061 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0c7af9e8-90f3-4d96-a733-25ac7234b06a >2014-08-11 15:37:49,061 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 0c7af9e8-90f3-4d96-a733-25ac7234b06a), log id: 5f74bae6 >2014-08-11 15:37:49,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=0c7af9e8-90f3-4d96-a733-25ac7234b06a), log id: 689a82ff >2014-08-11 15:37:49,086 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, HSMClearTaskVDSCommand, log id: 689a82ff >2014-08-11 15:37:49,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, SPMClearTaskVDSCommand, log id: 5f74bae6 >2014-08-11 15:37:49,102 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::removeTaskFromDB: Removed task 0c7af9e8-90f3-4d96-a733-25ac7234b06a from DataBase >2014-08-11 15:37:49,103 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 54a12d7f-b561-4be8-b771-5b0d6b5c045e >2014-08-11 15:37:57,759 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [6281795d] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:37:57,775 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [6281795d] START, IsVmDuringInitiatingVDSCommand( vmId = b379538b-4d39-4246-8b14-d2a667dc1a60), log id: 72960413 >2014-08-11 15:37:57,776 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [6281795d] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 72960413 >2014-08-11 15:37:57,919 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] Running command: RunVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:37:57,960 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] START, UpdateVmDynamicDataVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@494c363), log id: 7fe18bcb >2014-08-11 15:37:57,969 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] FINISH, UpdateVmDynamicDataVDSCommand, log id: 7fe18bcb >2014-08-11 15:37:57,971 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] START, CreateVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, vm=VM [vm2]), log id: 651a33d6 >2014-08-11 15:37:57,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] START, CreateVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, vm=VM [vm2]), log id: 277fb7f0 >2014-08-11 15:37:57,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=b379538b-4d39-4246-8b14-d2a667dc1a60,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=interleave},maxVCpus=16,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=e466d12e-bdb4-41c2-8961-f4bd736e6642}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=9fba0d9d-50d7-4ebb-a103-e6e7818ef052}, {shared=false, volumeID=3ee4cd82-e04c-4ae4-a96d-52d719996809, index=0, iface=virtio, imageID=77d8ae85-eed7-439e-bc2a-9abd280a63ac, domainID=a499025c-18cf-410b-9163-29fc62d44ba4, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=45dd52dc-0e1c-4321-8a19-f4a0b735410f, format=raw, type=disk, readonly=false, deviceId=77d8ae85-eed7-439e-bc2a-9abd280a63ac}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=67157cc3-5283-427a-bd68-316e67b8452a}],vmName=vm2,cpuType=Haswell,fileTransferEnable=true >2014-08-11 15:37:58,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] FINISH, CreateVDSCommand, log id: 277fb7f0 >2014-08-11 15:37:58,028 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 651a33d6 >2014-08-11 15:37:58,028 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-30) [6281795d] Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:37:58,038 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [6281795d] Correlation ID: 6281795d, Job ID: 86060212-0e9b-4fd4-a8a9-b00342286ea1, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was started by admin (Host: vdshost2). >2014-08-11 15:38:02,269 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-34) VM vm2 b379538b-4d39-4246-8b14-d2a667dc1a60 moved from WaitForLaunch --> PoweringUp >2014-08-11 15:38:02,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-34) START, FullListVdsCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8], vmIds=[b379538b-4d39-4246-8b14-d2a667dc1a60]), log id: 38f49c0b >2014-08-11 15:38:02,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-34) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=10.35.0.191, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5902, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=1024, display=qxl, pid=4715, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=interleave}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@3b5883d1, vmName=vm2, fileTransferEnable=true, cpuType=Haswell}], log id: 38f49c0b >2014-08-11 15:38:02,281 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-34) Received a memballoon Device without an address when processing VM b379538b-4d39-4246-8b14-d2a667dc1a60 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-08-11 15:38:02,281 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-34) Received a spice Device without an address when processing VM b379538b-4d39-4246-8b14-d2a667dc1a60 devices, skipping device: {port=5902, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.191}, device=spice, tlsPort=5903, type=graphics} >2014-08-11 15:38:18,821 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [f66fe] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:38:18,955 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-29) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:38:18,988 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-29) [78033a23] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:38:18,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-29) [78033a23] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 51bc44bc-db90-4bdd-a411-16b64de5861e, newImageDescription = , imageId = c1169cf9-65a0-428d-b89e-f6447edbad57, sourceImageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f), log id: 1979d0bf >2014-08-11 15:38:18,999 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-29) [78033a23] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:38:19,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-29) [78033a23] FINISH, CreateSnapshotVDSCommand, return: 51bc44bc-db90-4bdd-a411-16b64de5861e, log id: 1979d0bf >2014-08-11 15:38:19,098 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-29) [78033a23] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ed4cffe9-894d-459c-92c0-494d8b86cfa0 >2014-08-11 15:38:19,099 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-29) [78033a23] CommandMultiAsyncTasks::AttachTask: Attaching task e7f65617-8a6a-478c-b458-b9b6542675c7 to command ed4cffe9-894d-459c-92c0-494d8b86cfa0. >2014-08-11 15:38:19,122 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-29) [78033a23] Adding task e7f65617-8a6a-478c-b458-b9b6542675c7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:38:19,162 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-29) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = b51b3411-afa8-452f-b328-4dbb4a5e9057, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 80006e46-40f0-4d61-a90a-d8369443390b, newImageDescription = ), log id: 7128874b >2014-08-11 15:38:19,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-29) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:38:19,313 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-29) FINISH, CreateImageVDSCommand, return: 80006e46-40f0-4d61-a90a-d8369443390b, log id: 7128874b >2014-08-11 15:38:19,349 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-29) CommandMultiAsyncTasks::AttachTask: Attaching task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 to command ed4cffe9-894d-459c-92c0-494d8b86cfa0. >2014-08-11 15:38:19,372 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-29) Adding task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:38:19,380 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-29) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8468182f-1b71-4b10-b210-9e443d17c085, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 20bfca57-5b9e-4d25-bf22-ee29fc53f803, newImageDescription = ), log id: 4ef564e1 >2014-08-11 15:38:19,382 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-29) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:38:19,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-29) FINISH, CreateImageVDSCommand, return: 20bfca57-5b9e-4d25-bf22-ee29fc53f803, log id: 4ef564e1 >2014-08-11 15:38:19,757 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-29) CommandMultiAsyncTasks::AttachTask: Attaching task b8a9260e-6836-4841-98c8-b9dafca6799b to command ed4cffe9-894d-459c-92c0-494d8b86cfa0. >2014-08-11 15:38:19,780 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-29) Adding task b8a9260e-6836-4841-98c8-b9dafca6799b (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:38:19,822 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-29) Correlation ID: f66fe, Job ID: ff8b364d-26dd-45a8-9039-09262613ebf5, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap2' creation for VM 'vm1' was initiated by admin. >2014-08-11 15:38:19,823 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-29) BaseAsyncTask::startPollingTask: Starting to poll task e7f65617-8a6a-478c-b458-b9b6542675c7. >2014-08-11 15:38:19,823 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-29) BaseAsyncTask::startPollingTask: Starting to poll task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268. >2014-08-11 15:38:19,824 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-29) BaseAsyncTask::startPollingTask: Starting to poll task b8a9260e-6836-4841-98c8-b9dafca6799b. >2014-08-11 15:38:28,930 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-7) [536f0f8e] Polling and updating Async Tasks: 7 tasks, 3 tasks to poll now >2014-08-11 15:38:28,936 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] SPMAsyncTask::PollTask: Polling task b8a9260e-6836-4841-98c8-b9dafca6799b (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:38:28,981 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] BaseAsyncTask::onTaskEndSuccess: Task b8a9260e-6836-4841-98c8-b9dafca6799b (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:38:28,982 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-7) [536f0f8e] Task with DB Task ID 7d5f8ea6-576a-4f53-a923-b4c39e3b0ec2 and VDSM Task ID 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 is in state Polling. End action for command ed4cffe9-894d-459c-92c0-494d8b86cfa0 will proceed when all the entitys tasks are completed. >2014-08-11 15:38:28,982 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] SPMAsyncTask::PollTask: Polling task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:38:28,989 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] BaseAsyncTask::onTaskEndSuccess: Task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:38:28,990 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-7) [536f0f8e] Task with DB Task ID e77a33a1-9ead-4235-bd1a-79457a3eb303 and VDSM Task ID e7f65617-8a6a-478c-b458-b9b6542675c7 is in state Polling. End action for command ed4cffe9-894d-459c-92c0-494d8b86cfa0 will proceed when all the entitys tasks are completed. >2014-08-11 15:38:28,990 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] SPMAsyncTask::PollTask: Polling task e7f65617-8a6a-478c-b458-b9b6542675c7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:38:28,997 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] BaseAsyncTask::onTaskEndSuccess: Task e7f65617-8a6a-478c-b458-b9b6542675c7 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:38:28,998 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] CommandAsyncTask::endActionIfNecessary: All tasks of command ed4cffe9-894d-459c-92c0-494d8b86cfa0 has ended -> executing endAction >2014-08-11 15:38:28,999 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-7) [536f0f8e] CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: ed4cffe9-894d-459c-92c0-494d8b86cfa0): calling endAction . >2014-08-11 15:38:29,000 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:38:29,022 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:38:29,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7), log id: 397bcf19 >2014-08-11 15:38:29,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] Failed in SnapshotVDS method >2014-08-11 15:38:29,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:38:29,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] HostName = vdshost2 >2014-08-11 15:38:29,042 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:38:29,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] FINISH, SnapshotVDSCommand, log id: 397bcf19 >2014-08-11 15:38:29,043 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:38:29,048 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-13) [536f0f8e] Correlation ID: f66fe, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap2' for VM 'vm1'. VM restart is recommended. >2014-08-11 15:38:29,064 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-13) [78033a23] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:38:29,066 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [78033a23] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageId = 51bc44bc-db90-4bdd-a411-16b64de5861e), log id: 17c6a588 >2014-08-11 15:38:29,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [78033a23] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@9a63aa8a, log id: 17c6a588 >2014-08-11 15:38:29,116 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-13) Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:38:29,131 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-13) Correlation ID: f66fe, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap2' creation for VM 'vm1'. >2014-08-11 15:38:29,136 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:38:29,136 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:38:29,148 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b8a9260e-6836-4841-98c8-b9dafca6799b >2014-08-11 15:38:29,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = b8a9260e-6836-4841-98c8-b9dafca6799b), log id: 66d632c3 >2014-08-11 15:38:29,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=b8a9260e-6836-4841-98c8-b9dafca6799b), log id: 789ed4f3 >2014-08-11 15:38:29,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, HSMClearTaskVDSCommand, log id: 789ed4f3 >2014-08-11 15:38:29,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, SPMClearTaskVDSCommand, log id: 66d632c3 >2014-08-11 15:38:29,181 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) BaseAsyncTask::removeTaskFromDB: Removed task b8a9260e-6836-4841-98c8-b9dafca6799b from DataBase >2014-08-11 15:38:29,181 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 >2014-08-11 15:38:29,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268), log id: 31ec7305 >2014-08-11 15:38:29,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=50d1fb70-cbe3-4f0c-87aa-c23bab0c2268), log id: 1a7366de >2014-08-11 15:38:29,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, HSMClearTaskVDSCommand, log id: 1a7366de >2014-08-11 15:38:29,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, SPMClearTaskVDSCommand, log id: 31ec7305 >2014-08-11 15:38:29,264 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) BaseAsyncTask::removeTaskFromDB: Removed task 50d1fb70-cbe3-4f0c-87aa-c23bab0c2268 from DataBase >2014-08-11 15:38:29,264 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e7f65617-8a6a-478c-b458-b9b6542675c7 >2014-08-11 15:38:29,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = e7f65617-8a6a-478c-b458-b9b6542675c7), log id: 73429727 >2014-08-11 15:38:29,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=e7f65617-8a6a-478c-b458-b9b6542675c7), log id: 18d1bc8f >2014-08-11 15:38:29,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, HSMClearTaskVDSCommand, log id: 18d1bc8f >2014-08-11 15:38:29,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, SPMClearTaskVDSCommand, log id: 73429727 >2014-08-11 15:38:29,350 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-13) BaseAsyncTask::removeTaskFromDB: Removed task e7f65617-8a6a-478c-b458-b9b6542675c7 from DataBase >2014-08-11 15:38:29,350 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-13) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ed4cffe9-894d-459c-92c0-494d8b86cfa0 >2014-08-11 15:38:58,291 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM vm2 b379538b-4d39-4246-8b14-d2a667dc1a60 moved from PoweringUp --> Up >2014-08-11 15:38:58,357 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) Correlation ID: 6281795d, Job ID: 86060212-0e9b-4fd4-a8a9-b00342286ea1, Call Stack: null, Custom Event ID: -1, Message: VM vm2 started on Host vdshost2 >2014-08-11 15:38:58,751 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-94) Setting new tasks map. The map contains now 3 tasks >2014-08-11 15:39:19,247 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [21839c37] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:39:19,324 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-26) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:39:19,358 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:39:19,365 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = d039d77c-88d4-4deb-a183-366bd6afdb95, newImageDescription = , imageId = 3ee4cd82-e04c-4ae4-a96d-52d719996809, sourceImageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac), log id: 7cc5f3ae >2014-08-11 15:39:19,368 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:39:19,808 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] FINISH, CreateSnapshotVDSCommand, return: d039d77c-88d4-4deb-a183-366bd6afdb95, log id: 7cc5f3ae >2014-08-11 15:39:19,828 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813 >2014-08-11 15:39:19,828 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] CommandMultiAsyncTasks::AttachTask: Attaching task 0d213ed2-4604-484e-b144-e8d923a25406 to command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813. >2014-08-11 15:39:19,849 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) [4cb0663c] Adding task 0d213ed2-4604-484e-b144-e8d923a25406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:39:19,877 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-26) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = ef7c5f18-9594-482e-8950-369e259158ad, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 4a93f06b-b5c5-467d-a8ec-f4b2108248ca, newImageDescription = ), log id: 779e6459 >2014-08-11 15:39:19,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-26) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:39:20,267 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-26) FINISH, CreateImageVDSCommand, return: 4a93f06b-b5c5-467d-a8ec-f4b2108248ca, log id: 779e6459 >2014-08-11 15:39:20,317 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-26) CommandMultiAsyncTasks::AttachTask: Attaching task cc2f036a-0a54-4a4d-af0d-137d5b51a361 to command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813. >2014-08-11 15:39:20,366 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) Adding task cc2f036a-0a54-4a4d-af0d-137d5b51a361 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:39:20,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-26) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 246600b3-d577-4118-8f3e-33ce698e65e5, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = c222543b-1965-4f46-954f-e4fdf91f053b, newImageDescription = ), log id: 38e41198 >2014-08-11 15:39:20,376 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-26) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:39:20,531 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-26) FINISH, CreateImageVDSCommand, return: c222543b-1965-4f46-954f-e4fdf91f053b, log id: 38e41198 >2014-08-11 15:39:20,567 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-26) CommandMultiAsyncTasks::AttachTask: Attaching task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c to command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813. >2014-08-11 15:39:20,583 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-26) Adding task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:39:20,625 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-26) Correlation ID: 21839c37, Job ID: 27dbe9eb-49e4-4e42-917c-65789aaec7b4, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'vm2' was initiated by admin. >2014-08-11 15:39:20,625 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) BaseAsyncTask::startPollingTask: Starting to poll task 0d213ed2-4604-484e-b144-e8d923a25406. >2014-08-11 15:39:20,626 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) BaseAsyncTask::startPollingTask: Starting to poll task cc2f036a-0a54-4a4d-af0d-137d5b51a361. >2014-08-11 15:39:20,626 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) BaseAsyncTask::startPollingTask: Starting to poll task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c. >2014-08-11 15:39:29,009 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-92) Polling and updating Async Tasks: 6 tasks, 3 tasks to poll now >2014-08-11 15:39:29,068 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task 0d213ed2-4604-484e-b144-e8d923a25406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:39:29,108 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task 0d213ed2-4604-484e-b144-e8d923a25406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:39:29,109 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-92) Task with DB Task ID c06876f4-c82b-498f-9a4f-e3274b1ce267 and VDSM Task ID 211bf8a6-fb33-4d89-aa8d-a94aea674f3c is in state Polling. End action for command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813 will proceed when all the entitys tasks are completed. >2014-08-11 15:39:29,110 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task cc2f036a-0a54-4a4d-af0d-137d5b51a361 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:39:29,116 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task cc2f036a-0a54-4a4d-af0d-137d5b51a361 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:39:29,117 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-92) Task with DB Task ID c06876f4-c82b-498f-9a4f-e3274b1ce267 and VDSM Task ID 211bf8a6-fb33-4d89-aa8d-a94aea674f3c is in state Polling. End action for command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813 will proceed when all the entitys tasks are completed. >2014-08-11 15:39:29,118 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:39:29,125 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:39:29,125 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endActionIfNecessary: All tasks of command 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813 has ended -> executing endAction >2014-08-11 15:39:29,126 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813): calling endAction . >2014-08-11 15:39:29,126 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:39:29,158 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-4) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:39:29,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60), log id: 17892e81 >2014-08-11 15:39:30,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-4) Failed in SnapshotVDS method >2014-08-11 15:39:30,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-4) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:39:30,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-4) HostName = vdshost2 >2014-08-11 15:39:30,723 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-4) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:39:30,724 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, SnapshotVDSCommand, log id: 17892e81 >2014-08-11 15:39:30,724 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-4) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:39:30,728 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) Correlation ID: 21839c37, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap1' for VM 'vm2'. VM restart is recommended. >2014-08-11 15:39:30,742 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-4) [4cb0663c] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:39:30,746 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-4) [4cb0663c] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageId = d039d77c-88d4-4deb-a183-366bd6afdb95), log id: 588129d2 >2014-08-11 15:39:30,800 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-4) [4cb0663c] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a305cc58, log id: 588129d2 >2014-08-11 15:39:30,818 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-4) Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:39:30,833 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) Correlation ID: 21839c37, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap1' creation for VM 'vm2'. >2014-08-11 15:39:30,838 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:39:30,838 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:39:30,850 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c >2014-08-11 15:39:30,851 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 211bf8a6-fb33-4d89-aa8d-a94aea674f3c), log id: 50ccf6a4 >2014-08-11 15:39:30,854 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=211bf8a6-fb33-4d89-aa8d-a94aea674f3c), log id: 4054b26d >2014-08-11 15:39:30,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, HSMClearTaskVDSCommand, log id: 4054b26d >2014-08-11 15:39:30,874 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, SPMClearTaskVDSCommand, log id: 50ccf6a4 >2014-08-11 15:39:30,884 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) BaseAsyncTask::removeTaskFromDB: Removed task 211bf8a6-fb33-4d89-aa8d-a94aea674f3c from DataBase >2014-08-11 15:39:30,884 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) SPMAsyncTask::ClearAsyncTask: Attempting to clear task cc2f036a-0a54-4a4d-af0d-137d5b51a361 >2014-08-11 15:39:30,885 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = cc2f036a-0a54-4a4d-af0d-137d5b51a361), log id: 4beb283a >2014-08-11 15:39:30,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=cc2f036a-0a54-4a4d-af0d-137d5b51a361), log id: 3b9e1ec6 >2014-08-11 15:39:30,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, HSMClearTaskVDSCommand, log id: 3b9e1ec6 >2014-08-11 15:39:30,960 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, SPMClearTaskVDSCommand, log id: 4beb283a >2014-08-11 15:39:30,975 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) BaseAsyncTask::removeTaskFromDB: Removed task cc2f036a-0a54-4a4d-af0d-137d5b51a361 from DataBase >2014-08-11 15:39:30,975 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0d213ed2-4604-484e-b144-e8d923a25406 >2014-08-11 15:39:30,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 0d213ed2-4604-484e-b144-e8d923a25406), log id: 33b09245 >2014-08-11 15:39:30,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=0d213ed2-4604-484e-b144-e8d923a25406), log id: d530a86 >2014-08-11 15:39:31,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, HSMClearTaskVDSCommand, log id: d530a86 >2014-08-11 15:39:31,034 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) FINISH, SPMClearTaskVDSCommand, log id: 33b09245 >2014-08-11 15:39:31,050 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) BaseAsyncTask::removeTaskFromDB: Removed task 0d213ed2-4604-484e-b144-e8d923a25406 from DataBase >2014-08-11 15:39:31,050 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 6cd2e117-2fb4-4b6c-8211-9ffdb8d47813 >2014-08-11 15:39:37,048 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [2605d302] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:39:37,159 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-25) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:39:37,192 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-25) [22440348] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:39:37,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-25) [22440348] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = ec5e39d7-43c8-4802-ac98-f0536d229051, newImageDescription = , imageId = d039d77c-88d4-4deb-a183-366bd6afdb95, sourceImageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac), log id: 10a94000 >2014-08-11 15:39:37,196 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-25) [22440348] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:39:37,277 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-25) [22440348] FINISH, CreateSnapshotVDSCommand, return: ec5e39d7-43c8-4802-ac98-f0536d229051, log id: 10a94000 >2014-08-11 15:39:37,293 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-25) [22440348] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4 >2014-08-11 15:39:37,293 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-25) [22440348] CommandMultiAsyncTasks::AttachTask: Attaching task 13a951e5-8c37-4aa0-9466-c1f79884ebaa to command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4. >2014-08-11 15:39:37,325 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-25) [22440348] Adding task 13a951e5-8c37-4aa0-9466-c1f79884ebaa (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:39:37,354 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-25) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 13fd7bd9-b78f-4311-a266-b1d2df44b66d, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 47f004b9-7006-4b55-9542-081f4f07e5a0, newImageDescription = ), log id: 6214c78 >2014-08-11 15:39:37,356 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-25) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:39:39,421 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-25) FINISH, CreateImageVDSCommand, return: 47f004b9-7006-4b55-9542-081f4f07e5a0, log id: 6214c78 >2014-08-11 15:39:39,460 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-25) CommandMultiAsyncTasks::AttachTask: Attaching task 68d1fe44-1674-462a-800f-6801a6a8aaf2 to command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4. >2014-08-11 15:39:39,476 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-25) Adding task 68d1fe44-1674-462a-800f-6801a6a8aaf2 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:39:39,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-25) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = cdf31e5b-64b7-4513-895f-e7b85c877065, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 04805ee3-192e-4a6e-bbfc-fa2259bbf00b, newImageDescription = ), log id: 4830206b >2014-08-11 15:39:39,485 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-25) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:39:40,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-25) FINISH, CreateImageVDSCommand, return: 04805ee3-192e-4a6e-bbfc-fa2259bbf00b, log id: 4830206b >2014-08-11 15:39:40,410 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-25) CommandMultiAsyncTasks::AttachTask: Attaching task 84fb46af-765d-490f-bc9e-f254900e9ccd to command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4. >2014-08-11 15:39:40,451 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-25) Adding task 84fb46af-765d-490f-bc9e-f254900e9ccd (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:39:40,517 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-25) Correlation ID: 2605d302, Job ID: 98c42858-79a3-45bd-839a-59174621725a, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap2' creation for VM 'vm2' was initiated by admin. >2014-08-11 15:39:40,518 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) BaseAsyncTask::startPollingTask: Starting to poll task 13a951e5-8c37-4aa0-9466-c1f79884ebaa. >2014-08-11 15:39:40,518 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) BaseAsyncTask::startPollingTask: Starting to poll task 68d1fe44-1674-462a-800f-6801a6a8aaf2. >2014-08-11 15:39:40,519 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) BaseAsyncTask::startPollingTask: Starting to poll task 84fb46af-765d-490f-bc9e-f254900e9ccd. >2014-08-11 15:39:49,126 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-50) Polling and updating Async Tasks: 9 tasks, 3 tasks to poll now >2014-08-11 15:39:49,133 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) SPMAsyncTask::PollTask: Polling task 84fb46af-765d-490f-bc9e-f254900e9ccd (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:39:49,159 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) BaseAsyncTask::onTaskEndSuccess: Task 84fb46af-765d-490f-bc9e-f254900e9ccd (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:39:49,160 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-50) Task with DB Task ID 56c25b3d-7d60-4a95-9df4-c1ccb82c262b and VDSM Task ID 68d1fe44-1674-462a-800f-6801a6a8aaf2 is in state Polling. End action for command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4 will proceed when all the entitys tasks are completed. >2014-08-11 15:39:49,161 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) SPMAsyncTask::PollTask: Polling task 13a951e5-8c37-4aa0-9466-c1f79884ebaa (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:39:49,168 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) BaseAsyncTask::onTaskEndSuccess: Task 13a951e5-8c37-4aa0-9466-c1f79884ebaa (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:39:49,168 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-50) Task with DB Task ID 56c25b3d-7d60-4a95-9df4-c1ccb82c262b and VDSM Task ID 68d1fe44-1674-462a-800f-6801a6a8aaf2 is in state Polling. End action for command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4 will proceed when all the entitys tasks are completed. >2014-08-11 15:39:49,169 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) SPMAsyncTask::PollTask: Polling task 68d1fe44-1674-462a-800f-6801a6a8aaf2 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:39:49,176 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-50) BaseAsyncTask::onTaskEndSuccess: Task 68d1fe44-1674-462a-800f-6801a6a8aaf2 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:39:49,177 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-50) CommandAsyncTask::endActionIfNecessary: All tasks of command b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4 has ended -> executing endAction >2014-08-11 15:39:49,177 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-50) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4): calling endAction . >2014-08-11 15:39:49,178 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:39:49,209 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-12) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:39:49,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60), log id: 554ea596 >2014-08-11 15:39:49,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) Failed in SnapshotVDS method >2014-08-11 15:39:49,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:39:49,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) HostName = vdshost2 >2014-08-11 15:39:49,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:39:49,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, SnapshotVDSCommand, log id: 554ea596 >2014-08-11 15:39:49,258 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-12) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:39:49,262 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-12) Correlation ID: 2605d302, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap2' for VM 'vm2'. VM restart is recommended. >2014-08-11 15:39:49,276 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-12) [22440348] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:39:49,277 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-12) [22440348] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageId = ec5e39d7-43c8-4802-ac98-f0536d229051), log id: 52278e9f >2014-08-11 15:39:49,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-12) [22440348] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@ae6bb21b, log id: 52278e9f >2014-08-11 15:39:49,494 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-12) Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:39:49,509 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-12) Correlation ID: 2605d302, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap2' creation for VM 'vm2'. >2014-08-11 15:39:49,515 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:39:49,515 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:39:49,526 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 68d1fe44-1674-462a-800f-6801a6a8aaf2 >2014-08-11 15:39:49,527 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 68d1fe44-1674-462a-800f-6801a6a8aaf2), log id: 2f733945 >2014-08-11 15:39:49,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=68d1fe44-1674-462a-800f-6801a6a8aaf2), log id: 35b4f959 >2014-08-11 15:39:49,553 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, HSMClearTaskVDSCommand, log id: 35b4f959 >2014-08-11 15:39:49,553 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, SPMClearTaskVDSCommand, log id: 2f733945 >2014-08-11 15:39:49,568 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) BaseAsyncTask::removeTaskFromDB: Removed task 68d1fe44-1674-462a-800f-6801a6a8aaf2 from DataBase >2014-08-11 15:39:49,568 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 84fb46af-765d-490f-bc9e-f254900e9ccd >2014-08-11 15:39:49,569 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 84fb46af-765d-490f-bc9e-f254900e9ccd), log id: 34768a6f >2014-08-11 15:39:49,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=84fb46af-765d-490f-bc9e-f254900e9ccd), log id: 527a9851 >2014-08-11 15:39:49,635 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, HSMClearTaskVDSCommand, log id: 527a9851 >2014-08-11 15:39:49,635 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, SPMClearTaskVDSCommand, log id: 34768a6f >2014-08-11 15:39:49,643 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) BaseAsyncTask::removeTaskFromDB: Removed task 84fb46af-765d-490f-bc9e-f254900e9ccd from DataBase >2014-08-11 15:39:49,643 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 13a951e5-8c37-4aa0-9466-c1f79884ebaa >2014-08-11 15:39:49,644 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 13a951e5-8c37-4aa0-9466-c1f79884ebaa), log id: 11c00536 >2014-08-11 15:39:49,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=13a951e5-8c37-4aa0-9466-c1f79884ebaa), log id: 55962554 >2014-08-11 15:39:49,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, HSMClearTaskVDSCommand, log id: 55962554 >2014-08-11 15:39:49,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, SPMClearTaskVDSCommand, log id: 11c00536 >2014-08-11 15:39:49,718 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) BaseAsyncTask::removeTaskFromDB: Removed task 13a951e5-8c37-4aa0-9466-c1f79884ebaa from DataBase >2014-08-11 15:39:49,718 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity b24760e7-d7ef-47a8-87d1-1d6c64f0c0b4 >2014-08-11 15:39:58,752 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Setting new tasks map. The map contains now 6 tasks >2014-08-11 15:40:12,145 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:40:12,147 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] Entered (VM vm1). >2014-08-11 15:40:12,148 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] Sending shutdown command for VM vm1. >2014-08-11 15:40:12,151 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, force=false, secondsToWait=30, gracefully=true, reason=), log id: 160042fd >2014-08-11 15:40:12,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, force=false, secondsToWait=30, gracefully=true, reason=), log id: fb75827 >2014-08-11 15:40:12,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] FINISH, DestroyVDSCommand, log id: fb75827 >2014-08-11 15:40:12,178 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 160042fd >2014-08-11 15:40:12,195 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-11) [47f70b9e] Correlation ID: 47f70b9e, Job ID: 28dd92e0-d171-45ec-977e-e88bd5c8f587, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm1 (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:40:16,295 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-32) [37e18d8c] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:40:16,296 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-32) [37e18d8c] Entered (VM vm1). >2014-08-11 15:40:16,296 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-32) [37e18d8c] Cannot shutdown VM vm1, status is not up. Stopping instead. >2014-08-11 15:40:16,328 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-32) [3330ac2d] Running command: StopVmCommand internal: true. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:40:16,331 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-32) [3330ac2d] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 5ce72e95 >2014-08-11 15:40:16,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-32) [3330ac2d] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=850415d1-265a-43c9-ae65-6a11abbb32f7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 165b06ca >2014-08-11 15:40:16,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-32) [3330ac2d] FINISH, DestroyVDSCommand, log id: 165b06ca >2014-08-11 15:40:16,753 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-32) [3330ac2d] FINISH, DestroyVmVDSCommand, return: Down, log id: 5ce72e95 >2014-08-11 15:40:16,764 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-30) [2c5c6acd] Running command: ProcessDownVmCommand internal: true. >2014-08-11 15:40:16,780 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-32) [3330ac2d] Correlation ID: 3330ac2d, Job ID: 96750834-46b3-4400-9689-784e741dbb32, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was powered off ungracefully by admin (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:40:44,373 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [7795e5] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:40:44,404 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [7795e5] Running command: TryBackToAllSnapshotsOfVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:40:44,430 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [7795e5] START, SetVmStatusVDSCommand( vmId = 850415d1-265a-43c9-ae65-6a11abbb32f7, status = ImageLocked, exit status = Normal), log id: 1ac613aa >2014-08-11 15:40:44,432 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [7795e5] FINISH, SetVmStatusVDSCommand, log id: 1ac613aa >2014-08-11 15:40:44,446 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [7795e5] Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:40:44,538 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (http--0.0.0.0-8080-4) [36e80dad] Running command: TryBackToSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:40:44,539 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [36e80dad] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 650b7571-719c-4661-a705-f968f20c3ffd, newImageDescription = , imageId = 290bea6b-dcc9-4cb0-a0be-200e6c613722, sourceImageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f), log id: 6cea747f >2014-08-11 15:40:44,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [36e80dad] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:40:44,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [36e80dad] FINISH, CreateSnapshotVDSCommand, return: 650b7571-719c-4661-a705-f968f20c3ffd, log id: 6cea747f >2014-08-11 15:40:44,633 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [36e80dad] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 4d935a2e-f894-47c3-b60b-3a6bad20a3d6 >2014-08-11 15:40:44,633 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [36e80dad] CommandMultiAsyncTasks::AttachTask: Attaching task 70648986-e10b-468e-a68d-5f2a75449086 to command 4d935a2e-f894-47c3-b60b-3a6bad20a3d6. >2014-08-11 15:40:44,654 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [36e80dad] Adding task 70648986-e10b-468e-a68d-5f2a75449086 (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:40:44,863 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [36e80dad] Correlation ID: 7795e5, Job ID: 7d04a5a2-80b6-4392-ad8c-9e5823c71b21, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm1 was initiated by admin. >2014-08-11 15:40:44,863 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [36e80dad] BaseAsyncTask::startPollingTask: Starting to poll task 70648986-e10b-468e-a68d-5f2a75449086. >2014-08-11 15:40:49,179 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-33) Polling and updating Async Tasks: 7 tasks, 1 tasks to poll now >2014-08-11 15:40:49,188 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) SPMAsyncTask::PollTask: Polling task 70648986-e10b-468e-a68d-5f2a75449086 (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:40:49,246 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) BaseAsyncTask::onTaskEndSuccess: Task 70648986-e10b-468e-a68d-5f2a75449086 (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:40:49,247 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) CommandAsyncTask::endActionIfNecessary: All tasks of command 4d935a2e-f894-47c3-b60b-3a6bad20a3d6 has ended -> executing endAction >2014-08-11 15:40:49,248 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 4d935a2e-f894-47c3-b60b-3a6bad20a3d6): calling endAction . >2014-08-11 15:40:49,249 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction TryBackToAllSnapshotsOfVm, executionIndex: 0 >2014-08-11 15:40:49,288 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (org.ovirt.thread.pool-8-thread-47) [7795e5] Ending command successfully: org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand >2014-08-11 15:40:49,304 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (org.ovirt.thread.pool-8-thread-47) [36e80dad] Ending command successfully: org.ovirt.engine.core.bll.TryBackToSnapshotCommand >2014-08-11 15:40:49,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-47) [36e80dad] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageId = 650b7571-719c-4661-a705-f968f20c3ffd), log id: 5236ee34 >2014-08-11 15:40:49,325 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-47) [36e80dad] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@dc7efede, log id: 5236ee34 >2014-08-11 15:40:49,327 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, SetVmStatusVDSCommand( vmId = 850415d1-265a-43c9-ae65-6a11abbb32f7, status = Down, exit status = Normal), log id: 2199cc96 >2014-08-11 15:40:49,330 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, SetVmStatusVDSCommand, log id: 2199cc96 >2014-08-11 15:40:49,571 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-47) Correlation ID: 7795e5, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm1 has been completed. >2014-08-11 15:40:49,572 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm completed, handling the result. >2014-08-11 15:40:49,572 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm succeeded, clearing tasks. >2014-08-11 15:40:49,579 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 70648986-e10b-468e-a68d-5f2a75449086 >2014-08-11 15:40:49,603 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 70648986-e10b-468e-a68d-5f2a75449086), log id: 5989d53c >2014-08-11 15:40:49,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=70648986-e10b-468e-a68d-5f2a75449086), log id: 2b18e5e1 >2014-08-11 15:40:50,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 2b18e5e1 >2014-08-11 15:40:50,144 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 5989d53c >2014-08-11 15:40:50,188 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-47) BaseAsyncTask::removeTaskFromDB: Removed task 70648986-e10b-468e-a68d-5f2a75449086 from DataBase >2014-08-11 15:40:50,188 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 4d935a2e-f894-47c3-b60b-3a6bad20a3d6 >2014-08-11 15:40:58,754 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-57) Setting new tasks map. The map contains now 1 tasks >2014-08-11 15:41:05,230 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] Running command: ShutdownVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:41:05,231 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] Entered (VM vm2). >2014-08-11 15:41:05,232 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] Sending shutdown command for VM vm2. >2014-08-11 15:41:05,233 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, force=false, secondsToWait=30, gracefully=true, reason=), log id: 2b91d080 >2014-08-11 15:41:05,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, force=false, secondsToWait=30, gracefully=true, reason=), log id: 1cd71aa1 >2014-08-11 15:41:05,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] FINISH, DestroyVDSCommand, log id: 1cd71aa1 >2014-08-11 15:41:05,256 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 2b91d080 >2014-08-11 15:41:05,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-24) [24b4a0aa] Correlation ID: 24b4a0aa, Job ID: cfbec8b2-9fb4-4eca-a672-d366253a6746, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm2 (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:41:10,447 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-44) [2feb1821] Running command: ShutdownVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:41:10,448 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-44) [2feb1821] Entered (VM vm2). >2014-08-11 15:41:10,449 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-44) [2feb1821] Cannot shutdown VM vm2, status is not up. Stopping instead. >2014-08-11 15:41:10,480 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-44) [4372a2f8] Running command: StopVmCommand internal: true. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:41:10,484 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4372a2f8] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, force=false, secondsToWait=0, gracefully=false, reason=), log id: 2dbec4a3 >2014-08-11 15:41:10,487 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4372a2f8] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=b379538b-4d39-4246-8b14-d2a667dc1a60, force=false, secondsToWait=0, gracefully=false, reason=), log id: 25a1a9cc >2014-08-11 15:41:11,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4372a2f8] FINISH, DestroyVDSCommand, log id: 25a1a9cc >2014-08-11 15:41:11,240 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4372a2f8] FINISH, DestroyVmVDSCommand, return: Down, log id: 2dbec4a3 >2014-08-11 15:41:11,296 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-48) [1b88ff58] Running command: ProcessDownVmCommand internal: true. >2014-08-11 15:41:11,322 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) [4372a2f8] Correlation ID: 4372a2f8, Job ID: 5197f1ca-8e46-492c-8faa-bbf43030b9aa, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was powered off ungracefully by admin (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:41:47,158 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [8d445d] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:41:47,181 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [8d445d] Running command: RestoreAllSnapshotsCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:41:47,182 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [8d445d] Locking VM(id = 850415d1-265a-43c9-ae65-6a11abbb32f7) with compensation. >2014-08-11 15:41:47,184 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [8d445d] START, SetVmStatusVDSCommand( vmId = 850415d1-265a-43c9-ae65-6a11abbb32f7, status = ImageLocked, exit status = Normal), log id: 3d6bbe47 >2014-08-11 15:41:47,187 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [8d445d] FINISH, SetVmStatusVDSCommand, log id: 3d6bbe47 >2014-08-11 15:41:47,199 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [8d445d] Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:41:47,208 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (http--0.0.0.0-8080-4) [728fb60c] Running command: RestoreFromSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:41:47,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [728fb60c] START, DestroyImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, imageId = 00000000-0000-0000-0000-000000000000, imageList = [51bc44bc-db90-4bdd-a411-16b64de5861e, c1169cf9-65a0-428d-b89e-f6447edbad57], postZero = false, force = true), log id: 957627c >2014-08-11 15:41:47,316 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [728fb60c] FINISH, DestroyImageVDSCommand, log id: 957627c >2014-08-11 15:41:47,346 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [728fb60c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command ba7a0a8d-b492-426b-9f88-45afa53ea81b >2014-08-11 15:41:47,347 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [728fb60c] CommandMultiAsyncTasks::AttachTask: Attaching task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 to command ba7a0a8d-b492-426b-9f88-45afa53ea81b. >2014-08-11 15:41:47,365 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [728fb60c] Adding task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:42:05,352 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) Setting new tasks map. The map contains now 1 tasks >2014-08-11 15:43:51,376 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [728fb60c] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8468182f-1b71-4b10-b210-9e443d17c085, postZeros = false, forceDelete = false), log id: 241f293f >2014-08-11 15:43:51,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [728fb60c] FINISH, DeleteImageGroupVDSCommand, log id: 241f293f >2014-08-11 15:43:51,533 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [728fb60c] CommandMultiAsyncTasks::AttachTask: Attaching task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 to command ba7a0a8d-b492-426b-9f88-45afa53ea81b. >2014-08-11 15:43:51,575 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [728fb60c] Adding task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:43:51,660 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [728fb60c] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = b51b3411-afa8-452f-b328-4dbb4a5e9057, postZeros = false, forceDelete = false), log id: 1f3b12f9 >2014-08-11 15:43:51,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [728fb60c] FINISH, DeleteImageGroupVDSCommand, log id: 1f3b12f9 >2014-08-11 15:43:51,769 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [728fb60c] CommandMultiAsyncTasks::AttachTask: Attaching task 640b50a1-1418-46f6-8e5e-692590f40c1b to command ba7a0a8d-b492-426b-9f88-45afa53ea81b. >2014-08-11 15:43:51,785 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [728fb60c] Adding task 640b50a1-1418-46f6-8e5e-692590f40c1b (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:43:51,869 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [728fb60c] Correlation ID: 8d445d, Job ID: a3484ec7-27d8-4453-84ac-df214b9ee154, Call Stack: null, Custom Event ID: -1, Message: Restoring VM vm1 from snapshot started by user admin. >2014-08-11 15:43:51,870 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [728fb60c] BaseAsyncTask::startPollingTask: Starting to poll task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7. >2014-08-11 15:43:51,870 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [728fb60c] BaseAsyncTask::startPollingTask: Starting to poll task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9. >2014-08-11 15:43:51,871 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [728fb60c] BaseAsyncTask::startPollingTask: Starting to poll task 640b50a1-1418-46f6-8e5e-692590f40c1b. >2014-08-11 15:43:52,957 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-1) Running command: LoginUserCommand internal: false. >2014-08-11 15:43:52,989 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-5) Running command: LoginUserCommand internal: false. >2014-08-11 15:43:53,010 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:43:53,141 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-1) [58f69c3b] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:43:53,150 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-1) [7f84847c] Running command: LogoutUserCommand internal: false. >2014-08-11 15:43:53,172 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-5) [76eca80a] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:43:53,193 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-5) [335f1a72] Running command: LogoutUserCommand internal: false. >2014-08-11 15:43:53,213 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-1) [7f84847c] Correlation ID: 7f84847c, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:43:53,235 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-5) [335f1a72] Correlation ID: 335f1a72, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:43:58,036 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-75) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-08-11 15:43:58,042 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task 640b50a1-1418-46f6-8e5e-692590f40c1b (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:43:58,094 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task 640b50a1-1418-46f6-8e5e-692590f40c1b (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:43:58,095 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-75) Task with DB Task ID 63586fef-5427-4cec-980b-b1580f1586e3 and VDSM Task ID bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 is in state Polling. End action for command ba7a0a8d-b492-426b-9f88-45afa53ea81b will proceed when all the entitys tasks are completed. >2014-08-11 15:43:58,095 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:43:58,102 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:43:58,103 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-75) Task with DB Task ID b02801d1-2d2b-437b-b536-a66c3aa6da1e and VDSM Task ID 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 is in state Polling. End action for command ba7a0a8d-b492-426b-9f88-45afa53ea81b will proceed when all the entitys tasks are completed. >2014-08-11 15:43:58,104 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:43:58,119 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:43:58,120 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-75) CommandAsyncTask::endActionIfNecessary: All tasks of command ba7a0a8d-b492-426b-9f88-45afa53ea81b has ended -> executing endAction >2014-08-11 15:43:58,120 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-75) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: ba7a0a8d-b492-426b-9f88-45afa53ea81b): calling endAction . >2014-08-11 15:43:58,121 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RestoreAllSnapshots, executionIndex: 0 >2014-08-11 15:43:58,144 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (org.ovirt.thread.pool-8-thread-8) [8d445d] Ending command successfully: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand >2014-08-11 15:43:58,177 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (org.ovirt.thread.pool-8-thread-8) [728fb60c] Ending command successfully: org.ovirt.engine.core.bll.RestoreFromSnapshotCommand >2014-08-11 15:43:58,182 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, SetVmStatusVDSCommand( vmId = 850415d1-265a-43c9-ae65-6a11abbb32f7, status = Down, exit status = Normal), log id: 134d2a34 >2014-08-11 15:43:58,184 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, SetVmStatusVDSCommand, log id: 134d2a34 >2014-08-11 15:43:58,244 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-8) Correlation ID: 8d445d, Call Stack: null, Custom Event ID: -1, Message: VM vm1 restoring from Snapshot has been completed. >2014-08-11 15:43:58,245 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots completed, handling the result. >2014-08-11 15:43:58,245 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots succeeded, clearing tasks. >2014-08-11 15:43:58,253 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 >2014-08-11 15:43:58,253 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = bd12d363-b138-4cff-b2b6-fa5bdec9d5b9), log id: fefa337 >2014-08-11 15:43:58,255 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=bd12d363-b138-4cff-b2b6-fa5bdec9d5b9), log id: 3dc4780d >2014-08-11 15:43:58,272 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, HSMClearTaskVDSCommand, log id: 3dc4780d >2014-08-11 15:43:58,272 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, SPMClearTaskVDSCommand, log id: fefa337 >2014-08-11 15:43:58,294 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) BaseAsyncTask::removeTaskFromDB: Removed task bd12d363-b138-4cff-b2b6-fa5bdec9d5b9 from DataBase >2014-08-11 15:43:58,295 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 640b50a1-1418-46f6-8e5e-692590f40c1b >2014-08-11 15:43:58,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 640b50a1-1418-46f6-8e5e-692590f40c1b), log id: 3a6b9f9f >2014-08-11 15:43:58,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=640b50a1-1418-46f6-8e5e-692590f40c1b), log id: 6fbc9daf >2014-08-11 15:43:58,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, HSMClearTaskVDSCommand, log id: 6fbc9daf >2014-08-11 15:43:58,352 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, SPMClearTaskVDSCommand, log id: 3a6b9f9f >2014-08-11 15:43:58,361 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) BaseAsyncTask::removeTaskFromDB: Removed task 640b50a1-1418-46f6-8e5e-692590f40c1b from DataBase >2014-08-11 15:43:58,361 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 >2014-08-11 15:43:58,362 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 2d32de32-59fb-4a4d-81c9-d6c5f885afb7), log id: 53beb1a7 >2014-08-11 15:43:58,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=2d32de32-59fb-4a4d-81c9-d6c5f885afb7), log id: c8175e5 >2014-08-11 15:43:58,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, HSMClearTaskVDSCommand, log id: c8175e5 >2014-08-11 15:43:58,419 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, SPMClearTaskVDSCommand, log id: 53beb1a7 >2014-08-11 15:43:58,428 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) BaseAsyncTask::removeTaskFromDB: Removed task 2d32de32-59fb-4a4d-81c9-d6c5f885afb7 from DataBase >2014-08-11 15:43:58,428 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity ba7a0a8d-b492-426b-9f88-45afa53ea81b >2014-08-11 15:44:20,173 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [618e4b16] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:44:20,197 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [618e4b16] Running command: TryBackToAllSnapshotsOfVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:44:20,214 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [618e4b16] START, SetVmStatusVDSCommand( vmId = b379538b-4d39-4246-8b14-d2a667dc1a60, status = ImageLocked, exit status = Normal), log id: 78939236 >2014-08-11 15:44:20,216 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [618e4b16] FINISH, SetVmStatusVDSCommand, log id: 78939236 >2014-08-11 15:44:20,222 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [618e4b16] Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:44:20,255 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (http--0.0.0.0-8080-4) [4d829ec4] Running command: TryBackToSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:44:20,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [4d829ec4] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = e08ebc7d-b443-4b46-a890-b23233764d49, newImageDescription = , imageId = 3ee4cd82-e04c-4ae4-a96d-52d719996809, sourceImageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac), log id: 387fd55a >2014-08-11 15:44:20,258 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [4d829ec4] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:44:20,362 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [4d829ec4] FINISH, CreateSnapshotVDSCommand, return: e08ebc7d-b443-4b46-a890-b23233764d49, log id: 387fd55a >2014-08-11 15:44:20,390 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [4d829ec4] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command f69ff64c-8d90-4d67-9d48-75b54eb444fd >2014-08-11 15:44:20,391 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [4d829ec4] CommandMultiAsyncTasks::AttachTask: Attaching task e780c31c-ab4e-47d2-ac99-c8fd97b5098e to command f69ff64c-8d90-4d67-9d48-75b54eb444fd. >2014-08-11 15:44:20,450 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [4d829ec4] Adding task e780c31c-ab4e-47d2-ac99-c8fd97b5098e (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:44:20,606 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [4d829ec4] Correlation ID: 618e4b16, Job ID: ab7de3b5-c156-405a-b15f-b289a322486e, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm2 was initiated by admin. >2014-08-11 15:44:20,606 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [4d829ec4] BaseAsyncTask::startPollingTask: Starting to poll task e780c31c-ab4e-47d2-ac99-c8fd97b5098e. >2014-08-11 15:44:28,123 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-71) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-08-11 15:44:28,129 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-71) SPMAsyncTask::PollTask: Polling task e780c31c-ab4e-47d2-ac99-c8fd97b5098e (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:44:28,172 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-71) BaseAsyncTask::onTaskEndSuccess: Task e780c31c-ab4e-47d2-ac99-c8fd97b5098e (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:44:28,173 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-71) CommandAsyncTask::endActionIfNecessary: All tasks of command f69ff64c-8d90-4d67-9d48-75b54eb444fd has ended -> executing endAction >2014-08-11 15:44:28,174 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-71) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: f69ff64c-8d90-4d67-9d48-75b54eb444fd): calling endAction . >2014-08-11 15:44:28,174 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction TryBackToAllSnapshotsOfVm, executionIndex: 0 >2014-08-11 15:44:28,189 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (org.ovirt.thread.pool-8-thread-27) [618e4b16] Ending command successfully: org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand >2014-08-11 15:44:28,206 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (org.ovirt.thread.pool-8-thread-27) [4d829ec4] Ending command successfully: org.ovirt.engine.core.bll.TryBackToSnapshotCommand >2014-08-11 15:44:28,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [4d829ec4] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageId = e08ebc7d-b443-4b46-a890-b23233764d49), log id: 4983007f >2014-08-11 15:44:28,469 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [4d829ec4] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@2285f7e1, log id: 4983007f >2014-08-11 15:44:28,471 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, SetVmStatusVDSCommand( vmId = b379538b-4d39-4246-8b14-d2a667dc1a60, status = Down, exit status = Normal), log id: 39c6811e >2014-08-11 15:44:28,474 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, SetVmStatusVDSCommand, log id: 39c6811e >2014-08-11 15:44:28,614 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-27) Correlation ID: 618e4b16, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm2 has been completed. >2014-08-11 15:44:28,615 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm completed, handling the result. >2014-08-11 15:44:28,615 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm succeeded, clearing tasks. >2014-08-11 15:44:28,622 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-27) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e780c31c-ab4e-47d2-ac99-c8fd97b5098e >2014-08-11 15:44:28,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = e780c31c-ab4e-47d2-ac99-c8fd97b5098e), log id: 44eb257e >2014-08-11 15:44:28,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=e780c31c-ab4e-47d2-ac99-c8fd97b5098e), log id: 29ea968b >2014-08-11 15:44:28,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, HSMClearTaskVDSCommand, log id: 29ea968b >2014-08-11 15:44:28,644 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, SPMClearTaskVDSCommand, log id: 44eb257e >2014-08-11 15:44:28,656 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-27) BaseAsyncTask::removeTaskFromDB: Removed task e780c31c-ab4e-47d2-ac99-c8fd97b5098e from DataBase >2014-08-11 15:44:28,656 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity f69ff64c-8d90-4d67-9d48-75b54eb444fd >2014-08-11 15:44:48,117 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [3833a308] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:44:48,141 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [3833a308] Running command: RestoreAllSnapshotsCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:44:48,142 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [3833a308] Locking VM(id = b379538b-4d39-4246-8b14-d2a667dc1a60) with compensation. >2014-08-11 15:44:48,143 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [3833a308] START, SetVmStatusVDSCommand( vmId = b379538b-4d39-4246-8b14-d2a667dc1a60, status = ImageLocked, exit status = Normal), log id: 3a143839 >2014-08-11 15:44:48,145 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [3833a308] FINISH, SetVmStatusVDSCommand, log id: 3a143839 >2014-08-11 15:44:48,158 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [3833a308] Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:44:48,166 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (http--0.0.0.0-8080-4) [51f700eb] Running command: RestoreFromSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:44:48,193 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [51f700eb] START, DestroyImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, imageId = 00000000-0000-0000-0000-000000000000, imageList = [ec5e39d7-43c8-4802-ac98-f0536d229051, d039d77c-88d4-4deb-a183-366bd6afdb95], postZero = true, force = true), log id: 2348074a >2014-08-11 15:44:48,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [51f700eb] FINISH, DestroyImageVDSCommand, log id: 2348074a >2014-08-11 15:44:48,459 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [51f700eb] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 77dc1af4-c69b-4969-b6d7-48e1a43c8207 >2014-08-11 15:44:48,459 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [51f700eb] CommandMultiAsyncTasks::AttachTask: Attaching task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 to command 77dc1af4-c69b-4969-b6d7-48e1a43c8207. >2014-08-11 15:44:48,483 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [51f700eb] Adding task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:44:52,571 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:45:06,511 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:45:45,156 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-65) Setting new tasks map. The map contains now 1 tasks >2014-08-11 15:45:49,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [51f700eb] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = cdf31e5b-64b7-4513-895f-e7b85c877065, postZeros = false, forceDelete = false), log id: 3376423 >2014-08-11 15:45:49,331 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [51f700eb] FINISH, DeleteImageGroupVDSCommand, log id: 3376423 >2014-08-11 15:45:49,345 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [51f700eb] CommandMultiAsyncTasks::AttachTask: Attaching task cdee146c-22aa-4aae-9502-e7c0f9a334a1 to command 77dc1af4-c69b-4969-b6d7-48e1a43c8207. >2014-08-11 15:45:49,360 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [51f700eb] Adding task cdee146c-22aa-4aae-9502-e7c0f9a334a1 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:45:49,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [51f700eb] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 13fd7bd9-b78f-4311-a266-b1d2df44b66d, postZeros = false, forceDelete = false), log id: 32c3ab05 >2014-08-11 15:45:49,479 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [51f700eb] FINISH, DeleteImageGroupVDSCommand, log id: 32c3ab05 >2014-08-11 15:45:49,486 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [51f700eb] CommandMultiAsyncTasks::AttachTask: Attaching task 01035929-33a9-4f30-b0e1-5316f5a6f5d9 to command 77dc1af4-c69b-4969-b6d7-48e1a43c8207. >2014-08-11 15:45:49,502 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [51f700eb] Adding task 01035929-33a9-4f30-b0e1-5316f5a6f5d9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:45:49,561 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [51f700eb] Correlation ID: 3833a308, Job ID: 96f4581d-68a5-40d6-a632-cba3615d2cc1, Call Stack: null, Custom Event ID: -1, Message: Restoring VM vm2 from snapshot started by user admin. >2014-08-11 15:45:49,561 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [51f700eb] BaseAsyncTask::startPollingTask: Starting to poll task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4. >2014-08-11 15:45:49,561 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [51f700eb] BaseAsyncTask::startPollingTask: Starting to poll task cdee146c-22aa-4aae-9502-e7c0f9a334a1. >2014-08-11 15:45:49,562 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [51f700eb] BaseAsyncTask::startPollingTask: Starting to poll task 01035929-33a9-4f30-b0e1-5316f5a6f5d9. >2014-08-11 15:45:55,157 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-85) Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-08-11 15:45:55,198 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) SPMAsyncTask::PollTask: Polling task 01035929-33a9-4f30-b0e1-5316f5a6f5d9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:45:55,244 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) BaseAsyncTask::onTaskEndSuccess: Task 01035929-33a9-4f30-b0e1-5316f5a6f5d9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:45:55,245 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-85) Task with DB Task ID 09dd1abd-4609-42b9-a454-7c7756af5914 and VDSM Task ID 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 is in state Polling. End action for command 77dc1af4-c69b-4969-b6d7-48e1a43c8207 will proceed when all the entitys tasks are completed. >2014-08-11 15:45:55,246 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) SPMAsyncTask::PollTask: Polling task cdee146c-22aa-4aae-9502-e7c0f9a334a1 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:45:55,261 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) BaseAsyncTask::onTaskEndSuccess: Task cdee146c-22aa-4aae-9502-e7c0f9a334a1 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:45:55,262 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-85) Task with DB Task ID 09dd1abd-4609-42b9-a454-7c7756af5914 and VDSM Task ID 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 is in state Polling. End action for command 77dc1af4-c69b-4969-b6d7-48e1a43c8207 will proceed when all the entitys tasks are completed. >2014-08-11 15:45:55,263 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) SPMAsyncTask::PollTask: Polling task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:45:55,269 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-85) BaseAsyncTask::onTaskEndSuccess: Task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:45:55,270 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-85) CommandAsyncTask::endActionIfNecessary: All tasks of command 77dc1af4-c69b-4969-b6d7-48e1a43c8207 has ended -> executing endAction >2014-08-11 15:45:55,270 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-85) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 77dc1af4-c69b-4969-b6d7-48e1a43c8207): calling endAction . >2014-08-11 15:45:55,270 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RestoreAllSnapshots, executionIndex: 0 >2014-08-11 15:45:55,344 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (org.ovirt.thread.pool-8-thread-2) [3833a308] Ending command successfully: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand >2014-08-11 15:45:55,386 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (org.ovirt.thread.pool-8-thread-2) [51f700eb] Ending command successfully: org.ovirt.engine.core.bll.RestoreFromSnapshotCommand >2014-08-11 15:45:55,390 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SetVmStatusVDSCommand( vmId = b379538b-4d39-4246-8b14-d2a667dc1a60, status = Down, exit status = Normal), log id: 41f7d28d >2014-08-11 15:45:55,393 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SetVmStatusVDSCommand, log id: 41f7d28d >2014-08-11 15:45:55,427 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-2) Correlation ID: 3833a308, Call Stack: null, Custom Event ID: -1, Message: VM vm2 restoring from Snapshot has been completed. >2014-08-11 15:45:55,428 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots completed, handling the result. >2014-08-11 15:45:55,428 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots succeeded, clearing tasks. >2014-08-11 15:45:55,436 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 >2014-08-11 15:45:55,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4), log id: 287c146a >2014-08-11 15:45:55,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=24a2fa21-c9d6-4beb-9fc0-6fefecc808e4), log id: 6a204fe9 >2014-08-11 15:45:55,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 6a204fe9 >2014-08-11 15:45:55,458 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 287c146a >2014-08-11 15:45:55,469 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task 24a2fa21-c9d6-4beb-9fc0-6fefecc808e4 from DataBase >2014-08-11 15:45:55,470 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 01035929-33a9-4f30-b0e1-5316f5a6f5d9 >2014-08-11 15:45:55,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 01035929-33a9-4f30-b0e1-5316f5a6f5d9), log id: 291f0274 >2014-08-11 15:45:55,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=01035929-33a9-4f30-b0e1-5316f5a6f5d9), log id: 32da22c3 >2014-08-11 15:45:55,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 32da22c3 >2014-08-11 15:45:55,526 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 291f0274 >2014-08-11 15:45:55,536 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task 01035929-33a9-4f30-b0e1-5316f5a6f5d9 from DataBase >2014-08-11 15:45:55,537 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task cdee146c-22aa-4aae-9502-e7c0f9a334a1 >2014-08-11 15:45:55,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = cdee146c-22aa-4aae-9502-e7c0f9a334a1), log id: 66a2ddb5 >2014-08-11 15:45:55,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=cdee146c-22aa-4aae-9502-e7c0f9a334a1), log id: 4e89cab7 >2014-08-11 15:45:55,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 4e89cab7 >2014-08-11 15:45:55,598 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 66a2ddb5 >2014-08-11 15:45:55,635 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task cdee146c-22aa-4aae-9502-e7c0f9a334a1 from DataBase >2014-08-11 15:45:55,636 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 77dc1af4-c69b-4969-b6d7-48e1a43c8207 >2014-08-11 15:46:05,464 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:46:05,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:46:05,571 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [b70b611] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:46:05,573 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [20f5d40c] Running command: LogoutUserCommand internal: false. >2014-08-11 15:46:05,594 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [20f5d40c] Correlation ID: 20f5d40c, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:46:10,172 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:46:10,213 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [2fc1ac26] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:46:10,226 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [7be37afd] Running command: LogoutUserCommand internal: false. >2014-08-11 15:46:10,236 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [7be37afd] Correlation ID: 7be37afd, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:46:24,496 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:46:24,503 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:46:24,644 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [5608da29] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:46:24,645 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [3d53f72d] Running command: LogoutUserCommand internal: false. >2014-08-11 15:46:24,653 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [3d53f72d] Correlation ID: 3d53f72d, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:46:54,108 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:46:54,108 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-37) [7c6775bb] Start running CanDoAction for command number 2/2 (Command type: RemoveVm) >2014-08-11 15:46:54,109 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-24) [13aefa92] Start running CanDoAction for command number 1/2 (Command type: RemoveVm) >2014-08-11 15:46:54,111 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-24) [13aefa92] Lock Acquired to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:46:54,111 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-37) [7c6775bb] Lock Acquired to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:46:54,123 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-24) [13aefa92] Finish handling CanDoAction for command number 1/2 (Command type: RemoveVm) >2014-08-11 15:46:54,136 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-37) [7c6775bb] Finish handling CanDoAction for command number 2/2 (Command type: RemoveVm) >2014-08-11 15:46:54,179 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-28) [13aefa92] Running command: RemoveVmCommand internal: false. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VMAction group DELETE_VM with role type USER >2014-08-11 15:46:54,180 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-28) [13aefa92] START, SetVmStatusVDSCommand( vmId = 850415d1-265a-43c9-ae65-6a11abbb32f7, status = ImageLocked, exit status = Normal), log id: 74de8127 >2014-08-11 15:46:54,183 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-28) [13aefa92] FINISH, SetVmStatusVDSCommand, log id: 74de8127 >2014-08-11 15:46:54,196 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-28) [13aefa92] Lock freed to object EngineLock [exclusiveLocks= key: 850415d1-265a-43c9-ae65-6a11abbb32f7 value: VM >, sharedLocks= ] >2014-08-11 15:46:54,199 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-28) [53a30fac] Running command: RemoveMemoryVolumesCommand internal: true. >2014-08-11 15:46:54,214 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-28) [e8919ec] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 850415d1-265a-43c9-ae65-6a11abbb32f7 Type: VM >2014-08-11 15:46:54,219 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:46:54,239 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 8a8a508b-98f0-4c83-94fb-ed45d72abb5f, postZeros = false, forceDelete = false), log id: 1f41877b >2014-08-11 15:46:54,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] FINISH, DeleteImageGroupVDSCommand, log id: 1f41877b >2014-08-11 15:46:54,348 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 14055b38-c02c-46e8-aaa4-df4dfff9114e >2014-08-11 15:46:54,349 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] CommandMultiAsyncTasks::AttachTask: Attaching task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded to command 14055b38-c02c-46e8-aaa4-df4dfff9114e. >2014-08-11 15:46:54,363 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] Adding task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:46:54,454 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] Correlation ID: 13aefa92, Job ID: 61cf02e6-08c4-4f7e-8d4a-b2b314ebd9a3, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was successfully removed. >2014-08-11 15:46:54,455 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-28) [5a59d5ea] BaseAsyncTask::startPollingTask: Starting to poll task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded. >2014-08-11 15:46:54,480 ERROR [org.ovirt.engine.core.bll.GetVmConfigurationBySnapshotQuery] (http--0.0.0.0-8080-4) Snapshot 667473cb-1ab5-4284-9459-4038c4b63c3c does not exist >2014-08-11 15:46:54,496 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-28) [7c6775bb] Running command: RemoveVmCommand internal: false. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VMAction group DELETE_VM with role type USER >2014-08-11 15:46:54,497 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-28) [7c6775bb] START, SetVmStatusVDSCommand( vmId = b379538b-4d39-4246-8b14-d2a667dc1a60, status = ImageLocked, exit status = Normal), log id: 267233de >2014-08-11 15:46:54,499 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-28) [7c6775bb] FINISH, SetVmStatusVDSCommand, log id: 267233de >2014-08-11 15:46:54,504 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-28) [7c6775bb] Lock freed to object EngineLock [exclusiveLocks= key: b379538b-4d39-4246-8b14-d2a667dc1a60 value: VM >, sharedLocks= ] >2014-08-11 15:46:54,506 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-28) [5bf605d9] Running command: RemoveMemoryVolumesCommand internal: true. >2014-08-11 15:46:54,523 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-28) [40ef63aa] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: b379538b-4d39-4246-8b14-d2a667dc1a60 Type: VM >2014-08-11 15:46:54,526 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:46:54,547 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 77d8ae85-eed7-439e-bc2a-9abd280a63ac, postZeros = true, forceDelete = false), log id: 4365460 >2014-08-11 15:46:54,751 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] FINISH, DeleteImageGroupVDSCommand, log id: 4365460 >2014-08-11 15:46:54,789 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command d21bdb11-a448-4f33-b604-51423409f1db >2014-08-11 15:46:54,789 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] CommandMultiAsyncTasks::AttachTask: Attaching task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 to command d21bdb11-a448-4f33-b604-51423409f1db. >2014-08-11 15:46:54,813 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] Adding task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:46:54,871 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] Correlation ID: 7c6775bb, Job ID: 819577bb-2340-4843-9167-fd0c4a5284f9, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was successfully removed. >2014-08-11 15:46:54,872 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-28) [592a2e8a] BaseAsyncTask::startPollingTask: Starting to poll task 3c80c469-e7ae-45cd-a7e0-91e752fbb280. >2014-08-11 15:46:55,271 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-68) Polling and updating Async Tasks: 5 tasks, 2 tasks to poll now >2014-08-11 15:46:55,277 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) SPMAsyncTask::PollTask: Polling task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-11 15:46:55,278 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) SPMAsyncTask::PollTask: Polling task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:46:55,359 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) BaseAsyncTask::onTaskEndSuccess: Task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:46:55,360 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-68) CommandAsyncTask::endActionIfNecessary: All tasks of command 14055b38-c02c-46e8-aaa4-df4dfff9114e has ended -> executing endAction >2014-08-11 15:46:55,360 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-68) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 14055b38-c02c-46e8-aaa4-df4dfff9114e): calling endAction . >2014-08-11 15:46:55,361 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-68) Finished polling Tasks, will poll again in 10 seconds. >2014-08-11 15:46:55,361 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-08-11 15:46:55,393 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-39) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-08-11 15:46:55,394 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-08-11 15:46:55,394 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-08-11 15:46:55,414 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-39) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded >2014-08-11 15:46:55,414 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded), log id: 35a06e0e >2014-08-11 15:46:55,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=8ec43bd6-2f11-42ba-8b82-b4e8c6164ded), log id: 379974a3 >2014-08-11 15:46:55,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) FINISH, HSMClearTaskVDSCommand, log id: 379974a3 >2014-08-11 15:46:55,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) FINISH, SPMClearTaskVDSCommand, log id: 35a06e0e >2014-08-11 15:46:55,596 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-39) BaseAsyncTask::removeTaskFromDB: Removed task 8ec43bd6-2f11-42ba-8b82-b4e8c6164ded from DataBase >2014-08-11 15:46:55,596 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 14055b38-c02c-46e8-aaa4-df4dfff9114e >2014-08-11 15:47:15,156 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-23) Setting new tasks map. The map contains now 2 tasks >2014-08-11 15:47:15,250 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [66b2ce4d] Lock Acquired to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:47:15,281 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [66b2ce4d] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: e9d52ee1-5e46-4a89-803d-2f8259b8f981 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-08-11 15:47:15,365 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [66b2ce4d] Correlation ID: 66b2ce4d, Job ID: ef081c41-d109-4760-a212-b53727952780, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was created by admin. >2014-08-11 15:47:15,374 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [66b2ce4d] Lock freed to object EngineLock [exclusiveLocks= key: vm1 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:47:15,378 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-33) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-08-11 15:47:15,384 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) SPMAsyncTask::PollTask: Polling task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:47:15,398 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) BaseAsyncTask::onTaskEndSuccess: Task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:47:15,399 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) CommandAsyncTask::endActionIfNecessary: All tasks of command d21bdb11-a448-4f33-b604-51423409f1db has ended -> executing endAction >2014-08-11 15:47:15,400 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: d21bdb11-a448-4f33-b604-51423409f1db): calling endAction . >2014-08-11 15:47:15,401 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-08-11 15:47:15,415 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-38) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-08-11 15:47:15,416 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-08-11 15:47:15,416 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-08-11 15:47:15,423 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-38) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 >2014-08-11 15:47:15,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 3c80c469-e7ae-45cd-a7e0-91e752fbb280), log id: 3e4f9b09 >2014-08-11 15:47:15,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=3c80c469-e7ae-45cd-a7e0-91e752fbb280), log id: 5c4b8bd4 >2014-08-11 15:47:15,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) FINISH, HSMClearTaskVDSCommand, log id: 5c4b8bd4 >2014-08-11 15:47:15,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-38) FINISH, SPMClearTaskVDSCommand, log id: 3e4f9b09 >2014-08-11 15:47:15,448 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-38) BaseAsyncTask::removeTaskFromDB: Removed task 3c80c469-e7ae-45cd-a7e0-91e752fbb280 from DataBase >2014-08-11 15:47:15,448 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-38) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity d21bdb11-a448-4f33-b604-51423409f1db >2014-08-11 15:47:16,023 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (http--0.0.0.0-8080-4) [7cc85e90] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER >2014-08-11 15:47:25,686 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [68fee221] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM_DISK_BOOT >, sharedLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >] >2014-08-11 15:47:25,707 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [68fee221] Running command: AddDiskCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: StorageAction group CREATE_DISK with role type USER >2014-08-11 15:47:25,765 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [61b5b315] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 15:47:25,782 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [61b5b315] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM_DISK_BOOT >, sharedLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >] >2014-08-11 15:47:25,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [61b5b315] START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 5d8cbd7d-dd13-465d-ac9f-5a97e4d80607, newImageDescription = ), log id: 76615c8c >2014-08-11 15:47:25,784 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [61b5b315] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:47:25,919 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [61b5b315] FINISH, CreateImageVDSCommand, return: 5d8cbd7d-dd13-465d-ac9f-5a97e4d80607, log id: 76615c8c >2014-08-11 15:47:25,933 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [61b5b315] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command d4f326f4-5135-46cd-9ddf-982169bb6c5b >2014-08-11 15:47:25,934 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [61b5b315] CommandMultiAsyncTasks::AttachTask: Attaching task a6e6365d-1ccd-4d74-be68-a0f556228421 to command d4f326f4-5135-46cd-9ddf-982169bb6c5b. >2014-08-11 15:47:25,949 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [61b5b315] Adding task a6e6365d-1ccd-4d74-be68-a0f556228421 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:47:26,034 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [61b5b315] Correlation ID: 68fee221, Job ID: 98936d07-ae3f-48d0-b872-df46eaeed91e, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm1_Disk1 was initiated on VM vm1 by admin. >2014-08-11 15:47:26,035 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [61b5b315] BaseAsyncTask::startPollingTask: Starting to poll task a6e6365d-1ccd-4d74-be68-a0f556228421. >2014-08-11 15:47:33,448 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [7cc2de79] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:47:33,475 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [7cc2de79] START, IsVmDuringInitiatingVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00), log id: 70d8d789 >2014-08-11 15:47:33,476 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [7cc2de79] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 70d8d789 >2014-08-11 15:47:33,477 WARN [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [7cc2de79] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_DISKS_LOCKED,$diskAliases vm1_Disk1 >2014-08-11 15:47:33,478 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [7cc2de79] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:47:35,403 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-82) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-08-11 15:47:35,409 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-82) SPMAsyncTask::PollTask: Polling task a6e6365d-1ccd-4d74-be68-a0f556228421 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:47:35,425 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-82) BaseAsyncTask::onTaskEndSuccess: Task a6e6365d-1ccd-4d74-be68-a0f556228421 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:47:35,426 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-82) CommandAsyncTask::endActionIfNecessary: All tasks of command d4f326f4-5135-46cd-9ddf-982169bb6c5b has ended -> executing endAction >2014-08-11 15:47:35,427 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-82) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: d4f326f4-5135-46cd-9ddf-982169bb6c5b): calling endAction . >2014-08-11 15:47:35,428 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-11 15:47:35,441 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-26) [68fee221] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-11 15:47:35,458 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-26) [61b5b315] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-11 15:47:35,464 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [61b5b315] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageId = 5d8cbd7d-dd13-465d-ac9f-5a97e4d80607), log id: 281c0c4e >2014-08-11 15:47:35,483 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-26) [61b5b315] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@bddb366f, log id: 281c0c4e >2014-08-11 15:47:35,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-26) Correlation ID: 68fee221, Call Stack: null, Custom Event ID: -1, Message: The disk vm1_Disk1 was successfully added to VM vm1. >2014-08-11 15:47:35,509 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-11 15:47:35,509 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-11 15:47:35,516 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a6e6365d-1ccd-4d74-be68-a0f556228421 >2014-08-11 15:47:35,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-26) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = a6e6365d-1ccd-4d74-be68-a0f556228421), log id: 64508af4 >2014-08-11 15:47:35,518 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-26) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=a6e6365d-1ccd-4d74-be68-a0f556228421), log id: 63d2cc9f >2014-08-11 15:47:35,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-26) FINISH, HSMClearTaskVDSCommand, log id: 63d2cc9f >2014-08-11 15:47:35,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-26) FINISH, SPMClearTaskVDSCommand, log id: 64508af4 >2014-08-11 15:47:35,550 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-26) BaseAsyncTask::removeTaskFromDB: Removed task a6e6365d-1ccd-4d74-be68-a0f556228421 from DataBase >2014-08-11 15:47:35,550 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-26) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity d4f326f4-5135-46cd-9ddf-982169bb6c5b >2014-08-11 15:47:35,868 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-2) [2cd9ae9b] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:47:35,918 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-2) [2cd9ae9b] START, IsVmDuringInitiatingVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00), log id: 687bffa8 >2014-08-11 15:47:35,919 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-2) [2cd9ae9b] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 687bffa8 >2014-08-11 15:47:36,025 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] Running command: RunVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:47:36,047 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] START, UpdateVmDynamicDataVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@6093c761), log id: 1c2b8742 >2014-08-11 15:47:36,058 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] FINISH, UpdateVmDynamicDataVDSCommand, log id: 1c2b8742 >2014-08-11 15:47:36,060 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] START, CreateVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, vm=VM [vm1]), log id: 1b5dff2a >2014-08-11 15:47:36,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] START, CreateVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, vm=VM [vm1]), log id: 49bedc35 >2014-08-11 15:47:36,075 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=interleave},maxVCpus=16,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=05bb8e61-651d-4f86-b1f8-e07fdc2d259c}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=b2637b19-8525-4f0b-87ba-1f45b157e081}, {shared=false, volumeID=5d8cbd7d-dd13-465d-ac9f-5a97e4d80607, index=0, iface=virtio, imageID=eac57127-4993-4bf9-aaf9-23a568198364, domainID=9aac3d1c-aca8-47f8-95a9-4d9996313f87, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=45dd52dc-0e1c-4321-8a19-f4a0b735410f, format=raw, type=disk, readonly=false, deviceId=eac57127-4993-4bf9-aaf9-23a568198364}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=07548955-d2cd-44b2-987c-76edd44b8adb}],vmName=vm1,cpuType=Haswell,fileTransferEnable=true >2014-08-11 15:47:36,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] FINISH, CreateVDSCommand, log id: 49bedc35 >2014-08-11 15:47:36,117 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 1b5dff2a >2014-08-11 15:47:36,117 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:47:36,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-29) [2cd9ae9b] Correlation ID: 2cd9ae9b, Job ID: 6d3bebf0-1946-4d5a-9b0e-48517f0f0c2c, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin (Host: vdshost2). >2014-08-11 15:47:38,821 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from WaitForLaunch --> PoweringUp >2014-08-11 15:47:38,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8], vmIds=[af1e4f01-60d5-4457-a842-ff15af8d9f00]), log id: 70e28e0c >2014-08-11 15:47:38,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=10.35.0.191, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=1024, display=qxl, pid=12680, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=interleave}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@29dbefba, vmName=vm1, fileTransferEnable=true, cpuType=Haswell}], log id: 70e28e0c >2014-08-11 15:47:38,834 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Received a memballoon Device without an address when processing VM af1e4f01-60d5-4457-a842-ff15af8d9f00 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-08-11 15:47:38,835 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Received a spice Device without an address when processing VM af1e4f01-60d5-4457-a842-ff15af8d9f00 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.191}, device=spice, tlsPort=5901, type=graphics} >2014-08-11 15:47:47,096 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [69d64466] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:47:47,125 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [69d64466] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: e9d52ee1-5e46-4a89-803d-2f8259b8f981 Type: VdsGroupsAction group CREATE_VM with role type USER >2014-08-11 15:47:47,184 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [69d64466] Correlation ID: 69d64466, Job ID: ed5b0da9-d17f-4c69-a6a5-528e6f70ba6b, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was created by admin. >2014-08-11 15:47:47,192 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (http--0.0.0.0-8080-4) [69d64466] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2014-08-11 15:47:47,624 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (http--0.0.0.0-8080-4) [7d505eba] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER >2014-08-11 15:47:55,296 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [3799ed3] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM_DISK_BOOT >, sharedLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >] >2014-08-11 15:47:55,317 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (http--0.0.0.0-8080-4) [3799ed3] Running command: AddDiskCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group CONFIGURE_VM_STORAGE with role type USER, ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: StorageAction group CREATE_DISK with role type USER >2014-08-11 15:47:55,392 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [16c4b281] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 15:47:55,409 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (http--0.0.0.0-8080-4) [16c4b281] Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM_DISK_BOOT >, sharedLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >] >2014-08-11 15:47:55,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [16c4b281] START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 81c8637d-ba93-4db2-854f-ddb4e824246a, newImageDescription = ), log id: 2b172c9b >2014-08-11 15:47:55,412 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [16c4b281] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:47:55,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (http--0.0.0.0-8080-4) [16c4b281] FINISH, CreateImageVDSCommand, return: 81c8637d-ba93-4db2-854f-ddb4e824246a, log id: 2b172c9b >2014-08-11 15:47:55,509 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [16c4b281] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 9aa375c5-7ca2-409e-96b6-44d5a6e6eded >2014-08-11 15:47:55,510 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [16c4b281] CommandMultiAsyncTasks::AttachTask: Attaching task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6 to command 9aa375c5-7ca2-409e-96b6-44d5a6e6eded. >2014-08-11 15:47:55,527 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [16c4b281] Adding task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:47:55,578 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [16c4b281] Correlation ID: 3799ed3, Job ID: c3089dbc-8e88-437c-9c26-78444ebf84c0, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of vm2_Disk1 was initiated on VM vm2 by admin. >2014-08-11 15:47:55,578 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [16c4b281] BaseAsyncTask::startPollingTask: Starting to poll task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6. >2014-08-11 15:48:04,951 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [2d34afd1] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:48:04,977 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [2d34afd1] START, IsVmDuringInitiatingVDSCommand( vmId = 6ed6e66e-1a80-4538-845a-a54d6b573e65), log id: 59203caf >2014-08-11 15:48:04,977 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [2d34afd1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 59203caf >2014-08-11 15:48:04,979 WARN [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [2d34afd1] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_DISKS_LOCKED,$diskAliases vm2_Disk1 >2014-08-11 15:48:04,979 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [2d34afd1] Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:48:05,427 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-08-11 15:48:05,456 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) SPMAsyncTask::PollTask: Polling task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:48:05,494 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-73) BaseAsyncTask::onTaskEndSuccess: Task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:48:05,495 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::endActionIfNecessary: All tasks of command 9aa375c5-7ca2-409e-96b6-44d5a6e6eded has ended -> executing endAction >2014-08-11 15:48:05,496 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-73) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 9aa375c5-7ca2-409e-96b6-44d5a6e6eded): calling endAction . >2014-08-11 15:48:05,496 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-15) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-11 15:48:05,519 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-15) [3799ed3] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-11 15:48:05,536 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-15) [16c4b281] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-11 15:48:05,543 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [16c4b281] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageId = 81c8637d-ba93-4db2-854f-ddb4e824246a), log id: 59aa595 >2014-08-11 15:48:05,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [16c4b281] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@3cc322e8, log id: 59aa595 >2014-08-11 15:48:05,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-15) Correlation ID: 3799ed3, Call Stack: null, Custom Event ID: -1, Message: The disk vm2_Disk1 was successfully added to VM vm2. >2014-08-11 15:48:05,687 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-15) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-11 15:48:05,688 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-15) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-11 15:48:05,694 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-15) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6 >2014-08-11 15:48:05,695 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-15) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6), log id: 7470f210 >2014-08-11 15:48:05,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-15) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=85d08a0d-2278-4a2c-9eef-0ca9dda68fb6), log id: 23243429 >2014-08-11 15:48:05,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-15) FINISH, HSMClearTaskVDSCommand, log id: 23243429 >2014-08-11 15:48:05,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-15) FINISH, SPMClearTaskVDSCommand, log id: 7470f210 >2014-08-11 15:48:05,728 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-15) BaseAsyncTask::removeTaskFromDB: Removed task 85d08a0d-2278-4a2c-9eef-0ca9dda68fb6 from DataBase >2014-08-11 15:48:05,728 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-15) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 9aa375c5-7ca2-409e-96b6-44d5a6e6eded >2014-08-11 15:48:07,485 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [76908de1] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:48:07,512 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [76908de1] START, IsVmDuringInitiatingVDSCommand( vmId = 6ed6e66e-1a80-4538-845a-a54d6b573e65), log id: e0a6d64 >2014-08-11 15:48:07,513 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [76908de1] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: e0a6d64 >2014-08-11 15:48:07,611 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] Running command: RunVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:48:07,684 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] START, UpdateVmDynamicDataVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@fc3c5ec5), log id: 5becae8b >2014-08-11 15:48:07,703 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] FINISH, UpdateVmDynamicDataVDSCommand, log id: 5becae8b >2014-08-11 15:48:07,705 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] START, CreateVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, vm=VM [vm2]), log id: 4273b5d6 >2014-08-11 15:48:07,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] START, CreateVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, vm=VM [vm2]), log id: d9c2e8 >2014-08-11 15:48:07,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=interleave},maxVCpus=16,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=7d6c270f-657a-471e-9413-82dc09037592}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=32ac02c7-f3e5-480a-b932-c38e1608c25f}, {shared=false, volumeID=81c8637d-ba93-4db2-854f-ddb4e824246a, index=0, iface=virtio, imageID=6c20367c-d018-4df9-9735-f616b7b5dc89, domainID=a499025c-18cf-410b-9163-29fc62d44ba4, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=45dd52dc-0e1c-4321-8a19-f4a0b735410f, format=raw, type=disk, readonly=false, deviceId=6c20367c-d018-4df9-9735-f616b7b5dc89}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=cf170606-e90b-46f2-9efc-f41907354422}],vmName=vm2,cpuType=Haswell,fileTransferEnable=true >2014-08-11 15:48:07,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] FINISH, CreateVDSCommand, log id: d9c2e8 >2014-08-11 15:48:07,761 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 4273b5d6 >2014-08-11 15:48:07,762 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-19) [76908de1] Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:48:07,769 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-19) [76908de1] Correlation ID: 76908de1, Job ID: 2506473d-b03d-463e-9074-d5dad3b399ab, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was started by admin (Host: vdshost2). >2014-08-11 15:48:12,822 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM vm2 6ed6e66e-1a80-4538-845a-a54d6b573e65 moved from WaitForLaunch --> PoweringUp >2014-08-11 15:48:12,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8], vmIds=[6ed6e66e-1a80-4538-845a-a54d6b573e65]), log id: 5eedbd0f >2014-08-11 15:48:12,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=10.35.0.191, pauseCode=NOERR, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5902, emulatedMachine=rhel6.5.0, vmType=kvm, status=Up, memGuaranteedSize=1024, display=qxl, pid=13725, smartcardEnable=false, bootMenuEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, numaTune={mode=interleave}, smpCoresPerSocket=1, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@54a35941, vmName=vm2, fileTransferEnable=true, cpuType=Haswell}], log id: 5eedbd0f >2014-08-11 15:48:12,834 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Received a memballoon Device without an address when processing VM 6ed6e66e-1a80-4538-845a-a54d6b573e65 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-08-11 15:48:12,835 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) Received a spice Device without an address when processing VM 6ed6e66e-1a80-4538-845a-a54d6b573e65 devices, skipping device: {port=5902, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.191}, device=spice, tlsPort=5903, type=graphics} >2014-08-11 15:48:15,157 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) Setting new tasks map. The map contains now 3 tasks >2014-08-11 15:48:37,438 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from PoweringUp --> Up >2014-08-11 15:48:37,496 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-44) Correlation ID: 2cd9ae9b, Job ID: 6d3bebf0-1946-4d5a-9b0e-48517f0f0c2c, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host vdshost2 >2014-08-11 15:48:41,773 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [11fd3b5c] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:48:41,880 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-12) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:48:41,928 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:48:41,934 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 6c8c87cd-205f-4b39-94f2-a9183ad63edb, newImageDescription = , imageId = 5d8cbd7d-dd13-465d-ac9f-5a97e4d80607, sourceImageGroupId = eac57127-4993-4bf9-aaf9-23a568198364), log id: 9ebd538 >2014-08-11 15:48:41,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:48:42,019 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] FINISH, CreateSnapshotVDSCommand, return: 6c8c87cd-205f-4b39-94f2-a9183ad63edb, log id: 9ebd538 >2014-08-11 15:48:42,039 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 90ffe151-89f7-4dd8-a343-8209da0ed492 >2014-08-11 15:48:42,040 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] CommandMultiAsyncTasks::AttachTask: Attaching task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5 to command 90ffe151-89f7-4dd8-a343-8209da0ed492. >2014-08-11 15:48:42,055 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) [4e727c5e] Adding task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:48:42,092 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = bb0e3510-e6a2-4622-af95-cd2d07889f0b, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 8c9c2cb8-e766-4c0c-8c54-21cb36e192c6, newImageDescription = ), log id: 6fdb06b8 >2014-08-11 15:48:42,094 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-12) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:48:42,254 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, CreateImageVDSCommand, return: 8c9c2cb8-e766-4c0c-8c54-21cb36e192c6, log id: 6fdb06b8 >2014-08-11 15:48:42,289 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-12) CommandMultiAsyncTasks::AttachTask: Attaching task b7a994c8-c777-49da-a41a-4000d7fb2203 to command 90ffe151-89f7-4dd8-a343-8209da0ed492. >2014-08-11 15:48:42,305 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) Adding task b7a994c8-c777-49da-a41a-4000d7fb2203 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:48:42,314 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 3abe0634-d996-49ab-8070-ee8c9f9e27b1, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 6b2c2026-64ec-49a6-bb7b-8bc0900f2b58, newImageDescription = ), log id: f608eef >2014-08-11 15:48:42,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-12) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:48:42,572 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, CreateImageVDSCommand, return: 6b2c2026-64ec-49a6-bb7b-8bc0900f2b58, log id: f608eef >2014-08-11 15:48:42,607 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-12) CommandMultiAsyncTasks::AttachTask: Attaching task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0 to command 90ffe151-89f7-4dd8-a343-8209da0ed492. >2014-08-11 15:48:42,622 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) Adding task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:48:42,655 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-12) Correlation ID: 11fd3b5c, Job ID: 1d39978c-68b7-4bae-b30f-05391fdced92, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'vm1' was initiated by admin. >2014-08-11 15:48:42,656 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) BaseAsyncTask::startPollingTask: Starting to poll task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5. >2014-08-11 15:48:42,657 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) BaseAsyncTask::startPollingTask: Starting to poll task b7a994c8-c777-49da-a41a-4000d7fb2203. >2014-08-11 15:48:42,657 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) BaseAsyncTask::startPollingTask: Starting to poll task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0. >2014-08-11 15:48:45,156 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-84) Setting new tasks map. The map contains now 4 tasks >2014-08-11 15:48:45,498 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-92) Polling and updating Async Tasks: 4 tasks, 3 tasks to poll now >2014-08-11 15:48:45,504 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:48:45,572 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:48:45,575 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-92) Task with DB Task ID 46bc7b01-67db-4c8c-9e07-2653bed14a73 and VDSM Task ID b7a994c8-c777-49da-a41a-4000d7fb2203 is in state Polling. End action for command 90ffe151-89f7-4dd8-a343-8209da0ed492 will proceed when all the entitys tasks are completed. >2014-08-11 15:48:45,575 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:48:45,589 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:48:45,589 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-92) Task with DB Task ID 46bc7b01-67db-4c8c-9e07-2653bed14a73 and VDSM Task ID b7a994c8-c777-49da-a41a-4000d7fb2203 is in state Polling. End action for command 90ffe151-89f7-4dd8-a343-8209da0ed492 will proceed when all the entitys tasks are completed. >2014-08-11 15:48:45,590 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) SPMAsyncTask::PollTask: Polling task b7a994c8-c777-49da-a41a-4000d7fb2203 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:48:45,597 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-92) BaseAsyncTask::onTaskEndSuccess: Task b7a994c8-c777-49da-a41a-4000d7fb2203 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:48:45,598 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endActionIfNecessary: All tasks of command 90ffe151-89f7-4dd8-a343-8209da0ed492 has ended -> executing endAction >2014-08-11 15:48:45,598 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-92) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 90ffe151-89f7-4dd8-a343-8209da0ed492): calling endAction . >2014-08-11 15:48:45,599 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:48:45,622 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-36) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:48:45,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00), log id: 6d087522 >2014-08-11 15:48:46,669 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from Up --> Paused >2014-08-11 15:48:47,053 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-36) Failed in SnapshotVDS method >2014-08-11 15:48:47,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-36) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:48:47,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-36) HostName = vdshost2 >2014-08-11 15:48:47,054 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-36) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:48:47,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, SnapshotVDSCommand, log id: 6d087522 >2014-08-11 15:48:47,055 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-36) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:48:47,062 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-36) Correlation ID: 11fd3b5c, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap1' for VM 'vm1'. VM restart is recommended. >2014-08-11 15:48:47,122 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-36) [4e727c5e] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:48:47,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [4e727c5e] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageId = 6c8c87cd-205f-4b39-94f2-a9183ad63edb), log id: 1f60a1e3 >2014-08-11 15:48:47,144 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [4e727c5e] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@20e73cf8, log id: 1f60a1e3 >2014-08-11 15:48:47,167 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-36) Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:48:47,181 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-36) Correlation ID: 11fd3b5c, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap1' creation for VM 'vm1'. >2014-08-11 15:48:47,185 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:48:47,186 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:48:47,197 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) SPMAsyncTask::ClearAsyncTask: Attempting to clear task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5 >2014-08-11 15:48:47,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = fc68a4cc-18ee-4d66-8acd-6cb27e0021b5), log id: 2688c53d >2014-08-11 15:48:47,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=fc68a4cc-18ee-4d66-8acd-6cb27e0021b5), log id: 5d4d3b8e >2014-08-11 15:48:47,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, HSMClearTaskVDSCommand, log id: 5d4d3b8e >2014-08-11 15:48:47,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, SPMClearTaskVDSCommand, log id: 2688c53d >2014-08-11 15:48:47,222 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) BaseAsyncTask::removeTaskFromDB: Removed task fc68a4cc-18ee-4d66-8acd-6cb27e0021b5 from DataBase >2014-08-11 15:48:47,223 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b7a994c8-c777-49da-a41a-4000d7fb2203 >2014-08-11 15:48:47,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = b7a994c8-c777-49da-a41a-4000d7fb2203), log id: 308a5a9c >2014-08-11 15:48:47,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=b7a994c8-c777-49da-a41a-4000d7fb2203), log id: 4b42d0a9 >2014-08-11 15:48:47,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, HSMClearTaskVDSCommand, log id: 4b42d0a9 >2014-08-11 15:48:47,283 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, SPMClearTaskVDSCommand, log id: 308a5a9c >2014-08-11 15:48:47,297 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) BaseAsyncTask::removeTaskFromDB: Removed task b7a994c8-c777-49da-a41a-4000d7fb2203 from DataBase >2014-08-11 15:48:47,298 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0 >2014-08-11 15:48:47,298 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 0b97ece9-56de-46bd-b9fe-672ce7fee2b0), log id: 61250cab >2014-08-11 15:48:47,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=0b97ece9-56de-46bd-b9fe-672ce7fee2b0), log id: 4762e060 >2014-08-11 15:48:47,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, HSMClearTaskVDSCommand, log id: 4762e060 >2014-08-11 15:48:47,359 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, SPMClearTaskVDSCommand, log id: 61250cab >2014-08-11 15:48:47,372 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) BaseAsyncTask::removeTaskFromDB: Removed task 0b97ece9-56de-46bd-b9fe-672ce7fee2b0 from DataBase >2014-08-11 15:48:47,373 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 90ffe151-89f7-4dd8-a343-8209da0ed492 >2014-08-11 15:48:49,724 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-2) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from Paused --> Up >2014-08-11 15:48:59,383 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [4136bb26] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:48:59,498 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-22) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:48:59,531 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:48:59,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 5dcdc1ac-e1d4-40fe-9b5d-c3d5964b870a, newImageDescription = , imageId = 6c8c87cd-205f-4b39-94f2-a9183ad63edb, sourceImageGroupId = eac57127-4993-4bf9-aaf9-23a568198364), log id: e477519 >2014-08-11 15:48:59,537 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:48:59,615 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] FINISH, CreateSnapshotVDSCommand, return: 5dcdc1ac-e1d4-40fe-9b5d-c3d5964b870a, log id: e477519 >2014-08-11 15:48:59,658 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2 >2014-08-11 15:48:59,659 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] CommandMultiAsyncTasks::AttachTask: Attaching task a00b6d89-9dc5-4271-94ff-fc02394f766d to command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2. >2014-08-11 15:48:59,681 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) [69be7ea7] Adding task a00b6d89-9dc5-4271-94ff-fc02394f766d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:48:59,737 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = f53fe62c-1af9-452a-b08f-6e4e0786a5ea, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 7eca3138-3244-42a3-a182-849a56a587c5, newImageDescription = ), log id: 63084c35 >2014-08-11 15:48:59,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:48:59,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, CreateImageVDSCommand, return: 7eca3138-3244-42a3-a182-849a56a587c5, log id: 63084c35 >2014-08-11 15:48:59,925 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) CommandMultiAsyncTasks::AttachTask: Attaching task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 to command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2. >2014-08-11 15:48:59,940 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) Adding task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:48:59,948 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 785a74b2-6ba4-43fd-bfec-57bdc3ff8c6a, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 3173581f-0292-4b61-a95f-f885f64ea4e7, newImageDescription = ), log id: 4c04a652 >2014-08-11 15:48:59,951 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:00,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, CreateImageVDSCommand, return: 3173581f-0292-4b61-a95f-f885f64ea4e7, log id: 4c04a652 >2014-08-11 15:49:00,291 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) CommandMultiAsyncTasks::AttachTask: Attaching task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 to command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2. >2014-08-11 15:49:00,306 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) Adding task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:00,340 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-22) Correlation ID: 4136bb26, Job ID: 2df6c252-3c1a-4c30-9721-44ac7f66705f, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap2' creation for VM 'vm1' was initiated by admin. >2014-08-11 15:49:00,340 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task a00b6d89-9dc5-4271-94ff-fc02394f766d. >2014-08-11 15:49:00,341 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5. >2014-08-11 15:49:00,341 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72. >2014-08-11 15:49:05,599 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-62) Polling and updating Async Tasks: 7 tasks, 3 tasks to poll now >2014-08-11 15:49:05,604 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task a00b6d89-9dc5-4271-94ff-fc02394f766d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:05,648 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::onTaskEndSuccess: Task a00b6d89-9dc5-4271-94ff-fc02394f766d (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:05,649 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) Task with DB Task ID 70a44b01-9c9c-4df8-a98b-0b6889aa3333 and VDSM Task ID 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 is in state Polling. End action for command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:05,650 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:05,657 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::onTaskEndSuccess: Task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:05,657 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-62) Task with DB Task ID fa6be62b-c638-46d1-a382-6e18be1470ae and VDSM Task ID b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 is in state Polling. End action for command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:05,658 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) SPMAsyncTask::PollTask: Polling task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:05,665 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-62) BaseAsyncTask::onTaskEndSuccess: Task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:05,665 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-62) CommandAsyncTask::endActionIfNecessary: All tasks of command 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2 has ended -> executing endAction >2014-08-11 15:49:05,666 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-62) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2): calling endAction . >2014-08-11 15:49:05,666 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:49:05,698 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-34) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:49:05,705 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00), log id: 271bf103 >2014-08-11 15:49:05,710 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) Failed in SnapshotVDS method >2014-08-11 15:49:05,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:49:05,711 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) HostName = vdshost2 >2014-08-11 15:49:05,712 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:49:05,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SnapshotVDSCommand, log id: 271bf103 >2014-08-11 15:49:05,713 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-34) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:49:05,718 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-34) Correlation ID: 4136bb26, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap2' for VM 'vm1'. VM restart is recommended. >2014-08-11 15:49:05,757 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-34) [69be7ea7] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:49:05,759 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-34) [69be7ea7] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageId = 5dcdc1ac-e1d4-40fe-9b5d-c3d5964b870a), log id: 6bd64f16 >2014-08-11 15:49:05,778 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-34) [69be7ea7] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@a92bf029, log id: 6bd64f16 >2014-08-11 15:49:05,800 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-34) Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:49:05,815 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-34) Correlation ID: 4136bb26, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap2' creation for VM 'vm1'. >2014-08-11 15:49:05,823 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:49:05,824 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:49:05,832 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 >2014-08-11 15:49:05,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72), log id: 6845f3db >2014-08-11 15:49:05,834 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72), log id: 488ce458 >2014-08-11 15:49:05,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 488ce458 >2014-08-11 15:49:05,856 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 6845f3db >2014-08-11 15:49:05,865 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) BaseAsyncTask::removeTaskFromDB: Removed task 6f55ade6-2916-4bfc-9dc7-63fc6dc9ba72 from DataBase >2014-08-11 15:49:05,866 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 >2014-08-11 15:49:05,866 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5), log id: 355c7e1a >2014-08-11 15:49:05,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5), log id: 4b5af854 >2014-08-11 15:49:05,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 4b5af854 >2014-08-11 15:49:05,929 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 355c7e1a >2014-08-11 15:49:05,940 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) BaseAsyncTask::removeTaskFromDB: Removed task b64dfebf-c7f6-45db-b8ee-5eac94cdfaf5 from DataBase >2014-08-11 15:49:05,941 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a00b6d89-9dc5-4271-94ff-fc02394f766d >2014-08-11 15:49:05,941 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = a00b6d89-9dc5-4271-94ff-fc02394f766d), log id: 49937268 >2014-08-11 15:49:05,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=a00b6d89-9dc5-4271-94ff-fc02394f766d), log id: 6f3c2f94 >2014-08-11 15:49:06,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 6f3c2f94 >2014-08-11 15:49:06,007 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 49937268 >2014-08-11 15:49:06,015 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) BaseAsyncTask::removeTaskFromDB: Removed task a00b6d89-9dc5-4271-94ff-fc02394f766d from DataBase >2014-08-11 15:49:06,016 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 8cf680ad-c0cc-45a1-b7bd-bb4f6d3b5fe2 >2014-08-11 15:49:08,361 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) VM vm2 6ed6e66e-1a80-4538-845a-a54d6b573e65 moved from PoweringUp --> Up >2014-08-11 15:49:08,440 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) Correlation ID: 76908de1, Job ID: 2506473d-b03d-463e-9074-d5dad3b399ab, Call Stack: null, Custom Event ID: -1, Message: VM vm2 started on Host vdshost2 >2014-08-11 15:49:08,449 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:49:12,909 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [7ba9939a] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:49:13,040 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-49) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:49:13,090 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-49) [4d52f240] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:49:13,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-49) [4d52f240] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = ea872373-48a4-467f-ae37-b20d5b4b0060, newImageDescription = , imageId = 81c8637d-ba93-4db2-854f-ddb4e824246a, sourceImageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89), log id: 47020f57 >2014-08-11 15:49:13,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-49) [4d52f240] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:13,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-49) [4d52f240] FINISH, CreateSnapshotVDSCommand, return: ea872373-48a4-467f-ae37-b20d5b4b0060, log id: 47020f57 >2014-08-11 15:49:13,200 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-49) [4d52f240] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 >2014-08-11 15:49:13,200 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-49) [4d52f240] CommandMultiAsyncTasks::AttachTask: Attaching task e06f31a6-2ced-4642-b1c8-42882af1a406 to command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8. >2014-08-11 15:49:13,215 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-49) [4d52f240] Adding task e06f31a6-2ced-4642-b1c8-42882af1a406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:13,268 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-49) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 77962ded-16be-4b3c-815d-fffbfb24c557, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = ff42dd3a-8343-427f-91c6-92fae08d911a, newImageDescription = ), log id: 23c47704 >2014-08-11 15:49:13,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-49) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:14,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-49) FINISH, CreateImageVDSCommand, return: ff42dd3a-8343-427f-91c6-92fae08d911a, log id: 23c47704 >2014-08-11 15:49:14,309 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-49) CommandMultiAsyncTasks::AttachTask: Attaching task 5c468090-bae4-4086-9dcf-511007cceb23 to command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8. >2014-08-11 15:49:14,349 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-49) Adding task 5c468090-bae4-4086-9dcf-511007cceb23 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:14,357 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-49) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = ed65fb5b-9312-467e-834a-de49d534cdba, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 2276df01-f23b-48b5-b11d-556e647d4baf, newImageDescription = ), log id: 15166bce >2014-08-11 15:49:14,359 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-49) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:14,724 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-49) FINISH, CreateImageVDSCommand, return: 2276df01-f23b-48b5-b11d-556e647d4baf, log id: 15166bce >2014-08-11 15:49:14,818 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-49) CommandMultiAsyncTasks::AttachTask: Attaching task bcf67c24-81dd-4535-b7f2-496c6323aa96 to command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8. >2014-08-11 15:49:14,866 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-49) Adding task bcf67c24-81dd-4535-b7f2-496c6323aa96 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:14,907 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-49) Correlation ID: 7ba9939a, Job ID: e559f696-35ac-41fd-a36b-d3e2a3031401, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap1' creation for VM 'vm2' was initiated by admin. >2014-08-11 15:49:14,908 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-49) BaseAsyncTask::startPollingTask: Starting to poll task e06f31a6-2ced-4642-b1c8-42882af1a406. >2014-08-11 15:49:14,909 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-49) BaseAsyncTask::startPollingTask: Starting to poll task 5c468090-bae4-4086-9dcf-511007cceb23. >2014-08-11 15:49:14,909 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-49) BaseAsyncTask::startPollingTask: Starting to poll task bcf67c24-81dd-4535-b7f2-496c6323aa96. >2014-08-11 15:49:15,158 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Setting new tasks map. The map contains now 9 tasks >2014-08-11 15:49:15,667 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-75) Polling and updating Async Tasks: 9 tasks, 3 tasks to poll now >2014-08-11 15:49:15,673 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task 5c468090-bae4-4086-9dcf-511007cceb23 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:15,682 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task 5c468090-bae4-4086-9dcf-511007cceb23 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:15,684 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-75) Task with DB Task ID f90016cc-b4d1-4782-b4ed-9a787ab4f827 and VDSM Task ID bcf67c24-81dd-4535-b7f2-496c6323aa96 is in state Polling. End action for command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:15,685 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task bcf67c24-81dd-4535-b7f2-496c6323aa96 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:15,699 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task bcf67c24-81dd-4535-b7f2-496c6323aa96 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:15,700 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-75) Task with DB Task ID 9afd0af6-8255-46d2-8b6e-d8d4a2d9a71d and VDSM Task ID e06f31a6-2ced-4642-b1c8-42882af1a406 is in state Polling. End action for command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:15,701 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task e06f31a6-2ced-4642-b1c8-42882af1a406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-11 15:49:15,702 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-75) Finished polling Tasks, will poll again in 10 seconds. >2014-08-11 15:49:22,408 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] Running command: ShutdownVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:49:22,410 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] Entered (VM vm1). >2014-08-11 15:49:22,410 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] Sending shutdown command for VM vm1. >2014-08-11 15:49:22,412 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=30, gracefully=true, reason=), log id: 608f79ed >2014-08-11 15:49:22,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=30, gracefully=true, reason=), log id: 6a247eb6 >2014-08-11 15:49:22,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] FINISH, DestroyVDSCommand, log id: 6a247eb6 >2014-08-11 15:49:22,458 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-24) [63372fa9] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 608f79ed >2014-08-11 15:49:22,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-24) [63372fa9] Correlation ID: 63372fa9, Job ID: 032ccc43-4273-4439-8589-8ffa5cd9d066, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm1 (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:49:25,789 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) BaseAsyncTask::onTaskEndSuccess: Task 5c468090-bae4-4086-9dcf-511007cceb23 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:25,790 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-14) Task with DB Task ID 9afd0af6-8255-46d2-8b6e-d8d4a2d9a71d and VDSM Task ID e06f31a6-2ced-4642-b1c8-42882af1a406 is in state Polling. End action for command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:25,808 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) BaseAsyncTask::onTaskEndSuccess: Task bcf67c24-81dd-4535-b7f2-496c6323aa96 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:25,808 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-14) Task with DB Task ID 9afd0af6-8255-46d2-8b6e-d8d4a2d9a71d and VDSM Task ID e06f31a6-2ced-4642-b1c8-42882af1a406 is in state Polling. End action for command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:25,809 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) SPMAsyncTask::PollTask: Polling task e06f31a6-2ced-4642-b1c8-42882af1a406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:25,816 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) BaseAsyncTask::onTaskEndSuccess: Task e06f31a6-2ced-4642-b1c8-42882af1a406 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:25,817 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-14) CommandAsyncTask::endActionIfNecessary: All tasks of command 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 has ended -> executing endAction >2014-08-11 15:49:25,817 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-14) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8): calling endAction . >2014-08-11 15:49:25,818 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:49:25,850 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-34) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:49:25,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65), log id: 2c38053e >2014-08-11 15:49:27,491 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-5) [4880be4c] Running command: ShutdownVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:49:27,494 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-5) [4880be4c] Entered (VM vm1). >2014-08-11 15:49:27,494 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-5) [4880be4c] Cannot shutdown VM vm1, status is not up. Stopping instead. >2014-08-11 15:49:27,525 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-5) [7cd55144] Running command: StopVmCommand internal: true. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:49:27,529 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7cd55144] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=0, gracefully=false, reason=), log id: cb88a1d >2014-08-11 15:49:27,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7cd55144] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=0, gracefully=false, reason=), log id: ff21cf9 >2014-08-11 15:49:27,959 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) Failed in SnapshotVDS method >2014-08-11 15:49:27,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:49:27,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) HostName = vdshost2 >2014-08-11 15:49:27,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:49:27,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SnapshotVDSCommand, log id: 2c38053e >2014-08-11 15:49:27,961 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-34) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:49:27,965 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-34) Correlation ID: 7ba9939a, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap1' for VM 'vm2'. VM restart is recommended. >2014-08-11 15:49:27,983 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-34) [4d52f240] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:49:27,988 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-34) [4d52f240] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageId = ea872373-48a4-467f-ae37-b20d5b4b0060), log id: 5ba2912f >2014-08-11 15:49:28,041 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-34) [4d52f240] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@13580969, log id: 5ba2912f >2014-08-11 15:49:28,061 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-34) Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:49:28,075 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-34) Correlation ID: 7ba9939a, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap1' creation for VM 'vm2'. >2014-08-11 15:49:28,079 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:49:28,080 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:49:28,091 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task bcf67c24-81dd-4535-b7f2-496c6323aa96 >2014-08-11 15:49:28,092 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = bcf67c24-81dd-4535-b7f2-496c6323aa96), log id: 49b830c4 >2014-08-11 15:49:28,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=bcf67c24-81dd-4535-b7f2-496c6323aa96), log id: 5b89b9ab >2014-08-11 15:49:28,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 5b89b9ab >2014-08-11 15:49:28,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 49b830c4 >2014-08-11 15:49:28,125 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) BaseAsyncTask::removeTaskFromDB: Removed task bcf67c24-81dd-4535-b7f2-496c6323aa96 from DataBase >2014-08-11 15:49:28,125 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 5c468090-bae4-4086-9dcf-511007cceb23 >2014-08-11 15:49:28,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 5c468090-bae4-4086-9dcf-511007cceb23), log id: 24b95937 >2014-08-11 15:49:28,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=5c468090-bae4-4086-9dcf-511007cceb23), log id: 4903cb7 >2014-08-11 15:49:28,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 4903cb7 >2014-08-11 15:49:28,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 24b95937 >2014-08-11 15:49:28,201 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) BaseAsyncTask::removeTaskFromDB: Removed task 5c468090-bae4-4086-9dcf-511007cceb23 from DataBase >2014-08-11 15:49:28,201 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e06f31a6-2ced-4642-b1c8-42882af1a406 >2014-08-11 15:49:28,201 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = e06f31a6-2ced-4642-b1c8-42882af1a406), log id: 1ad51072 >2014-08-11 15:49:28,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=e06f31a6-2ced-4642-b1c8-42882af1a406), log id: 1a2aba21 >2014-08-11 15:49:28,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, HSMClearTaskVDSCommand, log id: 1a2aba21 >2014-08-11 15:49:28,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, SPMClearTaskVDSCommand, log id: 1ad51072 >2014-08-11 15:49:28,275 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-34) BaseAsyncTask::removeTaskFromDB: Removed task e06f31a6-2ced-4642-b1c8-42882af1a406 from DataBase >2014-08-11 15:49:28,275 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-34) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 16f2c6a8-2bf8-4e01-a1e7-d14344bf2ee8 >2014-08-11 15:49:28,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7cd55144] FINISH, DestroyVDSCommand, log id: ff21cf9 >2014-08-11 15:49:28,333 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7cd55144] FINISH, DestroyVmVDSCommand, return: Down, log id: cb88a1d >2014-08-11 15:49:28,350 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [7cd55144] Correlation ID: 7cd55144, Job ID: 75fd39bd-5d8c-45b8-ada7-9dbeb0c4b451, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was powered off ungracefully by admin (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:49:28,351 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-15) [57be729b] Running command: ProcessDownVmCommand internal: true. >2014-08-11 15:49:34,724 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [23c8b57] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:49:34,892 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-22) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:49:34,959 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:49:34,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 90ac62ee-531e-4170-9269-825827b2c6e3, newImageDescription = , imageId = ea872373-48a4-467f-ae37-b20d5b4b0060, sourceImageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89), log id: 42ec5087 >2014-08-11 15:49:34,963 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:35,051 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] FINISH, CreateSnapshotVDSCommand, return: 90ac62ee-531e-4170-9269-825827b2c6e3, log id: 42ec5087 >2014-08-11 15:49:35,060 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command c683783f-d97f-4719-a638-384a7408b209 >2014-08-11 15:49:35,060 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] CommandMultiAsyncTasks::AttachTask: Attaching task a7e2930c-b410-48cc-be61-78f5fc13d59a to command c683783f-d97f-4719-a638-384a7408b209. >2014-08-11 15:49:35,084 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) [6e7418d8] Adding task a7e2930c-b410-48cc-be61-78f5fc13d59a (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:35,113 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = bafe96bb-22d3-4235-b23d-357a4abcd37d, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = 51560c38-453a-4415-bd57-7bdad0f08d01, newImageDescription = ), log id: 2a7fcf6b >2014-08-11 15:49:35,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:35,551 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, CreateImageVDSCommand, return: 51560c38-453a-4415-bd57-7bdad0f08d01, log id: 2a7fcf6b >2014-08-11 15:49:35,635 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) CommandMultiAsyncTasks::AttachTask: Attaching task 2b9801e8-3909-42ce-836f-49a1236713d0 to command c683783f-d97f-4719-a638-384a7408b209. >2014-08-11 15:49:35,651 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) Adding task 2b9801e8-3909-42ce-836f-49a1236713d0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:35,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 68d8f365-868e-4088-b968-b102704a3d70, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = a8e36808-c1d7-4438-9c5b-f48febdc23c6, newImageDescription = ), log id: 668e0f3b >2014-08-11 15:49:35,660 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:49:35,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, CreateImageVDSCommand, return: a8e36808-c1d7-4438-9c5b-f48febdc23c6, log id: 668e0f3b >2014-08-11 15:49:36,077 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-22) CommandMultiAsyncTasks::AttachTask: Attaching task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff to command c683783f-d97f-4719-a638-384a7408b209. >2014-08-11 15:49:36,093 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-22) Adding task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:49:36,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-22) Correlation ID: 23c8b57, Job ID: c25d0cac-3930-4ea8-b80b-713747f6d876, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snap2' creation for VM 'vm2' was initiated by admin. >2014-08-11 15:49:36,127 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task a7e2930c-b410-48cc-be61-78f5fc13d59a. >2014-08-11 15:49:36,127 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task 2b9801e8-3909-42ce-836f-49a1236713d0. >2014-08-11 15:49:36,128 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-22) BaseAsyncTask::startPollingTask: Starting to poll task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff. >2014-08-11 15:49:45,818 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-56) Polling and updating Async Tasks: 12 tasks, 3 tasks to poll now >2014-08-11 15:49:45,823 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) SPMAsyncTask::PollTask: Polling task 2b9801e8-3909-42ce-836f-49a1236713d0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:45,843 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) BaseAsyncTask::onTaskEndSuccess: Task 2b9801e8-3909-42ce-836f-49a1236713d0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:45,844 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-56) Task with DB Task ID 8ffdae0a-5976-4062-968a-b15a49ed9d47 and VDSM Task ID e2df6a23-ec0c-48c6-88dc-2a8b97f60aff is in state Polling. End action for command c683783f-d97f-4719-a638-384a7408b209 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:45,844 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) SPMAsyncTask::PollTask: Polling task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:45,851 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) BaseAsyncTask::onTaskEndSuccess: Task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:45,852 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-56) Task with DB Task ID 66baa908-5d67-444d-910e-13b9e3cda0a3 and VDSM Task ID a7e2930c-b410-48cc-be61-78f5fc13d59a is in state Polling. End action for command c683783f-d97f-4719-a638-384a7408b209 will proceed when all the entitys tasks are completed. >2014-08-11 15:49:45,852 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) SPMAsyncTask::PollTask: Polling task a7e2930c-b410-48cc-be61-78f5fc13d59a (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:49:45,859 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-56) BaseAsyncTask::onTaskEndSuccess: Task a7e2930c-b410-48cc-be61-78f5fc13d59a (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:49:45,860 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-56) CommandAsyncTask::endActionIfNecessary: All tasks of command c683783f-d97f-4719-a638-384a7408b209 has ended -> executing endAction >2014-08-11 15:49:45,860 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-56) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: c683783f-d97f-4719-a638-384a7408b209): calling endAction . >2014-08-11 15:49:45,861 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 15:49:45,910 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-2) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 15:49:45,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65), log id: 15a351f3 >2014-08-11 15:49:45,919 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-2) Failed in SnapshotVDS method >2014-08-11 15:49:45,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-2) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 15:49:45,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-2) HostName = vdshost2 >2014-08-11 15:49:45,921 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-2) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 15:49:45,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SnapshotVDSCommand, log id: 15a351f3 >2014-08-11 15:49:45,921 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-2) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 15:49:45,925 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-2) Correlation ID: 23c8b57, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snap2' for VM 'vm2'. VM restart is recommended. >2014-08-11 15:49:45,960 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-2) [6e7418d8] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 15:49:45,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-2) [6e7418d8] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageId = 90ac62ee-531e-4170-9269-825827b2c6e3), log id: 3d7adae >2014-08-11 15:49:46,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-2) [6e7418d8] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@8e3e4875, log id: 3d7adae >2014-08-11 15:49:46,186 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-2) Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:49:46,201 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-2) Correlation ID: 23c8b57, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snap2' creation for VM 'vm2'. >2014-08-11 15:49:46,206 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 15:49:46,207 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 15:49:46,218 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2b9801e8-3909-42ce-836f-49a1236713d0 >2014-08-11 15:49:46,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 2b9801e8-3909-42ce-836f-49a1236713d0), log id: 489019f >2014-08-11 15:49:46,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=2b9801e8-3909-42ce-836f-49a1236713d0), log id: 314f76fe >2014-08-11 15:49:46,247 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 314f76fe >2014-08-11 15:49:46,247 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 489019f >2014-08-11 15:49:46,260 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task 2b9801e8-3909-42ce-836f-49a1236713d0 from DataBase >2014-08-11 15:49:46,260 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff >2014-08-11 15:49:46,260 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = e2df6a23-ec0c-48c6-88dc-2a8b97f60aff), log id: 70060fc7 >2014-08-11 15:49:46,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=e2df6a23-ec0c-48c6-88dc-2a8b97f60aff), log id: 1df60b46 >2014-08-11 15:49:46,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 1df60b46 >2014-08-11 15:49:46,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 70060fc7 >2014-08-11 15:49:46,335 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task e2df6a23-ec0c-48c6-88dc-2a8b97f60aff from DataBase >2014-08-11 15:49:46,335 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a7e2930c-b410-48cc-be61-78f5fc13d59a >2014-08-11 15:49:46,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = a7e2930c-b410-48cc-be61-78f5fc13d59a), log id: 3a079ec9 >2014-08-11 15:49:46,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=a7e2930c-b410-48cc-be61-78f5fc13d59a), log id: 4a49bbe2 >2014-08-11 15:49:46,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, HSMClearTaskVDSCommand, log id: 4a49bbe2 >2014-08-11 15:49:46,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, SPMClearTaskVDSCommand, log id: 3a079ec9 >2014-08-11 15:49:46,410 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-2) BaseAsyncTask::removeTaskFromDB: Removed task a7e2930c-b410-48cc-be61-78f5fc13d59a from DataBase >2014-08-11 15:49:46,410 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-2) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity c683783f-d97f-4719-a638-384a7408b209 >2014-08-11 15:49:49,760 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:49:49,762 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] Entered (VM vm2). >2014-08-11 15:49:49,762 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] Sending shutdown command for VM vm2. >2014-08-11 15:49:49,764 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, force=false, secondsToWait=30, gracefully=true, reason=), log id: 55945a9d >2014-08-11 15:49:49,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, force=false, secondsToWait=30, gracefully=true, reason=), log id: 389265b3 >2014-08-11 15:49:49,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] FINISH, DestroyVDSCommand, log id: 389265b3 >2014-08-11 15:49:49,818 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 55945a9d >2014-08-11 15:49:49,826 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) [3408e9dd] Correlation ID: 3408e9dd, Job ID: 9f049e5f-b14f-4dad-b966-3a2bf599bf97, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm2 (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:49:54,085 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-23) [210d6dcc] Running command: ShutdownVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:49:54,087 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-23) [210d6dcc] Entered (VM vm2). >2014-08-11 15:49:54,088 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-23) [210d6dcc] Cannot shutdown VM vm2, status is not up. Stopping instead. >2014-08-11 15:49:54,118 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-23) [42aaac5c] Running command: StopVmCommand internal: true. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 15:49:54,121 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-23) [42aaac5c] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, force=false, secondsToWait=0, gracefully=false, reason=), log id: 6a4cb98d >2014-08-11 15:49:54,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-23) [42aaac5c] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=6ed6e66e-1a80-4538-845a-a54d6b573e65, force=false, secondsToWait=0, gracefully=false, reason=), log id: 78a98dca >2014-08-11 15:49:54,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-23) [42aaac5c] FINISH, DestroyVDSCommand, log id: 78a98dca >2014-08-11 15:49:55,002 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-23) [42aaac5c] FINISH, DestroyVmVDSCommand, return: Down, log id: 6a4cb98d >2014-08-11 15:49:55,004 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-35) [55df9ef6] Running command: ProcessDownVmCommand internal: true. >2014-08-11 15:49:55,018 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-23) [42aaac5c] Correlation ID: 42aaac5c, Job ID: d0ff37c0-da4b-4b9c-a0c9-3f16322940ad, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was powered off ungracefully by admin (Host: vdshost2) (Reason: Not Specified). >2014-08-11 15:50:15,158 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-58) Setting new tasks map. The map contains now 6 tasks >2014-08-11 15:50:45,162 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-29) Setting new tasks map. The map contains now 3 tasks >2014-08-11 15:50:55,524 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:50:55,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:50:55,570 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [2813fa15] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:50:55,572 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [47de54f2] Running command: LogoutUserCommand internal: false. >2014-08-11 15:50:55,579 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [47de54f2] Correlation ID: 47de54f2, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:51:07,923 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:51:07,930 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:51:07,947 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [667b5d60] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:51:07,949 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [112148b2] Running command: LogoutUserCommand internal: false. >2014-08-11 15:51:07,955 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [112148b2] Correlation ID: 112148b2, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:51:15,163 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) [7626c070] Setting new tasks map. The map contains now 0 tasks >2014-08-11 15:51:15,163 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) [7626c070] Cleared all tasks of pool 45dd52dc-0e1c-4321-8a19-f4a0b735410f. >2014-08-11 15:51:20,641 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:51:20,655 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:51:20,820 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [3066c605] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:51:20,822 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [56edc587] Running command: LogoutUserCommand internal: false. >2014-08-11 15:51:20,830 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [56edc587] Correlation ID: 56edc587, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:51:27,682 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:51:27,689 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:51:27,883 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [79bf938b] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:51:27,885 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [26ecdb8c] Running command: LogoutUserCommand internal: false. >2014-08-11 15:51:27,897 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [26ecdb8c] Correlation ID: 26ecdb8c, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:51:40,607 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:51:40,614 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:51:40,782 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [451e18e7] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:51:40,783 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [6cf88e61] Running command: LogoutUserCommand internal: false. >2014-08-11 15:51:40,789 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [6cf88e61] Correlation ID: 6cf88e61, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:51:57,958 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:51:57,965 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:51:58,144 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [6851ad63] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:51:58,145 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [cee9144] Running command: LogoutUserCommand internal: false. >2014-08-11 15:51:58,157 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [cee9144] Correlation ID: cee9144, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:52:05,992 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:52:06,015 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:52:06,176 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [9d7117] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:52:06,177 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [190c958b] Running command: LogoutUserCommand internal: false. >2014-08-11 15:52:06,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [190c958b] Correlation ID: 190c958b, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:52:15,184 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:52:15,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:52:15,369 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [350ac42e] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:52:15,371 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [16bc68da] Running command: LogoutUserCommand internal: false. >2014-08-11 15:52:15,382 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [16bc68da] Correlation ID: 16bc68da, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:52:42,411 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:52:42,418 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:52:42,441 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [6916e165] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:52:42,443 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [263ed5f4] Running command: LogoutUserCommand internal: false. >2014-08-11 15:52:42,451 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [263ed5f4] Correlation ID: 263ed5f4, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:53:10,804 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:53:10,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:53:10,824 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [a5b1fe0] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:53:10,826 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [286ddd9c] Running command: LogoutUserCommand internal: false. >2014-08-11 15:53:10,836 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [286ddd9c] Correlation ID: 286ddd9c, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:53:18,987 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:53:18,994 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:53:19,012 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [4527d951] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:53:19,014 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [54f6d33c] Running command: LogoutUserCommand internal: false. >2014-08-11 15:53:19,027 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [54f6d33c] Correlation ID: 54f6d33c, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:53:37,613 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:53:37,628 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:53:37,805 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [29128265] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:53:37,807 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [152ddb24] Running command: LogoutUserCommand internal: false. >2014-08-11 15:53:37,820 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [152ddb24] Correlation ID: 152ddb24, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:53:41,146 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:53:41,315 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [78382532] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:53:41,316 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [7fa2f848] Running command: LogoutUserCommand internal: false. >2014-08-11 15:53:41,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [7fa2f848] Correlation ID: 7fa2f848, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:54:02,355 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:54:02,362 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:54:02,554 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [6835561e] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:54:02,555 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [6a4253b9] Running command: LogoutUserCommand internal: false. >2014-08-11 15:54:02,562 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [6a4253b9] Correlation ID: 6a4253b9, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:54:13,522 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:54:13,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:54:13,741 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [1a2263fe] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:54:13,742 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [9ac0182] Running command: LogoutUserCommand internal: false. >2014-08-11 15:54:13,812 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [9ac0182] Correlation ID: 9ac0182, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:54:29,830 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-3) Running command: LoginUserCommand internal: false. >2014-08-11 15:54:29,852 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 15:54:29,866 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-3) [199dd927] Running command: LogoutBySessionCommand internal: false. >2014-08-11 15:54:29,869 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-3) [549a5dd6] Running command: LogoutUserCommand internal: false. >2014-08-11 15:54:29,888 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-3) [549a5dd6] Correlation ID: 549a5dd6, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 15:55:27,042 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [2b0d105] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:55:27,066 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [2b0d105] Running command: TryBackToAllSnapshotsOfVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:55:27,083 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [2b0d105] START, SetVmStatusVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00, status = ImageLocked, exit status = Normal), log id: 6496ceaa >2014-08-11 15:55:27,085 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [2b0d105] FINISH, SetVmStatusVDSCommand, log id: 6496ceaa >2014-08-11 15:55:27,091 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [2b0d105] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:55:27,125 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (http--0.0.0.0-8080-4) [57df3af0] Running command: TryBackToSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:55:27,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [57df3af0] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = ff10a123-d06d-471e-9069-0965cc0d9c8a, newImageDescription = , imageId = 5d8cbd7d-dd13-465d-ac9f-5a97e4d80607, sourceImageGroupId = eac57127-4993-4bf9-aaf9-23a568198364), log id: 526ddcfb >2014-08-11 15:55:27,127 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [57df3af0] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:55:27,725 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [57df3af0] FINISH, CreateSnapshotVDSCommand, return: ff10a123-d06d-471e-9069-0965cc0d9c8a, log id: 526ddcfb >2014-08-11 15:55:27,767 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [57df3af0] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 7130d8d0-6c67-4817-bb40-e30f5c486704 >2014-08-11 15:55:27,768 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [57df3af0] CommandMultiAsyncTasks::AttachTask: Attaching task aff66dc5-0805-43d8-96c3-9c185ab2f02c to command 7130d8d0-6c67-4817-bb40-e30f5c486704. >2014-08-11 15:55:27,792 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [57df3af0] Adding task aff66dc5-0805-43d8-96c3-9c185ab2f02c (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:55:27,909 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [57df3af0] Correlation ID: 2b0d105, Job ID: 72376797-e5a7-4f83-b82b-dbead409e930, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm1 was initiated by admin. >2014-08-11 15:55:27,910 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [57df3af0] BaseAsyncTask::startPollingTask: Starting to poll task aff66dc5-0805-43d8-96c3-9c185ab2f02c. >2014-08-11 15:55:35,871 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-8) [9a7fcb4] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-11 15:55:35,877 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-8) [9a7fcb4] SPMAsyncTask::PollTask: Polling task aff66dc5-0805-43d8-96c3-9c185ab2f02c (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:55:35,936 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-8) [9a7fcb4] BaseAsyncTask::onTaskEndSuccess: Task aff66dc5-0805-43d8-96c3-9c185ab2f02c (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:55:35,937 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-8) [9a7fcb4] CommandAsyncTask::endActionIfNecessary: All tasks of command 7130d8d0-6c67-4817-bb40-e30f5c486704 has ended -> executing endAction >2014-08-11 15:55:35,937 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-8) [9a7fcb4] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 7130d8d0-6c67-4817-bb40-e30f5c486704): calling endAction . >2014-08-11 15:55:35,938 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) [9a7fcb4] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction TryBackToAllSnapshotsOfVm, executionIndex: 0 >2014-08-11 15:55:35,951 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (org.ovirt.thread.pool-8-thread-17) [2b0d105] Ending command successfully: org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand >2014-08-11 15:55:35,984 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (org.ovirt.thread.pool-8-thread-17) [57df3af0] Ending command successfully: org.ovirt.engine.core.bll.TryBackToSnapshotCommand >2014-08-11 15:55:35,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-17) [57df3af0] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageId = ff10a123-d06d-471e-9069-0965cc0d9c8a), log id: 5b591659 >2014-08-11 15:55:36,065 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-17) [57df3af0] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@37d4cf3d, log id: 5b591659 >2014-08-11 15:55:36,090 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-17) START, SetVmStatusVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00, status = Down, exit status = Normal), log id: 1413d2c3 >2014-08-11 15:55:36,092 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-17) FINISH, SetVmStatusVDSCommand, log id: 1413d2c3 >2014-08-11 15:55:36,234 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-17) Correlation ID: 2b0d105, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm1 has been completed. >2014-08-11 15:55:36,235 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm completed, handling the result. >2014-08-11 15:55:36,235 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm succeeded, clearing tasks. >2014-08-11 15:55:36,243 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) SPMAsyncTask::ClearAsyncTask: Attempting to clear task aff66dc5-0805-43d8-96c3-9c185ab2f02c >2014-08-11 15:55:36,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = aff66dc5-0805-43d8-96c3-9c185ab2f02c), log id: 4e755e81 >2014-08-11 15:55:36,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=aff66dc5-0805-43d8-96c3-9c185ab2f02c), log id: 7b8f8f64 >2014-08-11 15:55:36,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) FINISH, HSMClearTaskVDSCommand, log id: 7b8f8f64 >2014-08-11 15:55:36,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-17) FINISH, SPMClearTaskVDSCommand, log id: 4e755e81 >2014-08-11 15:55:36,276 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-17) BaseAsyncTask::removeTaskFromDB: Removed task aff66dc5-0805-43d8-96c3-9c185ab2f02c from DataBase >2014-08-11 15:55:36,277 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-17) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 7130d8d0-6c67-4817-bb40-e30f5c486704 >2014-08-11 15:55:38,602 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [39a10a4f] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:55:38,635 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [39a10a4f] Running command: RestoreAllSnapshotsCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:55:38,635 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [39a10a4f] Locking VM(id = af1e4f01-60d5-4457-a842-ff15af8d9f00) with compensation. >2014-08-11 15:55:38,637 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [39a10a4f] START, SetVmStatusVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00, status = ImageLocked, exit status = Normal), log id: d884d4d >2014-08-11 15:55:38,639 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [39a10a4f] FINISH, SetVmStatusVDSCommand, log id: d884d4d >2014-08-11 15:55:38,651 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [39a10a4f] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 15:55:38,662 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (http--0.0.0.0-8080-4) [22cb14b3] Running command: RestoreFromSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:55:38,694 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [22cb14b3] START, DestroyImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageId = 00000000-0000-0000-0000-000000000000, imageList = [5dcdc1ac-e1d4-40fe-9b5d-c3d5964b870a, 6c8c87cd-205f-4b39-94f2-a9183ad63edb], postZero = false, force = true), log id: 73989833 >2014-08-11 15:55:39,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [22cb14b3] FINISH, DestroyImageVDSCommand, log id: 73989833 >2014-08-11 15:55:39,425 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [22cb14b3] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 3d852ce7-0b3e-4670-be82-e8d35aa850b4 >2014-08-11 15:55:39,425 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [22cb14b3] CommandMultiAsyncTasks::AttachTask: Attaching task ffe9a02b-24fb-4fd3-a520-ee1e8172e383 to command 3d852ce7-0b3e-4670-be82-e8d35aa850b4. >2014-08-11 15:55:39,452 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [22cb14b3] Adding task ffe9a02b-24fb-4fd3-a520-ee1e8172e383 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:55:44,462 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:55:44,900 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 15:56:23,336 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [22cb14b3] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 785a74b2-6ba4-43fd-bfec-57bdc3ff8c6a, postZeros = false, forceDelete = false), log id: 788d2c2e >2014-08-11 15:56:23,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [22cb14b3] FINISH, DeleteImageGroupVDSCommand, log id: 788d2c2e >2014-08-11 15:56:23,445 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [22cb14b3] CommandMultiAsyncTasks::AttachTask: Attaching task fefba00d-e4a5-4f5f-80f2-90dab3f1b963 to command 3d852ce7-0b3e-4670-be82-e8d35aa850b4. >2014-08-11 15:56:23,486 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [22cb14b3] Adding task fefba00d-e4a5-4f5f-80f2-90dab3f1b963 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:56:23,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [22cb14b3] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = f53fe62c-1af9-452a-b08f-6e4e0786a5ea, postZeros = false, forceDelete = false), log id: 54fbfba0 >2014-08-11 15:56:23,607 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [22cb14b3] FINISH, DeleteImageGroupVDSCommand, log id: 54fbfba0 >2014-08-11 15:56:23,620 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [22cb14b3] CommandMultiAsyncTasks::AttachTask: Attaching task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9 to command 3d852ce7-0b3e-4670-be82-e8d35aa850b4. >2014-08-11 15:56:23,661 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [22cb14b3] Adding task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:56:23,728 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [22cb14b3] Correlation ID: 39a10a4f, Job ID: 3b26ed2e-6732-4d90-9511-fd264efc328c, Call Stack: null, Custom Event ID: -1, Message: Restoring VM vm1 from snapshot started by user admin. >2014-08-11 15:56:23,728 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [22cb14b3] BaseAsyncTask::startPollingTask: Starting to poll task ffe9a02b-24fb-4fd3-a520-ee1e8172e383. >2014-08-11 15:56:23,729 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [22cb14b3] BaseAsyncTask::startPollingTask: Starting to poll task fefba00d-e4a5-4f5f-80f2-90dab3f1b963. >2014-08-11 15:56:23,729 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [22cb14b3] BaseAsyncTask::startPollingTask: Starting to poll task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9. >2014-08-11 15:56:29,225 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-77) Polling and updating Async Tasks: 4 tasks, 3 tasks to poll now >2014-08-11 15:56:29,244 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:56:29,278 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::onTaskEndSuccess: Task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:56:29,278 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-77) Task with DB Task ID 2a16bcd0-4738-44f6-8c51-eb38bbdc957a and VDSM Task ID ffe9a02b-24fb-4fd3-a520-ee1e8172e383 is in state Polling. End action for command 3d852ce7-0b3e-4670-be82-e8d35aa850b4 will proceed when all the entitys tasks are completed. >2014-08-11 15:56:29,279 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task fefba00d-e4a5-4f5f-80f2-90dab3f1b963 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:56:29,286 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::onTaskEndSuccess: Task fefba00d-e4a5-4f5f-80f2-90dab3f1b963 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:56:29,286 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-77) Task with DB Task ID 2a16bcd0-4738-44f6-8c51-eb38bbdc957a and VDSM Task ID ffe9a02b-24fb-4fd3-a520-ee1e8172e383 is in state Polling. End action for command 3d852ce7-0b3e-4670-be82-e8d35aa850b4 will proceed when all the entitys tasks are completed. >2014-08-11 15:56:29,287 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task ffe9a02b-24fb-4fd3-a520-ee1e8172e383 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:56:29,303 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::onTaskEndSuccess: Task ffe9a02b-24fb-4fd3-a520-ee1e8172e383 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:56:29,303 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::endActionIfNecessary: All tasks of command 3d852ce7-0b3e-4670-be82-e8d35aa850b4 has ended -> executing endAction >2014-08-11 15:56:29,304 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 3d852ce7-0b3e-4670-be82-e8d35aa850b4): calling endAction . >2014-08-11 15:56:29,304 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RestoreAllSnapshots, executionIndex: 0 >2014-08-11 15:56:29,344 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (org.ovirt.thread.pool-8-thread-44) [39a10a4f] Ending command successfully: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand >2014-08-11 15:56:29,395 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (org.ovirt.thread.pool-8-thread-44) [22cb14b3] Ending command successfully: org.ovirt.engine.core.bll.RestoreFromSnapshotCommand >2014-08-11 15:56:29,400 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, SetVmStatusVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00, status = Down, exit status = Normal), log id: 51aca853 >2014-08-11 15:56:29,403 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, SetVmStatusVDSCommand, log id: 51aca853 >2014-08-11 15:56:29,436 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) Correlation ID: 39a10a4f, Call Stack: null, Custom Event ID: -1, Message: VM vm1 restoring from Snapshot has been completed. >2014-08-11 15:56:29,437 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots completed, handling the result. >2014-08-11 15:56:29,437 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots succeeded, clearing tasks. >2014-08-11 15:56:29,453 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ffe9a02b-24fb-4fd3-a520-ee1e8172e383 >2014-08-11 15:56:29,454 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = ffe9a02b-24fb-4fd3-a520-ee1e8172e383), log id: 65f1a513 >2014-08-11 15:56:29,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=ffe9a02b-24fb-4fd3-a520-ee1e8172e383), log id: 5b8cb6ae >2014-08-11 15:56:29,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 5b8cb6ae >2014-08-11 15:56:29,499 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 65f1a513 >2014-08-11 15:56:29,511 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) BaseAsyncTask::removeTaskFromDB: Removed task ffe9a02b-24fb-4fd3-a520-ee1e8172e383 from DataBase >2014-08-11 15:56:29,512 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9 >2014-08-11 15:56:29,512 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9), log id: 422da31b >2014-08-11 15:56:29,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9), log id: 422f638e >2014-08-11 15:56:29,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 422f638e >2014-08-11 15:56:29,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 422da31b >2014-08-11 15:56:29,586 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) BaseAsyncTask::removeTaskFromDB: Removed task 270cbbf8-0e83-49a4-b65a-0d0d2c94a6b9 from DataBase >2014-08-11 15:56:29,587 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task fefba00d-e4a5-4f5f-80f2-90dab3f1b963 >2014-08-11 15:56:29,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = fefba00d-e4a5-4f5f-80f2-90dab3f1b963), log id: 32322226 >2014-08-11 15:56:29,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=fefba00d-e4a5-4f5f-80f2-90dab3f1b963), log id: 79600688 >2014-08-11 15:56:29,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 79600688 >2014-08-11 15:56:29,646 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 32322226 >2014-08-11 15:56:29,653 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) BaseAsyncTask::removeTaskFromDB: Removed task fefba00d-e4a5-4f5f-80f2-90dab3f1b963 from DataBase >2014-08-11 15:56:29,653 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 3d852ce7-0b3e-4670-be82-e8d35aa850b4 >2014-08-11 15:56:53,204 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-60) Setting new tasks map. The map contains now 3 tasks >2014-08-11 15:57:01,821 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [647f61bb] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:57:01,846 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [647f61bb] Running command: TryBackToAllSnapshotsOfVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:57:01,863 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [647f61bb] START, SetVmStatusVDSCommand( vmId = 6ed6e66e-1a80-4538-845a-a54d6b573e65, status = ImageLocked, exit status = Normal), log id: 65da6afc >2014-08-11 15:57:01,867 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [647f61bb] FINISH, SetVmStatusVDSCommand, log id: 65da6afc >2014-08-11 15:57:01,879 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (http--0.0.0.0-8080-4) [647f61bb] Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:57:01,921 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (http--0.0.0.0-8080-4) [5185af6a] Running command: TryBackToSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:57:01,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [5185af6a] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 09090b0f-673f-4fc7-80ec-735b70b8652d, newImageDescription = , imageId = 81c8637d-ba93-4db2-854f-ddb4e824246a, sourceImageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89), log id: 5cb15e2d >2014-08-11 15:57:01,923 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [5185af6a] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 15:57:01,998 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (http--0.0.0.0-8080-4) [5185af6a] FINISH, CreateSnapshotVDSCommand, return: 09090b0f-673f-4fc7-80ec-735b70b8652d, log id: 5cb15e2d >2014-08-11 15:57:02,005 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [5185af6a] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0f6477cb-da9d-4aa8-bd17-6511b5e24c6e >2014-08-11 15:57:02,006 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [5185af6a] CommandMultiAsyncTasks::AttachTask: Attaching task 646ff27e-c81c-47f4-a1f5-3c67b24efb28 to command 0f6477cb-da9d-4aa8-bd17-6511b5e24c6e. >2014-08-11 15:57:02,021 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [5185af6a] Adding task 646ff27e-c81c-47f4-a1f5-3c67b24efb28 (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 15:57:02,172 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [5185af6a] Correlation ID: 647f61bb, Job ID: 56616f1e-7cc5-46d7-b3c3-01258139abe8, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm2 was initiated by admin. >2014-08-11 15:57:02,172 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (http--0.0.0.0-8080-4) [5185af6a] BaseAsyncTask::startPollingTask: Starting to poll task 646ff27e-c81c-47f4-a1f5-3c67b24efb28. >2014-08-11 15:57:09,306 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-08-11 15:57:09,312 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) SPMAsyncTask::PollTask: Polling task 646ff27e-c81c-47f4-a1f5-3c67b24efb28 (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 15:57:09,330 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) BaseAsyncTask::onTaskEndSuccess: Task 646ff27e-c81c-47f4-a1f5-3c67b24efb28 (Parent Command TryBackToAllSnapshotsOfVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 15:57:09,331 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-95) CommandAsyncTask::endActionIfNecessary: All tasks of command 0f6477cb-da9d-4aa8-bd17-6511b5e24c6e has ended -> executing endAction >2014-08-11 15:57:09,332 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-95) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 0f6477cb-da9d-4aa8-bd17-6511b5e24c6e): calling endAction . >2014-08-11 15:57:09,333 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction TryBackToAllSnapshotsOfVm, executionIndex: 0 >2014-08-11 15:57:09,347 INFO [org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand] (org.ovirt.thread.pool-8-thread-36) [647f61bb] Ending command successfully: org.ovirt.engine.core.bll.TryBackToAllSnapshotsOfVmCommand >2014-08-11 15:57:09,389 INFO [org.ovirt.engine.core.bll.TryBackToSnapshotCommand] (org.ovirt.thread.pool-8-thread-36) [5185af6a] Ending command successfully: org.ovirt.engine.core.bll.TryBackToSnapshotCommand >2014-08-11 15:57:09,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [5185af6a] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageId = 09090b0f-673f-4fc7-80ec-735b70b8652d), log id: 63e1d245 >2014-08-11 15:57:09,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-36) [5185af6a] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@c0d53a2c, log id: 63e1d245 >2014-08-11 15:57:09,580 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, SetVmStatusVDSCommand( vmId = 6ed6e66e-1a80-4538-845a-a54d6b573e65, status = Down, exit status = Normal), log id: 25ecfeae >2014-08-11 15:57:09,583 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, SetVmStatusVDSCommand, log id: 25ecfeae >2014-08-11 15:57:09,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-36) Correlation ID: 647f61bb, Call Stack: null, Custom Event ID: -1, Message: Snapshot-Preview snap1 for VM vm2 has been completed. >2014-08-11 15:57:09,740 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm completed, handling the result. >2014-08-11 15:57:09,740 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type TryBackToAllSnapshotsOfVm succeeded, clearing tasks. >2014-08-11 15:57:09,747 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 646ff27e-c81c-47f4-a1f5-3c67b24efb28 >2014-08-11 15:57:09,748 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 646ff27e-c81c-47f4-a1f5-3c67b24efb28), log id: 61491b87 >2014-08-11 15:57:09,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=646ff27e-c81c-47f4-a1f5-3c67b24efb28), log id: 6ae6df7 >2014-08-11 15:57:09,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, HSMClearTaskVDSCommand, log id: 6ae6df7 >2014-08-11 15:57:09,769 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, SPMClearTaskVDSCommand, log id: 61491b87 >2014-08-11 15:57:09,806 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-36) BaseAsyncTask::removeTaskFromDB: Removed task 646ff27e-c81c-47f4-a1f5-3c67b24efb28 from DataBase >2014-08-11 15:57:09,806 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-36) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0f6477cb-da9d-4aa8-bd17-6511b5e24c6e >2014-08-11 15:57:37,319 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [4a1f3f98] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:57:37,342 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [4a1f3f98] Running command: RestoreAllSnapshotsCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 15:57:37,343 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [4a1f3f98] Locking VM(id = 6ed6e66e-1a80-4538-845a-a54d6b573e65) with compensation. >2014-08-11 15:57:37,347 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [4a1f3f98] START, SetVmStatusVDSCommand( vmId = 6ed6e66e-1a80-4538-845a-a54d6b573e65, status = ImageLocked, exit status = Normal), log id: 3ed8806f >2014-08-11 15:57:37,348 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8080-4) [4a1f3f98] FINISH, SetVmStatusVDSCommand, log id: 3ed8806f >2014-08-11 15:57:37,359 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [4a1f3f98] Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 15:57:37,367 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (http--0.0.0.0-8080-4) [60c8379f] Running command: RestoreFromSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 15:57:37,394 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [60c8379f] START, DestroyImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, imageId = 00000000-0000-0000-0000-000000000000, imageList = [90ac62ee-531e-4170-9269-825827b2c6e3, ea872373-48a4-467f-ae37-b20d5b4b0060], postZero = true, force = true), log id: d9a4d10 >2014-08-11 15:57:37,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DestroyImageVDSCommand] (http--0.0.0.0-8080-4) [60c8379f] FINISH, DestroyImageVDSCommand, log id: d9a4d10 >2014-08-11 15:57:37,627 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [60c8379f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 1dc96e6e-431e-4bc0-a331-9702e5268d02 >2014-08-11 15:57:37,627 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [60c8379f] CommandMultiAsyncTasks::AttachTask: Attaching task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a to command 1dc96e6e-431e-4bc0-a331-9702e5268d02. >2014-08-11 15:57:37,668 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [60c8379f] Adding task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:32:04,437 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-17) Setting new tasks map. The map contains now 1 tasks >2014-08-11 16:32:04,481 ERROR [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (Transaction Reaper Worker 0) Transaction rolled-back for command: org.ovirt.engine.core.bll.RestoreFromSnapshotCommand. >2014-08-11 16:32:04,481 ERROR [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (Transaction Reaper Worker 0) Transaction rolled-back for command: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand. >2014-08-11 16:32:04,482 INFO [org.ovirt.engine.core.bll.tasks.interfaces.CommandCoordinator] (org.ovirt.thread.pool-8-thread-12) Rollback for command: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand. >2014-08-11 16:32:04,483 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) Attempting to cancel task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a. >2014-08-11 16:32:04,483 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) SPMAsyncTask::StopTask: Attempting to stop task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters). >2014-08-11 16:32:04,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMStopTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, SPMStopTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 982b8bf5-05fa-460e-94e3-63d3c10e2d4a), log id: 1cabb672 >2014-08-11 16:32:04,625 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-2) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:04,635 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-9) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:04,648 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 16:32:04,712 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [60c8379f] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 68d8f365-868e-4088-b968-b102704a3d70, postZeros = false, forceDelete = false), log id: 4d48f866 >2014-08-11 16:32:04,873 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [60c8379f] FINISH, DeleteImageGroupVDSCommand, log id: 4d48f866 >2014-08-11 16:32:04,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMStopTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) START, HSMStopTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=982b8bf5-05fa-460e-94e3-63d3c10e2d4a), log id: 5bb74558 >2014-08-11 16:32:04,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMStopTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, HSMStopTaskVDSCommand, log id: 5bb74558 >2014-08-11 16:32:04,891 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMStopTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) FINISH, SPMStopTaskVDSCommand, log id: 1cabb672 >2014-08-11 16:32:04,981 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [60c8379f] CommandMultiAsyncTasks::AttachTask: Attaching task cf1f08ff-4f68-49b3-9358-9f6213f4fbe2 to command 1dc96e6e-431e-4bc0-a331-9702e5268d02. >2014-08-11 16:32:05,017 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [60c8379f] Adding task cf1f08ff-4f68-49b3-9358-9f6213f4fbe2 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:32:05,068 ERROR [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [60c8379f] Error during persistAsyncTaskPlaceHolder for command: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand. Exception javax.ejb.TransactionRolledbackLocalException: Current transaction is marked for rollback, no further operations are possible or desired: javax.ejb.TransactionRolledbackLocalException: Current transaction is marked for rollback, no further operations are possible or desired > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:105) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.persistAsyncTaskPlaceHolder(CommandBase.java:1471) [bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeMemoryVolumes(VmCommand.java:353) [bll.jar:] > at org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand.removeSnapshotsFromDB(RestoreAllSnapshotsCommand.java:164) [bll.jar:] > at org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand.executeVmCommand(RestoreAllSnapshotsCommand.java:120) [bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:100) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1163) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1290) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1910) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1311) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:347) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:430) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:411) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:369) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor483.invoke(Unknown Source) [:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:114) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:125) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:135) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) [:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:82) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view6.runAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runAction(GenericApiGWTServiceImpl.java:134) > at sun.reflect.GeneratedMethodAccessor484.invoke(Unknown Source) [:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec-1.0.0.Final.jar:1.0.0.Final] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec-1.0.0.Final.jar:1.0.0.Final] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.SessionMgmtFilter.doFilter(SessionMgmtFilter.java:31) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.LoginFilter.doFilter(LoginFilter.java:73) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.NegotiationFilter.doFilter(NegotiationFilter.java:105) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:75) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:63) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:489) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368) > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877) > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] > >2014-08-11 16:32:05,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [60c8379f] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = bafe96bb-22d3-4235-b23d-357a4abcd37d, postZeros = false, forceDelete = false), log id: 52b38edc >2014-08-11 16:32:05,416 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-9) [a6837ef] Running command: LogoutBySessionCommand internal: false. >2014-08-11 16:32:05,440 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-9) [2c3e0fe9] Running command: LogoutUserCommand internal: false. >2014-08-11 16:32:05,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (http--0.0.0.0-8080-4) [60c8379f] FINISH, DeleteImageGroupVDSCommand, log id: 52b38edc >2014-08-11 16:32:05,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-9) [2c3e0fe9] Correlation ID: 2c3e0fe9, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 16:32:05,532 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (http--0.0.0.0-8080-4) [60c8379f] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 00000000-0000-0000-0000-000000000000 >2014-08-11 16:32:05,533 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (http--0.0.0.0-8080-4) [60c8379f] CommandMultiAsyncTasks::AttachTask: Attaching task 3140b4f4-3ee0-4207-9615-5e978f7a44f5 to command 00000000-0000-0000-0000-000000000000. >2014-08-11 16:32:05,606 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (http--0.0.0.0-8080-4) [60c8379f] Adding task 3140b4f4-3ee0-4207-9615-5e978f7a44f5 (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:32:05,632 ERROR [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [60c8379f] Command org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand throw exception: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction > at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80) [spring-jdbc.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:1001) [spring-jdbc.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.call(JdbcTemplate.java:1064) [spring-jdbc.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.simple.AbstractJdbcCall.executeCallInternal(AbstractJdbcCall.java:388) [spring-jdbc.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.simple.AbstractJdbcCall.doExecute(AbstractJdbcCall.java:351) [spring-jdbc.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.simple.SimpleJdbcCall.execute(SimpleJdbcCall.java:181) [spring-jdbc.jar:3.1.1.RELEASE] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeImpl(SimpleJdbcCallsHandler.java:141) [dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeImpl(SimpleJdbcCallsHandler.java:136) [dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeModification(SimpleJdbcCallsHandler.java:74) [dal.jar:] > at org.ovirt.engine.core.dao.DefaultGenericDaoDbFacade.remove(DefaultGenericDaoDbFacade.java:107) [dal.jar:] > at org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand.removeSnapshotsFromDB(RestoreAllSnapshotsCommand.java:170) [bll.jar:] > at org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand.executeVmCommand(RestoreAllSnapshotsCommand.java:120) [bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:100) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1163) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1290) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1910) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1311) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:347) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:430) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:411) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:369) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor483.invoke(Unknown Source) [:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:114) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:125) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:135) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.bll.interceptors.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:13) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) [:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:82) [jboss-as-weld-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view6.runAction(Unknown Source) [common.jar:] > at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runAction(GenericApiGWTServiceImpl.java:134) > at sun.reflect.GeneratedMethodAccessor484.invoke(Unknown Source) [:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) > at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) > at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) > at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [jboss-servlet-api_3.0_spec-1.0.0.Final.jar:1.0.0.Final] > at javax.servlet.http.HttpServlet.service(HttpServlet.java:847) [jboss-servlet-api_3.0_spec-1.0.0.Final.jar:1.0.0.Final] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:72) > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:64) [utils.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.SessionMgmtFilter.doFilter(SessionMgmtFilter.java:31) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.LoginFilter.doFilter(LoginFilter.java:73) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.NegotiationFilter.doFilter(NegotiationFilter.java:105) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:75) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:63) [aaa.jar:] > at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:280) > at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248) > at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275) > at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161) > at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:489) > at org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153) > at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155) > at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at org.jboss.web.rewrite.RewriteValve.invoke(RewriteValve.java:466) > at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368) > at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877) > at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930) > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] >Caused by: java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction > at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:137) > at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) [spring-jdbc.jar:3.1.1.RELEASE] > at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) [spring-jdbc.jar:3.1.1.RELEASE] > ... 124 more >Caused by: javax.resource.ResourceException: IJ000460: Error checking for a transaction > at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:362) > at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:464) > at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:129) > ... 126 more >Caused by: javax.resource.ResourceException: IJ000459: Transaction is not active: tx=TransactionImple < ac, BasicAction: 0:ffff7f000001:3a8ed035:53e8b86d:c00 status: ActionStatus.ABORTED > > at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:352) > ... 128 more > >2014-08-11 16:32:05,987 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (http--0.0.0.0-8080-4) [60c8379f] Command [id=1dc96e6e-431e-4bc0-a331-9702e5268d02]: Compensating CHANGED_STATUS_ONLY of org.ovirt.engine.core.common.businessentities.VmDynamic; snapshot: EntityStatusSnapshot [id=6ed6e66e-1a80-4538-845a-a54d6b573e65, status=Down]. >2014-08-11 16:32:06,097 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) [60c8379f] Correlation ID: 4a1f3f98, Job ID: 401c0455-dbbf-4d12-b3da-dc5a46ceba14, Call Stack: null, Custom Event ID: -1, Message: Failed to restore VM vm2 from Snapshot (User: admin). >2014-08-11 16:32:14,431 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-08-11 16:32:14,437 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-46) SPMAsyncTask::PollTask: Polling task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:32:14,455 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-46) BaseAsyncTask::onTaskEndSuccess: Task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a (Parent Command RestoreAllSnapshots, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:32:14,456 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-46) CommandAsyncTask::endActionIfNecessary: All tasks of command 1dc96e6e-431e-4bc0-a331-9702e5268d02 has ended -> executing endAction >2014-08-11 16:32:14,457 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-46) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 1dc96e6e-431e-4bc0-a331-9702e5268d02): calling endAction . >2014-08-11 16:32:14,458 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RestoreAllSnapshots, executionIndex: 0 >2014-08-11 16:32:14,480 INFO [org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand] (org.ovirt.thread.pool-8-thread-43) [4a1f3f98] Ending command successfully: org.ovirt.engine.core.bll.RestoreAllSnapshotsCommand >2014-08-11 16:32:14,522 INFO [org.ovirt.engine.core.bll.RestoreFromSnapshotCommand] (org.ovirt.thread.pool-8-thread-43) [60c8379f] Ending command successfully: org.ovirt.engine.core.bll.RestoreFromSnapshotCommand >2014-08-11 16:32:14,547 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-43) Correlation ID: 4a1f3f98, Call Stack: null, Custom Event ID: -1, Message: VM vm2 restoring from Snapshot has been completed. >2014-08-11 16:32:14,547 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots completed, handling the result. >2014-08-11 16:32:14,548 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RestoreAllSnapshots succeeded, clearing tasks. >2014-08-11 16:32:14,555 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a >2014-08-11 16:32:14,556 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 982b8bf5-05fa-460e-94e3-63d3c10e2d4a), log id: 33e749db >2014-08-11 16:32:14,557 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=982b8bf5-05fa-460e-94e3-63d3c10e2d4a), log id: 15a1e37c >2014-08-11 16:32:14,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 15a1e37c >2014-08-11 16:32:14,574 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 33e749db >2014-08-11 16:32:14,589 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) BaseAsyncTask::removeTaskFromDB: Removed task 982b8bf5-05fa-460e-94e3-63d3c10e2d4a from DataBase >2014-08-11 16:32:14,589 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-43) [within thread]: Some of the tasks related to command id 1dc96e6e-431e-4bc0-a331-9702e5268d02 were not cleared yet (Task id cf1f08ff-4f68-49b3-9358-9f6213f4fbe2 is in state Initializing). >2014-08-11 16:32:34,694 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:34,706 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 16:32:35,526 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-8) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:38,115 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:38,368 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-2) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:38,441 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-2) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:40,567 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:40,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 16:32:40,649 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-2) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:40,718 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-2) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:41,749 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:42,382 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:42,457 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,024 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-5) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,082 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,141 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,191 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,280 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,324 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,357 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,399 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,440 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,482 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,524 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,565 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,599 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,632 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,665 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,699 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,740 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,774 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,807 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,849 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,890 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,924 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:43,957 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-4) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:53,416 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (http--0.0.0.0-8080-9) Running command: LoginUserCommand internal: false. >2014-08-11 16:32:53,432 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-11 16:32:53,513 INFO [org.ovirt.engine.core.bll.aaa.LogoutBySessionCommand] (http--0.0.0.0-8080-9) [3cbc7797] Running command: LogoutBySessionCommand internal: false. >2014-08-11 16:32:53,515 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (http--0.0.0.0-8080-9) [2c292227] Running command: LogoutUserCommand internal: false. >2014-08-11 16:32:53,523 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (http--0.0.0.0-8080-9) [2c292227] Correlation ID: 2c292227, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-11 16:33:34,454 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-72) Setting new tasks map. The map contains now 2 tasks >2014-08-11 16:34:58,924 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2014-08-11 16:34:58,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VM OVFs in Data Center dc1 >2014-08-11 16:34:58,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully updated VM OVFs in Data Center dc1 >2014-08-11 16:34:58,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update template OVFs in Data Center dc1 >2014-08-11 16:34:58,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully updated templates OVFs in Data Center dc1 >2014-08-11 16:34:58,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to remove unneeded template/vm OVFs in Data Center dc1 >2014-08-11 16:34:58,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully removed unneeded template/vm OVFs in Data Center dc1 >2014-08-11 16:34:59,037 INFO [org.ovirt.engine.core.bll.aaa.SyncUsers] (DefaultQuartzScheduler_Worker-23) Principal admin::internal synchronized >2014-08-11 16:34:59,165 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-38) [2caef4dd] Lock Acquired to object EngineLock [exclusiveLocks= key: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 value: STORAGE >key: 0a1703cf-cb25-4ea7-aeb9-da64cad1263e value: DISK >key: 7b495ae1-6a35-4d17-8538-ac21c07326a6 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:34:59,166 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-38) [2caef4dd] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 16:34:59,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [2caef4dd] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 0a1703cf-cb25-4ea7-aeb9-da64cad1263e, imageId = 0400ec9c-208c-4c2f-aab7-80ece4b806be), log id: 64001a91 >2014-08-11 16:34:59,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [2caef4dd] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:34:59,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [2caef4dd] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > imageGroupGUID=0a1703cf-cb25-4ea7-aeb9-da64cad1263e > volUUID=0400ec9c-208c-4c2f-aab7-80ece4b806be > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"9aac3d1c-aca8-47f8-95a9-4d9996313f87"}],"Last Updated":"Mon Aug 11 12:18:44 IDT 2014"} > >2014-08-11 16:34:59,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [2caef4dd] FINISH, SetVolumeDescriptionVDSCommand, log id: 64001a91 >2014-08-11 16:34:59,285 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] Running command: UploadStreamCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 16:34:59,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] START, UploadStreamVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8), log id: 5d3116c8 >2014-08-11 16:34:59,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] -- executeVdsBrokerCommand: >2014-08-11 16:34:59,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] -- parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > imageGUID=0a1703cf-cb25-4ea7-aeb9-da64cad1263e > volUUID=0400ec9c-208c-4c2f-aab7-80ece4b806be > size=30,720 > >2014-08-11 16:35:00,488 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] FINISH, UploadStreamVDSCommand, log id: 5d3116c8 >2014-08-11 16:35:00,492 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-38) [6278a1eb] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command c6f42323-a2fe-4184-9a38-0954fd52bfc3 >2014-08-11 16:35:00,493 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-38) [6278a1eb] CommandMultiAsyncTasks::AttachTask: Attaching task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352 to command c6f42323-a2fe-4184-9a38-0954fd52bfc3. >2014-08-11 16:35:00,544 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) [6278a1eb] Adding task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:35:00,552 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] Lock freed to object EngineLock [exclusiveLocks= key: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 value: STORAGE >key: 0a1703cf-cb25-4ea7-aeb9-da64cad1263e value: DISK >key: 7b495ae1-6a35-4d17-8538-ac21c07326a6 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:00,556 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 0a1703cf-cb25-4ea7-aeb9-da64cad1263e, imageId = 0400ec9c-208c-4c2f-aab7-80ece4b806be), log id: 6163bcbe >2014-08-11 16:35:00,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:00,558 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > imageGroupGUID=0a1703cf-cb25-4ea7-aeb9-da64cad1263e > volUUID=0400ec9c-208c-4c2f-aab7-80ece4b806be > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"9aac3d1c-aca8-47f8-95a9-4d9996313f87"}],"Last Updated":"Mon Aug 11 16:34:59 IDT 2014","Size":30720} > >2014-08-11 16:35:00,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] FINISH, SetVolumeDescriptionVDSCommand, log id: 6163bcbe >2014-08-11 16:35:00,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 7b495ae1-6a35-4d17-8538-ac21c07326a6, imageId = 479dc64a-d6a3-4505-9dcb-1ae6b3e31c98), log id: 5236d0fc >2014-08-11 16:35:00,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:00,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > imageGroupGUID=7b495ae1-6a35-4d17-8538-ac21c07326a6 > volUUID=479dc64a-d6a3-4505-9dcb-1ae6b3e31c98 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"9aac3d1c-aca8-47f8-95a9-4d9996313f87"}],"Last Updated":"Mon Aug 11 12:18:44 IDT 2014"} > >2014-08-11 16:35:00,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [6278a1eb] FINISH, SetVolumeDescriptionVDSCommand, log id: 5236d0fc >2014-08-11 16:35:00,744 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] Running command: UploadStreamCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 16:35:00,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] START, UploadStreamVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8), log id: 35449583 >2014-08-11 16:35:00,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] -- executeVdsBrokerCommand: >2014-08-11 16:35:00,746 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] -- parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > imageGUID=7b495ae1-6a35-4d17-8538-ac21c07326a6 > volUUID=479dc64a-d6a3-4505-9dcb-1ae6b3e31c98 > size=30,720 > >2014-08-11 16:35:01,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] FINISH, UploadStreamVDSCommand, log id: 35449583 >2014-08-11 16:35:01,088 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-38) [46f6404f] CommandMultiAsyncTasks::AttachTask: Attaching task d2584b86-fd21-4aa3-9c5d-b125321ee723 to command c6f42323-a2fe-4184-9a38-0954fd52bfc3. >2014-08-11 16:35:01,110 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) [46f6404f] Adding task d2584b86-fd21-4aa3-9c5d-b125321ee723 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:35:01,119 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [46f6404f] Trying to release a shared lock for key: 45dd52dc-0e1c-4321-8a19-f4a0b735410fOVF_UPDATE , but lock does not exist >2014-08-11 16:35:01,119 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [46f6404f] Trying to release exclusive lock which does not exist, lock key: 9aac3d1c-aca8-47f8-95a9-4d9996313f87STORAGE >2014-08-11 16:35:01,120 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [46f6404f] Trying to release exclusive lock which does not exist, lock key: 0a1703cf-cb25-4ea7-aeb9-da64cad1263eDISK >2014-08-11 16:35:01,120 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [46f6404f] Trying to release exclusive lock which does not exist, lock key: 7b495ae1-6a35-4d17-8538-ac21c07326a6DISK >2014-08-11 16:35:01,121 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] Lock freed to object EngineLock [exclusiveLocks= key: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 value: STORAGE >key: 0a1703cf-cb25-4ea7-aeb9-da64cad1263e value: DISK >key: 7b495ae1-6a35-4d17-8538-ac21c07326a6 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:01,122 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 7b495ae1-6a35-4d17-8538-ac21c07326a6, imageId = 479dc64a-d6a3-4505-9dcb-1ae6b3e31c98), log id: 6b69704 >2014-08-11 16:35:01,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:01,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=9aac3d1c-aca8-47f8-95a9-4d9996313f87 > imageGroupGUID=7b495ae1-6a35-4d17-8538-ac21c07326a6 > volUUID=479dc64a-d6a3-4505-9dcb-1ae6b3e31c98 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"9aac3d1c-aca8-47f8-95a9-4d9996313f87"}],"Last Updated":"Mon Aug 11 16:34:59 IDT 2014","Size":30720} > >2014-08-11 16:35:01,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [46f6404f] FINISH, SetVolumeDescriptionVDSCommand, log id: 6b69704 >2014-08-11 16:35:01,177 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-38) [46f6404f] BaseAsyncTask::startPollingTask: Starting to poll task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352. >2014-08-11 16:35:01,178 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-38) [46f6404f] BaseAsyncTask::startPollingTask: Starting to poll task d2584b86-fd21-4aa3-9c5d-b125321ee723. >2014-08-11 16:35:01,182 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-38) [664d27d7] Lock Acquired to object EngineLock [exclusiveLocks= key: cfc19550-86e9-4b71-b969-3e26708ca715 value: DISK >key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >key: 8cc26f26-db51-4c61-a07e-8af8b7cdf742 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:01,186 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-38) [664d27d7] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 16:35:01,196 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [664d27d7] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 8cc26f26-db51-4c61-a07e-8af8b7cdf742, imageId = c1452e79-7b14-4586-9df7-e49f3e10b46f), log id: 502f2900 >2014-08-11 16:35:01,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [664d27d7] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:01,198 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [664d27d7] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 > imageGroupGUID=8cc26f26-db51-4c61-a07e-8af8b7cdf742 > volUUID=c1452e79-7b14-4586-9df7-e49f3e10b46f > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a499025c-18cf-410b-9163-29fc62d44ba4"}],"Last Updated":"Mon Aug 11 14:18:39 IDT 2014"} > >2014-08-11 16:35:01,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [664d27d7] FINISH, SetVolumeDescriptionVDSCommand, log id: 502f2900 >2014-08-11 16:35:01,585 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] Running command: UploadStreamCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 16:35:01,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] START, UploadStreamVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8), log id: 53005f69 >2014-08-11 16:35:01,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] -- executeVdsBrokerCommand: >2014-08-11 16:35:01,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] -- parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 > imageGUID=8cc26f26-db51-4c61-a07e-8af8b7cdf742 > volUUID=c1452e79-7b14-4586-9df7-e49f3e10b46f > size=51,200 > >2014-08-11 16:35:03,920 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] FINISH, UploadStreamVDSCommand, log id: 53005f69 >2014-08-11 16:35:03,921 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-38) [4656c1af] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command d7236516-445b-455f-aeb4-67146132a174 >2014-08-11 16:35:03,921 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-38) [4656c1af] CommandMultiAsyncTasks::AttachTask: Attaching task c9155205-974e-4797-8fbb-631328e4f217 to command d7236516-445b-455f-aeb4-67146132a174. >2014-08-11 16:35:03,977 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) [4656c1af] Adding task c9155205-974e-4797-8fbb-631328e4f217 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:35:04,037 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] Lock freed to object EngineLock [exclusiveLocks= key: cfc19550-86e9-4b71-b969-3e26708ca715 value: DISK >key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >key: 8cc26f26-db51-4c61-a07e-8af8b7cdf742 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:04,040 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 8cc26f26-db51-4c61-a07e-8af8b7cdf742, imageId = c1452e79-7b14-4586-9df7-e49f3e10b46f), log id: 65afdbd1 >2014-08-11 16:35:04,041 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:04,042 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 > imageGroupGUID=8cc26f26-db51-4c61-a07e-8af8b7cdf742 > volUUID=c1452e79-7b14-4586-9df7-e49f3e10b46f > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a499025c-18cf-410b-9163-29fc62d44ba4"}],"Last Updated":"Mon Aug 11 16:35:01 IDT 2014","Size":51200} > >2014-08-11 16:35:04,333 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] FINISH, SetVolumeDescriptionVDSCommand, log id: 65afdbd1 >2014-08-11 16:35:04,379 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = cfc19550-86e9-4b71-b969-3e26708ca715, imageId = 3c2d09cd-ee59-473c-9847-2dec96aa77e4), log id: 6090603b >2014-08-11 16:35:04,379 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:04,380 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 > imageGroupGUID=cfc19550-86e9-4b71-b969-3e26708ca715 > volUUID=3c2d09cd-ee59-473c-9847-2dec96aa77e4 > description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a499025c-18cf-410b-9163-29fc62d44ba4"}],"Last Updated":"Mon Aug 11 14:18:39 IDT 2014"} > >2014-08-11 16:35:04,464 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-51) Polling and updating Async Tasks: 5 tasks, 2 tasks to poll now >2014-08-11 16:35:04,653 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [4656c1af] FINISH, SetVolumeDescriptionVDSCommand, log id: 6090603b >2014-08-11 16:35:04,661 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:35:04,661 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) BaseAsyncTask::onTaskEndSuccess: Task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:35:04,662 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-51) Task with DB Task ID 75458e7f-41eb-4f93-9bc1-bfd499ec5a55 and VDSM Task ID d2584b86-fd21-4aa3-9c5d-b125321ee723 is in state Polling. End action for command c6f42323-a2fe-4184-9a38-0954fd52bfc3 will proceed when all the entitys tasks are completed. >2014-08-11 16:35:04,663 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) SPMAsyncTask::PollTask: Polling task d2584b86-fd21-4aa3-9c5d-b125321ee723 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:35:04,663 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-51) BaseAsyncTask::onTaskEndSuccess: Task d2584b86-fd21-4aa3-9c5d-b125321ee723 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:35:04,664 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-51) CommandAsyncTask::endActionIfNecessary: All tasks of command c6f42323-a2fe-4184-9a38-0954fd52bfc3 has ended -> executing endAction >2014-08-11 16:35:04,664 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-51) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: c6f42323-a2fe-4184-9a38-0954fd52bfc3): calling endAction . >2014-08-11 16:35:04,665 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-08-11 16:35:04,721 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-08-11 16:35:04,722 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] Trying to release a shared lock for key: 45dd52dc-0e1c-4321-8a19-f4a0b735410fOVF_UPDATE , but lock does not exist >2014-08-11 16:35:04,722 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] Trying to release exclusive lock which does not exist, lock key: 9aac3d1c-aca8-47f8-95a9-4d9996313f87STORAGE >2014-08-11 16:35:04,723 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] Trying to release exclusive lock which does not exist, lock key: 0a1703cf-cb25-4ea7-aeb9-da64cad1263eDISK >2014-08-11 16:35:04,723 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] Trying to release exclusive lock which does not exist, lock key: 7b495ae1-6a35-4d17-8538-ac21c07326a6DISK >2014-08-11 16:35:04,723 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] Lock freed to object EngineLock [exclusiveLocks= key: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 value: STORAGE >key: 0a1703cf-cb25-4ea7-aeb9-da64cad1263e value: DISK >key: 7b495ae1-6a35-4d17-8538-ac21c07326a6 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:04,724 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-08-11 16:35:04,725 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-08-11 16:35:04,725 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] SPMAsyncTask::ClearAsyncTask: Attempting to clear task d2584b86-fd21-4aa3-9c5d-b125321ee723 >2014-08-11 16:35:04,725 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = d2584b86-fd21-4aa3-9c5d-b125321ee723), log id: 353f3239 >2014-08-11 16:35:04,727 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=d2584b86-fd21-4aa3-9c5d-b125321ee723), log id: 47fa577e >2014-08-11 16:35:04,744 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] Running command: UploadStreamCommand internal: true. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: Storage >2014-08-11 16:35:04,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] START, UploadStreamVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8), log id: 5e2da9ea >2014-08-11 16:35:04,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] -- executeVdsBrokerCommand: >2014-08-11 16:35:04,746 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] -- parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 > imageGUID=cfc19550-86e9-4b71-b969-3e26708ca715 > volUUID=3c2d09cd-ee59-473c-9847-2dec96aa77e4 > size=51,200 > >2014-08-11 16:35:04,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] FINISH, HSMClearTaskVDSCommand, log id: 47fa577e >2014-08-11 16:35:04,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] FINISH, SPMClearTaskVDSCommand, log id: 353f3239 >2014-08-11 16:35:04,811 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] BaseAsyncTask::removeTaskFromDB: Removed task d2584b86-fd21-4aa3-9c5d-b125321ee723 from DataBase >2014-08-11 16:35:04,811 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352 >2014-08-11 16:35:04,812 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 7e693d46-2f5b-44e8-bae8-18d2ae9b6352), log id: 41c8e907 >2014-08-11 16:35:04,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=7e693d46-2f5b-44e8-bae8-18d2ae9b6352), log id: 6d3aec4e >2014-08-11 16:35:04,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] FINISH, HSMClearTaskVDSCommand, log id: 6d3aec4e >2014-08-11 16:35:04,886 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] FINISH, SPMClearTaskVDSCommand, log id: 41c8e907 >2014-08-11 16:35:04,894 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] BaseAsyncTask::removeTaskFromDB: Removed task 7e693d46-2f5b-44e8-bae8-18d2ae9b6352 from DataBase >2014-08-11 16:35:04,894 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-48) [2caef4dd] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity c6f42323-a2fe-4184-9a38-0954fd52bfc3 >2014-08-11 16:35:06,942 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] FINISH, UploadStreamVDSCommand, log id: 5e2da9ea >2014-08-11 16:35:06,943 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-38) [444c8889] CommandMultiAsyncTasks::AttachTask: Attaching task f2456f48-0277-48ef-ab51-36b93bf823fa to command d7236516-445b-455f-aeb4-67146132a174. >2014-08-11 16:35:07,044 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-38) [444c8889] Adding task f2456f48-0277-48ef-ab51-36b93bf823fa (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:35:07,053 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [444c8889] Trying to release a shared lock for key: 45dd52dc-0e1c-4321-8a19-f4a0b735410fOVF_UPDATE , but lock does not exist >2014-08-11 16:35:07,053 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [444c8889] Trying to release exclusive lock which does not exist, lock key: cfc19550-86e9-4b71-b969-3e26708ca715DISK >2014-08-11 16:35:07,053 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [444c8889] Trying to release exclusive lock which does not exist, lock key: a499025c-18cf-410b-9163-29fc62d44ba4STORAGE >2014-08-11 16:35:07,054 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-38) [444c8889] Trying to release exclusive lock which does not exist, lock key: 8cc26f26-db51-4c61-a07e-8af8b7cdf742DISK >2014-08-11 16:35:07,054 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] Lock freed to object EngineLock [exclusiveLocks= key: cfc19550-86e9-4b71-b969-3e26708ca715 value: DISK >key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >key: 8cc26f26-db51-4c61-a07e-8af8b7cdf742 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:07,056 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] START, SetVolumeDescriptionVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = cfc19550-86e9-4b71-b969-3e26708ca715, imageId = 3c2d09cd-ee59-473c-9847-2dec96aa77e4), log id: 7f8e6dd2 >2014-08-11 16:35:07,057 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] -- executeIrsBrokerCommand: calling 'setVolumeDescription' >2014-08-11 16:35:07,057 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] -- setVolumeDescription parameters: > spUUID=45dd52dc-0e1c-4321-8a19-f4a0b735410f > sdUUID=a499025c-18cf-410b-9163-29fc62d44ba4 > imageGroupGUID=cfc19550-86e9-4b71-b969-3e26708ca715 > volUUID=3c2d09cd-ee59-473c-9847-2dec96aa77e4 > description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"a499025c-18cf-410b-9163-29fc62d44ba4"}],"Last Updated":"Mon Aug 11 16:35:01 IDT 2014","Size":51200} > >2014-08-11 16:35:07,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-38) [444c8889] FINISH, SetVolumeDescriptionVDSCommand, log id: 7f8e6dd2 >2014-08-11 16:35:07,344 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-38) [444c8889] BaseAsyncTask::startPollingTask: Starting to poll task c9155205-974e-4797-8fbb-631328e4f217. >2014-08-11 16:35:07,345 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-38) [444c8889] BaseAsyncTask::startPollingTask: Starting to poll task f2456f48-0277-48ef-ab51-36b93bf823fa. >2014-08-11 16:35:14,665 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-75) Polling and updating Async Tasks: 6 tasks, 2 tasks to poll now >2014-08-11 16:35:14,671 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task c9155205-974e-4797-8fbb-631328e4f217 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:35:14,672 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task c9155205-974e-4797-8fbb-631328e4f217 (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:35:14,672 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-75) Task with DB Task ID 36476369-eee5-4231-827b-0e3f6a96e868 and VDSM Task ID f2456f48-0277-48ef-ab51-36b93bf823fa is in state Polling. End action for command d7236516-445b-455f-aeb4-67146132a174 will proceed when all the entitys tasks are completed. >2014-08-11 16:35:14,673 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) SPMAsyncTask::PollTask: Polling task f2456f48-0277-48ef-ab51-36b93bf823fa (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:35:14,673 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-75) BaseAsyncTask::onTaskEndSuccess: Task f2456f48-0277-48ef-ab51-36b93bf823fa (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:35:14,674 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-75) CommandAsyncTask::endActionIfNecessary: All tasks of command d7236516-445b-455f-aeb4-67146132a174 has ended -> executing endAction >2014-08-11 16:35:14,674 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-75) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: d7236516-445b-455f-aeb4-67146132a174): calling endAction . >2014-08-11 16:35:14,675 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 >2014-08-11 16:35:14,679 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] Ending command successfully: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand >2014-08-11 16:35:14,679 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-4) [664d27d7] Trying to release a shared lock for key: 45dd52dc-0e1c-4321-8a19-f4a0b735410fOVF_UPDATE , but lock does not exist >2014-08-11 16:35:14,680 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-4) [664d27d7] Trying to release exclusive lock which does not exist, lock key: cfc19550-86e9-4b71-b969-3e26708ca715DISK >2014-08-11 16:35:14,680 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-4) [664d27d7] Trying to release exclusive lock which does not exist, lock key: a499025c-18cf-410b-9163-29fc62d44ba4STORAGE >2014-08-11 16:35:14,680 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-4) [664d27d7] Trying to release exclusive lock which does not exist, lock key: 8cc26f26-db51-4c61-a07e-8af8b7cdf742DISK >2014-08-11 16:35:14,681 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] Lock freed to object EngineLock [exclusiveLocks= key: cfc19550-86e9-4b71-b969-3e26708ca715 value: DISK >key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >key: 8cc26f26-db51-4c61-a07e-8af8b7cdf742 value: DISK >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: OVF_UPDATE >] >2014-08-11 16:35:14,681 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. >2014-08-11 16:35:14,682 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. >2014-08-11 16:35:14,682 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] SPMAsyncTask::ClearAsyncTask: Attempting to clear task f2456f48-0277-48ef-ab51-36b93bf823fa >2014-08-11 16:35:14,683 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = f2456f48-0277-48ef-ab51-36b93bf823fa), log id: 3997b9cf >2014-08-11 16:35:14,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=f2456f48-0277-48ef-ab51-36b93bf823fa), log id: 1827e293 >2014-08-11 16:35:14,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] FINISH, HSMClearTaskVDSCommand, log id: 1827e293 >2014-08-11 16:35:14,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] FINISH, SPMClearTaskVDSCommand, log id: 3997b9cf >2014-08-11 16:35:14,786 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] BaseAsyncTask::removeTaskFromDB: Removed task f2456f48-0277-48ef-ab51-36b93bf823fa from DataBase >2014-08-11 16:35:14,786 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] SPMAsyncTask::ClearAsyncTask: Attempting to clear task c9155205-974e-4797-8fbb-631328e4f217 >2014-08-11 16:35:14,787 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = c9155205-974e-4797-8fbb-631328e4f217), log id: 4537d680 >2014-08-11 16:35:14,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=c9155205-974e-4797-8fbb-631328e4f217), log id: 54e39100 >2014-08-11 16:35:14,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] FINISH, HSMClearTaskVDSCommand, log id: 54e39100 >2014-08-11 16:35:14,804 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-4) [664d27d7] FINISH, SPMClearTaskVDSCommand, log id: 4537d680 >2014-08-11 16:35:14,819 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] BaseAsyncTask::removeTaskFromDB: Removed task c9155205-974e-4797-8fbb-631328e4f217 from DataBase >2014-08-11 16:35:14,820 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-4) [664d27d7] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity d7236516-445b-455f-aeb4-67146132a174 >2014-08-11 16:36:34,454 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-7) [536f0f8e] Setting new tasks map. The map contains now 2 tasks >2014-08-11 16:37:05,412 INFO [org.ovirt.engine.core.bll.RunVmCommand] (http--0.0.0.0-8080-4) [2d0d613] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 16:37:05,427 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [2d0d613] START, IsVmDuringInitiatingVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00), log id: 361a467f >2014-08-11 16:37:05,428 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (http--0.0.0.0-8080-4) [2d0d613] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 361a467f >2014-08-11 16:37:05,572 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] Running command: RunVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 16:37:05,623 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] START, UpdateVmDynamicDataVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@5228017e), log id: 50a2cfa6 >2014-08-11 16:37:05,634 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] FINISH, UpdateVmDynamicDataVDSCommand, log id: 50a2cfa6 >2014-08-11 16:37:05,636 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] START, CreateVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, vm=VM [vm1]), log id: 30a49527 >2014-08-11 16:37:05,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] START, CreateVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, vm=VM [vm1]), log id: f48cfe7 >2014-08-11 16:37:05,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,hiberVolHandle=9aac3d1c-aca8-47f8-95a9-4d9996313f87,45dd52dc-0e1c-4321-8a19-f4a0b735410f,3abe0634-d996-49ab-8070-ee8c9f9e27b1,6b2c2026-64ec-49a6-bb7b-8bc0900f2b58,bb0e3510-e6a2-4622-af95-cd2d07889f0b,8c9c2cb8-e766-4c0c-8c54-21cb36e192c6,transparentHugePages=true,vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00,acpiEnable=true,custom={device_11831574-f84d-48c7-b751-306c1e9c50a7device_5c1d9376-67ee-47e9-b1b7-5ca93d395105device_46036896-272e-4f0c-ab54-e25c003f50eddevice_ddad5fbd-6abc-4487-97be-ed8c4dc53765=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=ddad5fbd-6abc-4487-97be-ed8c4dc53765, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_11831574-f84d-48c7-b751-306c1e9c50a7device_5c1d9376-67ee-47e9-b1b7-5ca93d395105=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=5c1d9376-67ee-47e9-b1b7-5ca93d395105, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_11831574-f84d-48c7-b751-306c1e9c50a7device_5c1d9376-67ee-47e9-b1b7-5ca93d395105device_46036896-272e-4f0c-ab54-e25c003f50ed=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=46036896-272e-4f0c-ab54-e25c003f50ed, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_11831574-f84d-48c7-b751-306c1e9c50a7=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=11831574-f84d-48c7-b751-306c1e9c50a7, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1024,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,numaTune={mode=interleave},maxVCpus=16,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=a27f4b7c-602c-44cb-9817-067488e703e9}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={}, path=, device=cdrom, type=disk, readonly=true, deviceId=3929a972-8f3b-4700-a299-494633fa7354}, {shared=false, index=0, volumeID=ff10a123-d06d-471e-9069-0965cc0d9c8a, propagateErrors=off, format=cow, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x05, type=pci, function=0x0}, domainID=9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageID=eac57127-4993-4bf9-aaf9-23a568198364, specParams={}, optional=false, device=disk, poolID=45dd52dc-0e1c-4321-8a19-f4a0b735410f, readonly=false, deviceId=eac57127-4993-4bf9-aaf9-23a568198364}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=9c6bd3f8-493f-4a47-a30e-08d8c9a372fa}, {address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=10737f6b-3968-4314-b5e4-75015d3274a1}],vmName=vm1,cpuType=Haswell,fileTransferEnable=true >2014-08-11 16:37:05,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] FINISH, CreateVDSCommand, log id: f48cfe7 >2014-08-11 16:37:05,968 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] FINISH, CreateVmVDSCommand, return: RestoringState, log id: 30a49527 >2014-08-11 16:37:05,968 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-10) [2d0d613] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 16:37:05,984 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [2d0d613] Correlation ID: 2d0d613, Job ID: f0bb69ef-d6bd-4006-acf5-a85589e034af, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was started by admin (Host: vdshost2). >2014-08-11 16:37:08,596 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from RestoringState --> Up >2014-08-11 16:37:08,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-30) START, FullListVdsCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vds=Host[vdshost2,eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8], vmIds=[af1e4f01-60d5-4457-a842-ff15af8d9f00]), log id: 735548b7 >2014-08-11 16:37:08,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-30) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=10.35.0.191, nice=0, displayNetwork=ovirtmgmt, copyPasteEnable=true, timeOffset=0, transparentHugePages=true, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, acpiEnable=true, custom={device_11831574-f84d-48c7-b751-306c1e9c50a7device_5c1d9376-67ee-47e9-b1b7-5ca93d395105device_46036896-272e-4f0c-ab54-e25c003f50eddevice_ddad5fbd-6abc-4487-97be-ed8c4dc53765=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=ddad5fbd-6abc-4487-97be-ed8c4dc53765, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_11831574-f84d-48c7-b751-306c1e9c50a7device_5c1d9376-67ee-47e9-b1b7-5ca93d395105=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=5c1d9376-67ee-47e9-b1b7-5ca93d395105, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_11831574-f84d-48c7-b751-306c1e9c50a7device_5c1d9376-67ee-47e9-b1b7-5ca93d395105device_46036896-272e-4f0c-ab54-e25c003f50ed=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=46036896-272e-4f0c-ab54-e25c003f50ed, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_11831574-f84d-48c7-b751-306c1e9c50a7=VmDevice {vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, deviceId=11831574-f84d-48c7-b751-306c1e9c50a7, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, vmType=kvm, emulatedMachine=rhel6.5.0, status=Up, memGuaranteedSize=1024, display=qxl, pid=25294, smartcardEnable=false, bootMenuEnable=false, numaTune={mode=interleave}, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6893d19, vmName=vm1, fileTransferEnable=true, cpuType=Haswell}], log id: 735548b7 >2014-08-11 16:37:08,811 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) Received a memballoon Device without an address when processing VM af1e4f01-60d5-4457-a842-ff15af8d9f00 devices, skipping device: {alias=balloon0, specParams={model=none}, device=memballoon, type=balloon} >2014-08-11 16:37:08,812 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) Received a spice Device without an address when processing VM af1e4f01-60d5-4457-a842-ff15af8d9f00 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayNetwork=ovirtmgmt, copyPasteEnable=true, displayIp=10.35.0.191}, device=spice, tlsPort=5901, type=graphics} >2014-08-11 16:37:08,943 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) Correlation ID: 2d0d613, Job ID: f0bb69ef-d6bd-4006-acf5-a85589e034af, Call Stack: null, Custom Event ID: -1, Message: VM vm1 started on Host vdshost2 >2014-08-11 16:37:38,711 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (http--0.0.0.0-8080-4) [3cc2867b] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 16:37:38,878 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-30) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >2014-08-11 16:37:38,928 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-30) [395f64ed] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 16:37:38,935 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-30) [395f64ed] START, CreateSnapshotVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageSizeInBytes = 1073741824, volumeFormat = COW, newImageId = 2f320136-56c6-42e5-a84d-17aa25fd35c0, newImageDescription = , imageId = ff10a123-d06d-471e-9069-0965cc0d9c8a, sourceImageGroupId = eac57127-4993-4bf9-aaf9-23a568198364), log id: 47b94344 >2014-08-11 16:37:38,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-30) [395f64ed] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 16:37:39,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-30) [395f64ed] FINISH, CreateSnapshotVDSCommand, return: 2f320136-56c6-42e5-a84d-17aa25fd35c0, log id: 47b94344 >2014-08-11 16:37:39,028 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-30) [395f64ed] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 495c75d1-8864-4035-b2f2-d795044f6d50 >2014-08-11 16:37:39,029 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-30) [395f64ed] CommandMultiAsyncTasks::AttachTask: Attaching task 89788d50-e1d9-48fd-85fc-2c70d57d76eb to command 495c75d1-8864-4035-b2f2-d795044f6d50. >2014-08-11 16:37:39,045 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-30) [395f64ed] Adding task 89788d50-e1d9-48fd-85fc-2c70d57d76eb (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:37:39,090 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 648eaef0-9e90-4c68-8062-b5d29fc3e7ab, imageSizeInBytes = 10240, volumeFormat = COW, newImageId = aab83df1-7ef0-4f28-911a-e931e5cbac87, newImageDescription = ), log id: 23850c58 >2014-08-11 16:37:39,091 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 16:37:39,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) FINISH, CreateImageVDSCommand, return: aab83df1-7ef0-4f28-911a-e931e5cbac87, log id: 23850c58 >2014-08-11 16:37:39,279 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-30) CommandMultiAsyncTasks::AttachTask: Attaching task 3ce85f07-2828-4934-a829-f9d35033facc to command 495c75d1-8864-4035-b2f2-d795044f6d50. >2014-08-11 16:37:39,296 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-30) Adding task 3ce85f07-2828-4934-a829-f9d35033facc (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:37:39,303 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) START, CreateImageVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = e726c7a9-d1ab-4baf-be78-f5c12f190d86, imageSizeInBytes = 1350565888, volumeFormat = RAW, newImageId = 37f973dd-66aa-4340-8136-34317071c56e, newImageDescription = ), log id: 568bd312 >2014-08-11 16:37:39,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-11 16:37:39,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) FINISH, CreateImageVDSCommand, return: 37f973dd-66aa-4340-8136-34317071c56e, log id: 568bd312 >2014-08-11 16:37:39,646 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-30) CommandMultiAsyncTasks::AttachTask: Attaching task 29a8516f-0453-4648-9278-28f6c18962b0 to command 495c75d1-8864-4035-b2f2-d795044f6d50. >2014-08-11 16:37:39,670 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-30) Adding task 29a8516f-0453-4648-9278-28f6c18962b0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:37:39,703 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) Correlation ID: 3cc2867b, Job ID: 1d7f98cc-c940-46ce-8ed2-fd2a4e6926ae, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'snapshot-taken-live' creation for VM 'vm1' was initiated by admin. >2014-08-11 16:37:39,704 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) BaseAsyncTask::startPollingTask: Starting to poll task 89788d50-e1d9-48fd-85fc-2c70d57d76eb. >2014-08-11 16:37:39,705 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) BaseAsyncTask::startPollingTask: Starting to poll task 3ce85f07-2828-4934-a829-f9d35033facc. >2014-08-11 16:37:39,705 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) BaseAsyncTask::startPollingTask: Starting to poll task 29a8516f-0453-4648-9278-28f6c18962b0. >2014-08-11 16:37:44,681 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-42) Polling and updating Async Tasks: 5 tasks, 3 tasks to poll now >2014-08-11 16:37:44,687 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) SPMAsyncTask::PollTask: Polling task 29a8516f-0453-4648-9278-28f6c18962b0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:37:44,729 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) BaseAsyncTask::onTaskEndSuccess: Task 29a8516f-0453-4648-9278-28f6c18962b0 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:37:44,729 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-42) Task with DB Task ID d084018a-3066-4ace-8398-b9deae165930 and VDSM Task ID 3ce85f07-2828-4934-a829-f9d35033facc is in state Polling. End action for command 495c75d1-8864-4035-b2f2-d795044f6d50 will proceed when all the entitys tasks are completed. >2014-08-11 16:37:44,730 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) SPMAsyncTask::PollTask: Polling task 89788d50-e1d9-48fd-85fc-2c70d57d76eb (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:37:44,737 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) BaseAsyncTask::onTaskEndSuccess: Task 89788d50-e1d9-48fd-85fc-2c70d57d76eb (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:37:44,738 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-42) Task with DB Task ID d084018a-3066-4ace-8398-b9deae165930 and VDSM Task ID 3ce85f07-2828-4934-a829-f9d35033facc is in state Polling. End action for command 495c75d1-8864-4035-b2f2-d795044f6d50 will proceed when all the entitys tasks are completed. >2014-08-11 16:37:44,738 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) SPMAsyncTask::PollTask: Polling task 3ce85f07-2828-4934-a829-f9d35033facc (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:37:44,745 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-42) BaseAsyncTask::onTaskEndSuccess: Task 3ce85f07-2828-4934-a829-f9d35033facc (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:37:44,746 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-42) CommandAsyncTask::endActionIfNecessary: All tasks of command 495c75d1-8864-4035-b2f2-d795044f6d50 has ended -> executing endAction >2014-08-11 16:37:44,746 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-42) CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: 495c75d1-8864-4035-b2f2-d795044f6d50): calling endAction . >2014-08-11 16:37:44,747 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-11 16:37:44,770 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-11 16:37:44,778 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00), log id: 4e383980 >2014-08-11 16:37:45,734 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-37) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from Up --> Paused >2014-08-11 16:37:45,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) Failed in SnapshotVDS method >2014-08-11 16:37:45,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) Command org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=48, mMessage=Snapshot failed]] >2014-08-11 16:37:45,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) HostName = vdshost2 >2014-08-11 16:37:45,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) Command SnapshotVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 >2014-08-11 16:37:45,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, SnapshotVDSCommand, log id: 4e383980 >2014-08-11 16:37:45,969 WARN [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Could not perform live snapshot due to error: VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48). VM will still be configured to the new created snapshot >2014-08-11 16:37:45,973 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) Correlation ID: 3cc2867b, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to create live snapshot 'snapshot-taken-live' for VM 'vm1'. VM restart is recommended. >2014-08-11 16:37:45,987 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-7) [395f64ed] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-11 16:37:45,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-7) [395f64ed] START, GetImageInfoVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, imageId = 2f320136-56c6-42e5-a84d-17aa25fd35c0), log id: 382fcdf7 >2014-08-11 16:37:46,011 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-7) [395f64ed] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@d6222f58, log id: 382fcdf7 >2014-08-11 16:37:46,030 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-7) Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 16:37:46,045 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) Correlation ID: 3cc2867b, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SnapshotVDS, error = Snapshot failed, code = 48 (Failed with error SNAPSHOT_FAILED and code 48) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:117) > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2009) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:391) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand$2.runInTransaction(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.performLiveSnapshot(CreateAllSnapshotsFromVmCommand.java:388) > at org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand.endVmCommand(CreateAllSnapshotsFromVmCommand.java:310) > at org.ovirt.engine.core.bll.VmCommand.endSuccessfully(VmCommand.java:308) > at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:613) > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:558) > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1912) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:210) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:149) > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:118) > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:489) > at org.ovirt.engine.core.bll.tasks.DecoratedCommand.endAction(DecoratedCommand.java:17) > at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:317) > at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:350) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:149) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.access$000(CommandAsyncTask.java:28) > at org.ovirt.engine.core.bll.tasks.CommandAsyncTask$1.run(CommandAsyncTask.java:109) > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Failed to complete snapshot 'snapshot-taken-live' creation for VM 'vm1'. >2014-08-11 16:37:46,050 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-11 16:37:46,051 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm hasn't succeeded, clearing tasks. >2014-08-11 16:37:46,062 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 29a8516f-0453-4648-9278-28f6c18962b0 >2014-08-11 16:37:46,063 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 29a8516f-0453-4648-9278-28f6c18962b0), log id: 34025b52 >2014-08-11 16:37:46,064 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=29a8516f-0453-4648-9278-28f6c18962b0), log id: 6b97f2b >2014-08-11 16:37:46,086 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, HSMClearTaskVDSCommand, log id: 6b97f2b >2014-08-11 16:37:46,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, SPMClearTaskVDSCommand, log id: 34025b52 >2014-08-11 16:37:46,095 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::removeTaskFromDB: Removed task 29a8516f-0453-4648-9278-28f6c18962b0 from DataBase >2014-08-11 16:37:46,096 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3ce85f07-2828-4934-a829-f9d35033facc >2014-08-11 16:37:46,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 3ce85f07-2828-4934-a829-f9d35033facc), log id: 3e981293 >2014-08-11 16:37:46,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=3ce85f07-2828-4934-a829-f9d35033facc), log id: 71eb90ff >2014-08-11 16:37:46,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, HSMClearTaskVDSCommand, log id: 71eb90ff >2014-08-11 16:37:46,159 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, SPMClearTaskVDSCommand, log id: 3e981293 >2014-08-11 16:37:46,171 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::removeTaskFromDB: Removed task 3ce85f07-2828-4934-a829-f9d35033facc from DataBase >2014-08-11 16:37:46,171 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 89788d50-e1d9-48fd-85fc-2c70d57d76eb >2014-08-11 16:37:46,171 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 89788d50-e1d9-48fd-85fc-2c70d57d76eb), log id: 48f59326 >2014-08-11 16:37:46,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=89788d50-e1d9-48fd-85fc-2c70d57d76eb), log id: 728fc935 >2014-08-11 16:37:48,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, HSMClearTaskVDSCommand, log id: 728fc935 >2014-08-11 16:37:48,231 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-7) FINISH, SPMClearTaskVDSCommand, log id: 48f59326 >2014-08-11 16:37:48,246 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-7) BaseAsyncTask::removeTaskFromDB: Removed task 89788d50-e1d9-48fd-85fc-2c70d57d76eb from DataBase >2014-08-11 16:37:48,246 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-7) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 495c75d1-8864-4035-b2f2-d795044f6d50 >2014-08-11 16:37:48,830 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) VM vm1 af1e4f01-60d5-4457-a842-ff15af8d9f00 moved from Paused --> Up >2014-08-11 16:39:04,457 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-61) Setting new tasks map. The map contains now 2 tasks >2014-08-11 16:45:34,212 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] Running command: ShutdownVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 16:45:34,218 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] Entered (VM vm1). >2014-08-11 16:45:34,219 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] Sending shutdown command for VM vm1. >2014-08-11 16:45:34,221 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=30, gracefully=true, reason=), log id: 2312a503 >2014-08-11 16:45:34,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=30, gracefully=true, reason=), log id: 12e3f461 >2014-08-11 16:45:34,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] FINISH, DestroyVDSCommand, log id: 12e3f461 >2014-08-11 16:45:34,246 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] FINISH, DestroyVmVDSCommand, return: PoweringDown, log id: 2312a503 >2014-08-11 16:45:34,263 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-37) [35d4f7d8] Correlation ID: 35d4f7d8, Job ID: 34cd456e-bebf-4c54-8658-1b1a144ca066, Call Stack: null, Custom Event ID: -1, Message: VM shutdown initiated by admin on VM vm1 (Host: vdshost2) (Reason: Not Specified). >2014-08-11 16:45:38,088 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-3) [2b25746b] Running command: ShutdownVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 16:45:38,089 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-3) [2b25746b] Entered (VM vm1). >2014-08-11 16:45:38,089 INFO [org.ovirt.engine.core.bll.ShutdownVmCommand] (org.ovirt.thread.pool-8-thread-3) [2b25746b] Cannot shutdown VM vm1, status is not up. Stopping instead. >2014-08-11 16:45:38,121 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-3) [6fcd53f0] Running command: StopVmCommand internal: true. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group VM_BASIC_OPERATIONS with role type USER >2014-08-11 16:45:38,124 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-3) [6fcd53f0] START, DestroyVmVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=0, gracefully=false, reason=), log id: 226c663e >2014-08-11 16:45:38,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-3) [6fcd53f0] START, DestroyVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vmId=af1e4f01-60d5-4457-a842-ff15af8d9f00, force=false, secondsToWait=0, gracefully=false, reason=), log id: 503351aa >2014-08-11 16:45:38,524 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-3) [6fcd53f0] FINISH, DestroyVDSCommand, log id: 503351aa >2014-08-11 16:45:38,538 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-3) [6fcd53f0] FINISH, DestroyVmVDSCommand, return: Down, log id: 226c663e >2014-08-11 16:45:38,541 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-42) [34eb9514] Running command: ProcessDownVmCommand internal: true. >2014-08-11 16:45:38,563 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) [6fcd53f0] Correlation ID: 6fcd53f0, Job ID: ff1e5626-5405-49a2-a025-b5611f871d29, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was powered off ungracefully by admin (Host: vdshost2) (Reason: Not Specified). >2014-08-11 16:45:45,283 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-8-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-11 16:45:45,284 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-49) [33a80c5b] Start running CanDoAction for command number 1/2 (Command type: RemoveVm) >2014-08-11 16:45:45,284 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-44) [4321da27] Start running CanDoAction for command number 2/2 (Command type: RemoveVm) >2014-08-11 16:45:45,287 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-44) [4321da27] Lock Acquired to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 16:45:45,287 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-49) [33a80c5b] Lock Acquired to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 16:45:45,298 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-49) [33a80c5b] Finish handling CanDoAction for command number 1/2 (Command type: RemoveVm) >2014-08-11 16:45:45,317 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-44) [4321da27] Finish handling CanDoAction for command number 2/2 (Command type: RemoveVm) >2014-08-11 16:45:45,413 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-31) [33a80c5b] Running command: RemoveVmCommand internal: false. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VMAction group DELETE_VM with role type USER >2014-08-11 16:45:45,414 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-31) [33a80c5b] START, SetVmStatusVDSCommand( vmId = 6ed6e66e-1a80-4538-845a-a54d6b573e65, status = ImageLocked, exit status = Normal), log id: 26787a0c >2014-08-11 16:45:45,419 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-31) [33a80c5b] FINISH, SetVmStatusVDSCommand, log id: 26787a0c >2014-08-11 16:45:45,430 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-31) [33a80c5b] Lock freed to object EngineLock [exclusiveLocks= key: 6ed6e66e-1a80-4538-845a-a54d6b573e65 value: VM >, sharedLocks= ] >2014-08-11 16:45:45,434 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-31) [13cbc90f] Running command: RemoveMemoryVolumesCommand internal: true. >2014-08-11 16:45:45,443 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-31) [3ca0c5d2] Running command: RemoveMemoryVolumesCommand internal: true. >2014-08-11 16:45:45,481 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-31) [2ea7247c] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: 6ed6e66e-1a80-4538-845a-a54d6b573e65 Type: VM >2014-08-11 16:45:45,486 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-31) [14b65637] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 16:45:45,508 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-31) [14b65637] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, imageGroupId = 6c20367c-d018-4df9-9735-f616b7b5dc89, postZeros = true, forceDelete = false), log id: 62d268bf >2014-08-11 16:45:45,735 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-31) [14b65637] FINISH, DeleteImageGroupVDSCommand, log id: 62d268bf >2014-08-11 16:45:45,782 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-31) [14b65637] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 100b01af-e349-40af-81f1-964ec3995059 >2014-08-11 16:45:45,783 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-31) [14b65637] CommandMultiAsyncTasks::AttachTask: Attaching task 9369a992-2b0b-4c96-ab05-50f70b637879 to command 100b01af-e349-40af-81f1-964ec3995059. >2014-08-11 16:45:45,797 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-31) [14b65637] Adding task 9369a992-2b0b-4c96-ab05-50f70b637879 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:45:45,889 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [14b65637] Correlation ID: 33a80c5b, Job ID: 302e39fc-eee0-4ca0-bd62-ba855697262f, Call Stack: null, Custom Event ID: -1, Message: VM vm2 was successfully removed. >2014-08-11 16:45:45,890 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-31) [14b65637] BaseAsyncTask::startPollingTask: Starting to poll task 9369a992-2b0b-4c96-ab05-50f70b637879. >2014-08-11 16:45:45,931 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-31) [4321da27] Running command: RemoveVmCommand internal: false. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VMAction group DELETE_VM with role type USER >2014-08-11 16:45:45,932 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-31) [4321da27] START, SetVmStatusVDSCommand( vmId = af1e4f01-60d5-4457-a842-ff15af8d9f00, status = ImageLocked, exit status = Normal), log id: c31cb73 >2014-08-11 16:45:45,934 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-31) [4321da27] FINISH, SetVmStatusVDSCommand, log id: c31cb73 >2014-08-11 16:45:45,939 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-31) [4321da27] Lock freed to object EngineLock [exclusiveLocks= key: af1e4f01-60d5-4457-a842-ff15af8d9f00 value: VM >, sharedLocks= ] >2014-08-11 16:45:45,948 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-31) [2a12ca46] Running command: RemoveMemoryVolumesCommand internal: true. >2014-08-11 16:45:45,950 INFO [org.ovirt.engine.core.bll.RemoveMemoryVolumesCommand] (org.ovirt.thread.pool-8-thread-31) [3b5a7db5] Running command: RemoveMemoryVolumesCommand internal: true. >2014-08-11 16:45:45,966 INFO [org.ovirt.engine.core.bll.RemoveAllVmImagesCommand] (org.ovirt.thread.pool-8-thread-31) [7ceface7] Running command: RemoveAllVmImagesCommand internal: true. Entities affected : ID: af1e4f01-60d5-4457-a842-ff15af8d9f00 Type: VM >2014-08-11 16:45:45,968 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-11 16:45:45,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = eac57127-4993-4bf9-aaf9-23a568198364, postZeros = false, forceDelete = false), log id: 7f6e7710 >2014-08-11 16:45:46,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] FINISH, DeleteImageGroupVDSCommand, log id: 7f6e7710 >2014-08-11 16:45:46,199 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command d1abd830-1a13-442f-8da9-a71ccdea1cc2 >2014-08-11 16:45:46,200 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] CommandMultiAsyncTasks::AttachTask: Attaching task 693a5527-3b26-42e5-b132-bd36cdb43a08 to command d1abd830-1a13-442f-8da9-a71ccdea1cc2. >2014-08-11 16:45:46,215 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] Adding task 693a5527-3b26-42e5-b132-bd36cdb43a08 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 16:45:46,273 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] Correlation ID: 4321da27, Job ID: b44cb7a3-7c01-4039-adc3-95ef50091246, Call Stack: null, Custom Event ID: -1, Message: VM vm1 was successfully removed. >2014-08-11 16:45:46,274 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-31) [2c85adcc] BaseAsyncTask::startPollingTask: Starting to poll task 693a5527-3b26-42e5-b132-bd36cdb43a08. >2014-08-11 16:45:54,765 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-88) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2014-08-11 16:45:54,779 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-88) SPMAsyncTask::PollTask: Polling task 693a5527-3b26-42e5-b132-bd36cdb43a08 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:45:54,823 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-88) BaseAsyncTask::onTaskEndSuccess: Task 693a5527-3b26-42e5-b132-bd36cdb43a08 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:45:54,824 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-88) CommandAsyncTask::endActionIfNecessary: All tasks of command d1abd830-1a13-442f-8da9-a71ccdea1cc2 has ended -> executing endAction >2014-08-11 16:45:54,824 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-88) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: d1abd830-1a13-442f-8da9-a71ccdea1cc2): calling endAction . >2014-08-11 16:45:54,825 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-88) SPMAsyncTask::PollTask: Polling task 9369a992-2b0b-4c96-ab05-50f70b637879 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-11 16:45:54,825 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-08-11 16:45:54,825 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-88) Finished polling Tasks, will poll again in 10 seconds. >2014-08-11 16:45:54,848 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-39) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-08-11 16:45:54,849 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-08-11 16:45:54,850 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-08-11 16:45:54,856 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-39) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 693a5527-3b26-42e5-b132-bd36cdb43a08 >2014-08-11 16:45:54,857 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 693a5527-3b26-42e5-b132-bd36cdb43a08), log id: 2ed50de4 >2014-08-11 16:45:54,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=693a5527-3b26-42e5-b132-bd36cdb43a08), log id: 25830bc1 >2014-08-11 16:45:54,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) FINISH, HSMClearTaskVDSCommand, log id: 25830bc1 >2014-08-11 16:45:54,919 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) FINISH, SPMClearTaskVDSCommand, log id: 2ed50de4 >2014-08-11 16:45:54,931 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-39) BaseAsyncTask::removeTaskFromDB: Removed task 693a5527-3b26-42e5-b132-bd36cdb43a08 from DataBase >2014-08-11 16:45:54,932 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity d1abd830-1a13-442f-8da9-a71ccdea1cc2 >2014-08-11 16:46:14,848 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task 9369a992-2b0b-4c96-ab05-50f70b637879 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 16:46:14,899 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-58) BaseAsyncTask::onTaskEndSuccess: Task 9369a992-2b0b-4c96-ab05-50f70b637879 (Parent Command RemoveVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 16:46:14,899 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-58) CommandAsyncTask::endActionIfNecessary: All tasks of command 100b01af-e349-40af-81f1-964ec3995059 has ended -> executing endAction >2014-08-11 16:46:14,900 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-58) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 100b01af-e349-40af-81f1-964ec3995059): calling endAction . >2014-08-11 16:46:14,900 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVm, executionIndex: 0 >2014-08-11 16:46:14,924 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (org.ovirt.thread.pool-8-thread-43) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmCommand >2014-08-11 16:46:14,924 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm completed, handling the result. >2014-08-11 16:46:14,925 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVm succeeded, clearing tasks. >2014-08-11 16:46:14,932 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 9369a992-2b0b-4c96-ab05-50f70b637879 >2014-08-11 16:46:14,932 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = 9369a992-2b0b-4c96-ab05-50f70b637879), log id: 4df92b4a >2014-08-11 16:46:14,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=9369a992-2b0b-4c96-ab05-50f70b637879), log id: 21892f44 >2014-08-11 16:46:14,993 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) FINISH, HSMClearTaskVDSCommand, log id: 21892f44 >2014-08-11 16:46:14,994 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-43) FINISH, SPMClearTaskVDSCommand, log id: 4df92b4a >2014-08-11 16:46:15,007 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-43) BaseAsyncTask::removeTaskFromDB: Removed task 9369a992-2b0b-4c96-ab05-50f70b637879 from DataBase >2014-08-11 16:46:15,007 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-43) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 100b01af-e349-40af-81f1-964ec3995059 >2014-08-11 16:47:04,465 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-81) Setting new tasks map. The map contains now 3 tasks >2014-08-11 16:47:34,467 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-84) Setting new tasks map. The map contains now 2 tasks >2014-08-11 17:09:49,117 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (http--0.0.0.0-8080-4) [1c94cb41] Lock Acquired to object EngineLock [exclusiveLocks= key: 41ddf26d-701b-4e99-843c-16db1a5dd84c value: STORAGE >, sharedLocks= key: 9e763f98-5d93-4677-b9ac-f0b5504c123f value: POOL >] >2014-08-11 17:09:49,226 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 41ddf26d-701b-4e99-843c-16db1a5dd84c Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-08-11 17:09:49,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] START, DeactivateStorageDomainVDSCommand( storagePoolId = 9e763f98-5d93-4677-b9ac-f0b5504c123f, ignoreFailoverLimit = false, storageDomainId = 41ddf26d-701b-4e99-843c-16db1a5dd84c, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 566b500f >2014-08-11 17:09:51,258 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] FINISH, DeactivateStorageDomainVDSCommand, log id: 566b500f >2014-08-11 17:09:51,259 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] Lock freed to object EngineLock [exclusiveLocks= key: 41ddf26d-701b-4e99-843c-16db1a5dd84c value: STORAGE >, sharedLocks= key: 9e763f98-5d93-4677-b9ac-f0b5504c123f value: POOL >] >2014-08-11 17:09:51,265 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-15) After deactivate treatment vds: vdshost1,pool dc1 >2014-08-11 17:09:51,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-15) START, ConnectStoragePoolVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, vdsId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, storagePoolId = 9e763f98-5d93-4677-b9ac-f0b5504c123f, masterVersion = 1), log id: 745a1099 >2014-08-11 17:09:51,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-15) FINISH, ConnectStoragePoolVDSCommand, log id: 745a1099 >2014-08-11 17:09:51,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] START, DisconnectStorageServerVDSCommand(HostName = vdshost1, HostId = ccc5aec0-8b3c-4089-89ea-52185b3f390b, storagePoolId = 9e763f98-5d93-4677-b9ac-f0b5504c123f, storageType = ISCSI, connectionList = []), log id: 254429bc >2014-08-11 17:09:52,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 254429bc >2014-08-11 17:09:52,278 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] Domain 41ddf26d-701b-4e99-843c-16db1a5dd84c will remain in PreparingForMaintenance status until deactivated on all hosts >2014-08-11 17:09:52,319 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-26) [1c94cb41] Correlation ID: 1c94cb41, Job ID: c98c76ce-7439-47b1-a0a2-4989b2432b09, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi_sd1 (Data Center dc1) was deactivated by admin >2014-08-11 17:09:55,805 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-4) Adding domain 41ddf26d-701b-4e99-843c-16db1a5dd84c to the domains in maintenance cache >2014-08-11 17:10:00,743 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (http--0.0.0.0-8080-4) [23443533] Lock Acquired to object EngineLock [exclusiveLocks= key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: POOL >] >2014-08-11 17:10:00,861 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN >2014-08-11 17:10:00,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] START, DeactivateStorageDomainVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 585bc83 >2014-08-11 17:10:01,547 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-18) Moving domain 41ddf26d-701b-4e99-843c-16db1a5dd84c to maintenance >2014-08-11 17:10:02,894 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] FINISH, DeactivateStorageDomainVDSCommand, log id: 585bc83 >2014-08-11 17:10:02,895 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] Lock freed to object EngineLock [exclusiveLocks= key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >, sharedLocks= key: 45dd52dc-0e1c-4321-8a19-f4a0b735410f value: POOL >] >2014-08-11 17:10:02,898 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-40) After deactivate treatment vds: vdshost2,pool dc2 >2014-08-11 17:10:02,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-40) START, ConnectStoragePoolVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, vdsId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, masterVersion = 1), log id: 242a215b >2014-08-11 17:10:03,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-40) FINISH, ConnectStoragePoolVDSCommand, log id: 242a215b >2014-08-11 17:10:03,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] START, DisconnectStorageServerVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, storageType = ISCSI, connectionList = []), log id: 7a72a6a7 >2014-08-11 17:10:03,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] FINISH, DisconnectStorageServerVDSCommand, return: {}, log id: 7a72a6a7 >2014-08-11 17:10:03,959 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [23443533] Domain a499025c-18cf-410b-9163-29fc62d44ba4 will remain in PreparingForMaintenance status until deactivated on all hosts >2014-08-11 17:10:04,045 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [23443533] Correlation ID: 23443533, Job ID: 017f880c-8651-4752-98b3-65e9cea26a48, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi_sd2 (Data Center dc2) was deactivated by admin >2014-08-11 17:10:07,839 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-8) Adding domain a499025c-18cf-410b-9163-29fc62d44ba4 to the domains in maintenance cache >2014-08-11 17:10:14,063 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-44) Moving domain a499025c-18cf-410b-9163-29fc62d44ba4 to maintenance >2014-08-11 17:10:42,839 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (http--0.0.0.0-8080-4) [5d66d361] Lock Acquired to object EngineLock [exclusiveLocks= key: 41ddf26d-701b-4e99-843c-16db1a5dd84c value: STORAGE >, sharedLocks= ] >2014-08-11 17:10:42,887 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (org.ovirt.thread.pool-8-thread-18) [5d66d361] Running command: ForceRemoveStorageDomainCommand internal: false. Entities affected : ID: 41ddf26d-701b-4e99-843c-16db1a5dd84c Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN >2014-08-11 17:10:42,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-18) [5d66d361] START, DetachStorageDomainVDSCommand( storagePoolId = 9e763f98-5d93-4677-b9ac-f0b5504c123f, ignoreFailoverLimit = false, storageDomainId = 41ddf26d-701b-4e99-843c-16db1a5dd84c, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = -1, force = true), log id: 392de711 >2014-08-11 17:10:42,900 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-18) [5d66d361] FINISH, DetachStorageDomainVDSCommand, log id: 392de711 >2014-08-11 17:10:42,972 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-18) [5d66d361] Correlation ID: 5d66d361, Job ID: 97ec56c8-6dda-4af0-9ff6-3dd059d28b5f, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi_sd1 was forcibly removed by admin >2014-08-11 17:10:42,980 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (org.ovirt.thread.pool-8-thread-18) [5d66d361] Lock freed to object EngineLock [exclusiveLocks= key: 41ddf26d-701b-4e99-843c-16db1a5dd84c value: STORAGE >, sharedLocks= ] >2014-08-11 17:10:57,341 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-14) Removing domain 41ddf26d-701b-4e99-843c-16db1a5dd84c from the domains in maintenance cache >2014-08-11 17:10:59,006 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (http--0.0.0.0-8080-4) [7e4fa92a] Lock Acquired to object EngineLock [exclusiveLocks= key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >, sharedLocks= ] >2014-08-11 17:10:59,089 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (org.ovirt.thread.pool-8-thread-16) [7e4fa92a] Running command: ForceRemoveStorageDomainCommand internal: false. Entities affected : ID: a499025c-18cf-410b-9163-29fc62d44ba4 Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN >2014-08-11 17:10:59,090 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-16) [7e4fa92a] START, DetachStorageDomainVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = a499025c-18cf-410b-9163-29fc62d44ba4, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = -1, force = true), log id: cfa0682 >2014-08-11 17:10:59,113 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-16) [7e4fa92a] FINISH, DetachStorageDomainVDSCommand, log id: cfa0682 >2014-08-11 17:10:59,189 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-16) [7e4fa92a] Correlation ID: 7e4fa92a, Job ID: 802d6b73-eb86-476a-881c-0d525dad5d8b, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iscsi_sd2 was forcibly removed by admin >2014-08-11 17:10:59,206 INFO [org.ovirt.engine.core.bll.storage.ForceRemoveStorageDomainCommand] (org.ovirt.thread.pool-8-thread-16) [7e4fa92a] Lock freed to object EngineLock [exclusiveLocks= key: a499025c-18cf-410b-9163-29fc62d44ba4 value: STORAGE >, sharedLocks= ] >2014-08-11 17:11:08,775 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-37) Removing domain a499025c-18cf-410b-9163-29fc62d44ba4 from the domains in maintenance cache >2014-08-11 17:11:11,026 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (http--0.0.0.0-8080-4) [5571ab6d] Lock Acquired to object EngineLock [exclusiveLocks= key: 76bbb9d4-d276-4beb-9fc0-cabc895261a9 value: TEMPLATE >, sharedLocks= ] >2014-08-11 17:11:11,165 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-24) [5571ab6d] Running command: RemoveVmTemplateCommand internal: false. Entities affected : ID: 76bbb9d4-d276-4beb-9fc0-cabc895261a9 Type: VmTemplateAction group DELETE_TEMPLATE with role type USER >2014-08-11 17:11:11,202 INFO [org.ovirt.engine.core.bll.RemoveAllVmTemplateImageTemplatesCommand] (org.ovirt.thread.pool-8-thread-24) [5571ab6d] Running command: RemoveAllVmTemplateImageTemplatesCommand internal: true. Entities affected : ID: 76bbb9d4-d276-4beb-9fc0-cabc895261a9 Type: VmTemplate >2014-08-11 17:11:11,234 INFO [org.ovirt.engine.core.bll.RemoveTemplateSnapshotCommand] (org.ovirt.thread.pool-8-thread-24) [6d44e39] Running command: RemoveTemplateSnapshotCommand internal: true. Entities affected : ID: 9aac3d1c-aca8-47f8-95a9-4d9996313f87 Type: Storage >2014-08-11 17:11:11,259 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-24) [6d44e39] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 9aac3d1c-aca8-47f8-95a9-4d9996313f87, imageGroupId = 5b466d6e-7800-48eb-986f-0c612411e880, postZeros = false, forceDelete = false), log id: 13f304b9 >2014-08-11 17:11:11,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-24) [6d44e39] FINISH, DeleteImageGroupVDSCommand, log id: 13f304b9 >2014-08-11 17:11:11,457 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-24) [6d44e39] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 76578f0b-68cf-41c1-aea7-90d089bac7ce >2014-08-11 17:11:11,457 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-24) [6d44e39] CommandMultiAsyncTasks::AttachTask: Attaching task a30a3259-1432-4b0e-a327-86939ec5c209 to command 76578f0b-68cf-41c1-aea7-90d089bac7ce. >2014-08-11 17:11:11,473 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-24) [6d44e39] Adding task a30a3259-1432-4b0e-a327-86939ec5c209 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 17:11:11,515 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-24) [6d44e39] Correlation ID: 5571ab6d, Job ID: b0be1f2a-2733-456e-b0fa-0655e6322abb, Call Stack: null, Custom Event ID: -1, Message: Removal of Template vm1_template was initiated by admin. >2014-08-11 17:11:11,516 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-24) [6d44e39] BaseAsyncTask::startPollingTask: Starting to poll task a30a3259-1432-4b0e-a327-86939ec5c209. >2014-08-11 17:11:14,938 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-08-11 17:11:14,943 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) SPMAsyncTask::PollTask: Polling task a30a3259-1432-4b0e-a327-86939ec5c209 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 17:11:14,957 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) BaseAsyncTask::onTaskEndSuccess: Task a30a3259-1432-4b0e-a327-86939ec5c209 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 17:11:14,958 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) CommandAsyncTask::endActionIfNecessary: All tasks of command 76578f0b-68cf-41c1-aea7-90d089bac7ce has ended -> executing endAction >2014-08-11 17:11:14,959 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 76578f0b-68cf-41c1-aea7-90d089bac7ce): calling endAction . >2014-08-11 17:11:14,960 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVmTemplate, executionIndex: 0 >2014-08-11 17:11:14,974 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-39) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmTemplateCommand >2014-08-11 17:11:14,980 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-39) Lock freed to object EngineLock [exclusiveLocks= key: 76bbb9d4-d276-4beb-9fc0-cabc895261a9 value: TEMPLATE >, sharedLocks= ] >2014-08-11 17:11:14,999 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-39) Correlation ID: 5571ab6d, Call Stack: null, Custom Event ID: -1, Message: Removal of Template vm1_template has been completed. >2014-08-11 17:11:14,999 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate completed, handling the result. >2014-08-11 17:11:15,000 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate succeeded, clearing tasks. >2014-08-11 17:11:15,007 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-39) SPMAsyncTask::ClearAsyncTask: Attempting to clear task a30a3259-1432-4b0e-a327-86939ec5c209 >2014-08-11 17:11:15,007 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = a30a3259-1432-4b0e-a327-86939ec5c209), log id: 2ed4f392 >2014-08-11 17:11:15,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=a30a3259-1432-4b0e-a327-86939ec5c209), log id: 1ec30e43 >2014-08-11 17:11:15,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) FINISH, HSMClearTaskVDSCommand, log id: 1ec30e43 >2014-08-11 17:11:15,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-39) FINISH, SPMClearTaskVDSCommand, log id: 2ed4f392 >2014-08-11 17:11:15,032 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-39) BaseAsyncTask::removeTaskFromDB: Removed task a30a3259-1432-4b0e-a327-86939ec5c209 from DataBase >2014-08-11 17:11:15,032 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 76578f0b-68cf-41c1-aea7-90d089bac7ce >2014-08-11 17:11:21,359 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (http--0.0.0.0-8080-4) [44599c3] Lock Acquired to object EngineLock [exclusiveLocks= key: e0914c91-ed30-487a-8be9-ed75a7876024 value: TEMPLATE >, sharedLocks= ] >2014-08-11 17:11:21,415 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-16) [44599c3] Running command: RemoveVmTemplateCommand internal: false. Entities affected : ID: e0914c91-ed30-487a-8be9-ed75a7876024 Type: VmTemplateAction group DELETE_TEMPLATE with role type USER >2014-08-11 17:11:21,435 INFO [org.ovirt.engine.core.bll.RemoveAllVmTemplateImageTemplatesCommand] (org.ovirt.thread.pool-8-thread-16) [44599c3] Running command: RemoveAllVmTemplateImageTemplatesCommand internal: true. Entities affected : ID: e0914c91-ed30-487a-8be9-ed75a7876024 Type: VmTemplate >2014-08-11 17:11:21,440 INFO [org.ovirt.engine.core.bll.RemoveTemplateSnapshotCommand] (org.ovirt.thread.pool-8-thread-16) [530b47b1] Running command: RemoveTemplateSnapshotCommand internal: true. Entities affected : ID: 565441d8-3f84-4c1e-8f78-90e903087208 Type: Storage >2014-08-11 17:11:21,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-16) [530b47b1] START, DeleteImageGroupVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, storageDomainId = 565441d8-3f84-4c1e-8f78-90e903087208, imageGroupId = 13f1b63a-8114-4c22-b626-434b1512c732, postZeros = false, forceDelete = false), log id: 7bd4afab >2014-08-11 17:11:21,548 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-16) [530b47b1] FINISH, DeleteImageGroupVDSCommand, log id: 7bd4afab >2014-08-11 17:11:21,558 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-16) [530b47b1] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 5d1b112c-a1c1-41e1-8f5b-9a6712c26416 >2014-08-11 17:11:21,558 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-16) [530b47b1] CommandMultiAsyncTasks::AttachTask: Attaching task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4 to command 5d1b112c-a1c1-41e1-8f5b-9a6712c26416. >2014-08-11 17:11:21,574 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-16) [530b47b1] Adding task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-11 17:11:21,607 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-16) [530b47b1] Correlation ID: 44599c3, Job ID: 2758ab24-d3e8-44bd-9a66-80a6e6702529, Call Stack: null, Custom Event ID: -1, Message: Removal of Template vm1_template2 was initiated by admin. >2014-08-11 17:11:21,608 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-16) [530b47b1] BaseAsyncTask::startPollingTask: Starting to poll task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4. >2014-08-11 17:11:24,959 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-60) Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-08-11 17:11:24,965 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-60) SPMAsyncTask::PollTask: Polling task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-11 17:11:24,982 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-60) BaseAsyncTask::onTaskEndSuccess: Task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4 (Parent Command RemoveVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-11 17:11:24,983 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-60) CommandAsyncTask::endActionIfNecessary: All tasks of command 5d1b112c-a1c1-41e1-8f5b-9a6712c26416 has ended -> executing endAction >2014-08-11 17:11:24,984 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-60) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 5d1b112c-a1c1-41e1-8f5b-9a6712c26416): calling endAction . >2014-08-11 17:11:24,984 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-19) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction RemoveVmTemplate, executionIndex: 0 >2014-08-11 17:11:24,999 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-19) Ending command successfully: org.ovirt.engine.core.bll.RemoveVmTemplateCommand >2014-08-11 17:11:25,001 INFO [org.ovirt.engine.core.bll.RemoveVmTemplateCommand] (org.ovirt.thread.pool-8-thread-19) Lock freed to object EngineLock [exclusiveLocks= key: e0914c91-ed30-487a-8be9-ed75a7876024 value: TEMPLATE >, sharedLocks= ] >2014-08-11 17:11:25,016 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-19) Correlation ID: 44599c3, Call Stack: null, Custom Event ID: -1, Message: Removal of Template vm1_template2 has been completed. >2014-08-11 17:11:25,016 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-19) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate completed, handling the result. >2014-08-11 17:11:25,017 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-19) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveVmTemplate succeeded, clearing tasks. >2014-08-11 17:11:25,024 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-19) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4 >2014-08-11 17:11:25,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-19) START, SPMClearTaskVDSCommand( storagePoolId = 45dd52dc-0e1c-4321-8a19-f4a0b735410f, ignoreFailoverLimit = false, taskId = c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4), log id: 523a79d >2014-08-11 17:11:25,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-19) START, HSMClearTaskVDSCommand(HostName = vdshost2, HostId = eefdcea3-0f2e-4cbc-9b7c-540dc1f0e5b8, taskId=c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4), log id: 67d1370d >2014-08-11 17:11:25,041 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-19) FINISH, HSMClearTaskVDSCommand, log id: 67d1370d >2014-08-11 17:11:25,042 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-19) FINISH, SPMClearTaskVDSCommand, log id: 523a79d >2014-08-11 17:11:25,057 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-19) BaseAsyncTask::removeTaskFromDB: Removed task c79e4eca-373f-4ffb-81e9-2fb9cf84f5d4 from DataBase >2014-08-11 17:11:25,058 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-19) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 5d1b112c-a1c1-41e1-8f5b-9a6712c26416 >2014-08-11 17:12:34,478 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-58) Setting new tasks map. The map contains now 2 tasks
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1128776
: 925778