Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 634294 Details for
Bug 868887
[Storage] [Clone VM from snapshot] VM stuck in image lock status forever after restarting vdsm daemon while VM is being cloned from snapshot.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine log specified in comment 11
engine_down_iptables.log (text/x-log), 175.35 KB, created by
Vered Volansky
on 2012-10-27 17:45:08 UTC
(
hide
)
Description:
engine log specified in comment 11
Filename:
MIME Type:
Creator:
Vered Volansky
Created:
2012-10-27 17:45:08 UTC
Size:
175.35 KB
patch
obsolete
>2012-10-25 15:52:25,102 WARN [org.ovirt.engine.core.dal.dbbroker.DbFacadeLocator] (MSC service thread 1-1) /etc/ovirt-engine/engine.conf file is not found. Please check your engine installation. Default values will be used >2012-10-25 15:52:25,361 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Start time: 10/25/12 3:52 PM >2012-10-25 15:52:25,429 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CAEngineKey >2012-10-25 15:52:25,430 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: CbcCheckOnVdsChange >2012-10-25 15:52:25,435 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,437 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,438 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property CertificatePassword will be used encrypted value >2012-10-25 15:52:25,445 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,447 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,448 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property AdminPassword will be used encrypted value >2012-10-25 15:52:25,449 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ENGINEEARLib >2012-10-25 15:52:25,455 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,456 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,457 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property LocalAdminPassword will be used encrypted value >2012-10-25 15:52:25,465 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: MinimalETLVersion >2012-10-25 15:52:25,473 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: ScriptsPath >2012-10-25 15:52:25,477 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (MSC service thread 1-1) Could not find enum value for option: SQLServerI18NPrefix >2012-10-25 15:52:25,483 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,485 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (MSC service thread 1-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:52:25,486 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-10-25 15:52:25,597 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (MSC service thread 1-1) Could not parse option AutoRecoveryAllowedTypes value. >2012-10-25 15:52:25,604 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VDSBrokerFrontend: 10/25/12 3:52 PM >2012-10-25 15:52:25,609 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) CpuFlagsManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,610 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-1) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-10-25 15:52:25,623 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AuditLogCleanupManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,626 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) TagsDirector initialization >2012-10-25 15:52:25,647 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-1) Tag root added to tree >2012-10-25 15:52:25,653 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) TagsDirector: 10/25/12 3:52 PM >2012-10-25 15:52:25,659 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) IsoDomainListSyncronizer: 10/25/12 3:52 PM >2012-10-25 15:52:25,674 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) InitHandlers: 10/25/12 3:52 PM >2012-10-25 15:52:25,681 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-1) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-10-25 15:52:25,683 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ErrorTranslator: 10/25/12 3:52 PM >2012-10-25 15:52:25,684 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) VdsErrorTranslator: 10/25/12 3:52 PM >2012-10-25 15:52:25,685 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) Mark uncompleted jobs as UNKNOWN: 10/25/12 3:52 PM >2012-10-25 15:52:25,729 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) JobRepositoryCleanupManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,733 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) AutoRecoveryManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,737 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-1) ExecutionMessageDirector: 10/25/12 3:52 PM >2012-10-25 15:52:25,749 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-1) UsersDomainsCacheManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,753 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-5) InitResourceManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,755 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-5) ResourceManager::ResourceManager::Entered >2012-10-25 15:52:25,852 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-5) Eneterd VdsManager:constructor >2012-10-25 15:52:25,853 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-5) vdsBroker(mars-vdsi.tlv.redhat.com,54,321) >2012-10-25 15:52:25,870 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (MSC service thread 1-1) DbUserCacheManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,891 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-10-25 15:52:25,923 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-5) ResourceManager::AddVds - VDS 5d4237fe-0abe-11e2-bd6b-3c970e182f75 was added to the Resource Manager >2012-10-25 15:52:25,925 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-5) Eneterd VdsManager:constructor >2012-10-25 15:52:25,926 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-5) vdsBroker(pluto-vdsb.eng.lab.tlv.redhat.com,54,321) >2012-10-25 15:52:25,930 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-5) ResourceManager::AddVds - VDS 65dd451a-1e88-11e2-92df-3c970e182f75 was added to the Resource Manager >2012-10-25 15:52:25,960 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (MSC service thread 1-5) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-10-25 15:52:25,961 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-5) AsyncTaskManager: 10/25/12 3:52 PM >2012-10-25 15:52:25,963 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-5) VdsLoadBalancer: 10/25/12 3:52 PM >2012-10-25 15:52:25,965 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-10-thread-1) MacPoolManager started: 10/25/12 3:52 PM >2012-10-25 15:52:26,026 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-10-thread-1) MacPoolManager finished: 10/25/12 3:52 PM >2012-10-25 15:52:27,939 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) Initializing Host: pluto-vdsb.eng.lab.tlv.redhat.com >2012-10-25 15:52:28,207 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: UNASSIGNED not exist in string table >2012-10-25 15:52:28,208 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2012-10-25 15:52:28,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-10-25 15:52:28,210 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STOPPED not exist in string table >2012-10-25 15:52:28,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_STARTED not exist in string table >2012-10-25 15:52:28,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table >2012-10-25 15:52:28,217 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-10-25 15:52:28,217 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-10-25 15:52:28,218 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-10-25 15:52:28,219 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-10-25 15:52:28,220 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2012-10-25 15:52:28,223 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2012-10-25 15:52:28,546 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: h2 >2012-10-25 15:52:28,643 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [911f38a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 5d4237fe-0abe-11e2-bd6b-3c970e182f75 Type: VDS >2012-10-25 15:52:35,980 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-12) [2d59e0ae] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 5fc9dbd7-9595-4192-97f1-4d2b2e24c380 Type: StoragePool >2012-10-25 15:52:36,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [2d59e0ae] hostFromVds::selectedVds - h2, spmStatus SPM, storage pool dc1 >2012-10-25 15:52:36,132 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [2d59e0ae] Initialize Irs proxy from vds: mars-vdsi.tlv.redhat.com >2012-10-25 15:52:36,236 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-15) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 47af671 >2012-10-25 15:52:36,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-15) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 5fc9dbd7-9595-4192-97f1-4d2b2e24c380 >2012-10-25 15:52:36,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-15) START, HSMGetAllTasksInfoVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75), log id: 8434bd3 >2012-10-25 15:52:36,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-15) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 8434bd3 >2012-10-25 15:52:36,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-15) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 47af671 >2012-10-25 15:52:36,424 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-15) Discovered no tasks on Storage Pool dc1 >2012-10-25 15:53:04,315 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (http--0.0.0.0-8700-1) Checking if user admin@internal is an admin, result true >2012-10-25 15:53:04,317 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (http--0.0.0.0-8700-1) Running command: LoginAdminUserCommand internal: false. >2012-10-25 15:53:04,407 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,408 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,409 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (http--0.0.0.0-8700-1) Failed to decrypt value for property LocalAdminPassword will be used encrypted value >2012-10-25 15:53:04,410 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,411 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,412 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (http--0.0.0.0-8700-1) Failed to decrypt value for property LocalAdminPassword will be used encrypted value >2012-10-25 15:53:04,412 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,413 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,414 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (http--0.0.0.0-8700-1) Failed to decrypt value for property LocalAdminPassword will be used encrypted value >2012-10-25 15:53:04,414 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Can't load keystore from file "/usr/share/jboss-as-7.1.1.Final/keys/engine.p12". FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,415 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (http--0.0.0.0-8700-1) Failed to decrypt java.io.FileNotFoundException: keys/engine.p12 (No such file or directory) >2012-10-25 15:53:04,416 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (http--0.0.0.0-8700-1) Failed to decrypt value for property LocalAdminPassword will be used encrypted value >2012-10-25 15:53:05,127 ERROR [org.ovirt.engine.core.ServletUtils] (http--0.0.0.0-8700-1) Can't read file "/usr/share/ovirt-engine/docs/DocumentationPath.csv" for request "/docs/DocumentationPath.csv", will send a 404 error response. >2012-10-25 15:53:30,288 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (http--0.0.0.0-8700-1) [3eb14ecb] The message key AddVmFromSnapshot is missing from bundles/ExecutionMessages >2012-10-25 15:53:30,441 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (http--0.0.0.0-8700-1) [3eb14ecb] Lock Acquired to object EngineLock [exclusiveLocks= key: 39299965-f964-44f4-b278-54f258c31ae7 value: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >, sharedLocks= ] >2012-10-25 15:53:30,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (http--0.0.0.0-8700-1) START, IsValidVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 522cffad >2012-10-25 15:53:30,635 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (http--0.0.0.0-8700-1) FINISH, IsValidVDSCommand, return: true, log id: 522cffad >2012-10-25 15:53:30,673 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (http--0.0.0.0-8700-1) Running command: AddVmFromSnapshotCommand internal: false. Entities affected : ID: 90d71c8e-fa4b-11e1-bf96-2477037a2acc Type: VdsGroups, ID: acc3e321-f8cb-46fa-86d8-13c2d27670d2 Type: VM >2012-10-25 15:53:30,679 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (http--0.0.0.0-8700-1) START, IsValidVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7dac964b >2012-10-25 15:53:30,682 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (http--0.0.0.0-8700-1) FINISH, IsValidVDSCommand, return: true, log id: 7dac964b >2012-10-25 15:53:30,724 INFO [org.ovirt.engine.core.bll.MacPoolManager] (http--0.0.0.0-8700-1) MacPoolManager::allocateNewMac entered >2012-10-25 15:53:30,725 INFO [org.ovirt.engine.core.bll.MacPoolManager] (http--0.0.0.0-8700-1) MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:01:b7 >2012-10-25 15:53:30,773 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (http--0.0.0.0-8700-1) Lock freed to object EngineLock [exclusiveLocks= key: 39299965-f964-44f4-b278-54f258c31ae7 value: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >, sharedLocks= ] >2012-10-25 15:53:30,784 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (http--0.0.0.0-8700-1) Locking VM(id = 4fcd9c56-4727-44f7-a9cb-2051f064baf2) with compensation. >2012-10-25 15:53:30,795 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8700-1) START, SetVmStatusVDSCommand( vmId = 4fcd9c56-4727-44f7-a9cb-2051f064baf2, status = ImageLocked), log id: 4490eb72 >2012-10-25 15:53:30,816 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (http--0.0.0.0-8700-1) FINISH, SetVmStatusVDSCommand, log id: 4490eb72 >2012-10-25 15:53:30,873 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (http--0.0.0.0-8700-1) [796d917a] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: ce351396-4837-435f-b821-1c6af2506fb3 Type: Storage >2012-10-25 15:53:30,887 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [796d917a] START, CopyImageVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 4bc9f209-c46b-4c2a-8c8b-8bbde6de968e, imageId = 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27, dstImageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, vmId = 4fcd9c56-4727-44f7-a9cb-2051f064baf2, dstImageId = 0052e2d0-4e7e-4896-908f-168358b34696, imageDescription = , dstStorageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, copyVolumeType = LeafVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false), log id: 299e27bd >2012-10-25 15:53:30,889 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [796d917a] -- CopyImageVDSCommand::ExecuteIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2012-10-25 15:53:30,890 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [796d917a] -- copyImage parameters: > sdUUID=ce351396-4837-435f-b821-1c6af2506fb3 > spUUID=5fc9dbd7-9595-4192-97f1-4d2b2e24c380 > vmGUID=4fcd9c56-4727-44f7-a9cb-2051f064baf2 > srcImageGUID=4bc9f209-c46b-4c2a-8c8b-8bbde6de968e > srcVolUUID=6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 > dstImageGUID=937aff09-1549-409a-af9b-316892e40ef2 > dstVolUUID=0052e2d0-4e7e-4896-908f-168358b34696 > descr= > >2012-10-25 15:53:31,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [796d917a] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 299e27bd >2012-10-25 15:53:31,519 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (http--0.0.0.0-8700-1) [796d917a] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 >2012-10-25 15:53:31,522 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [796d917a] EntityMultiAsyncTasks::AttachTask: Attaching task e1e620ff-2618-492d-b324-24b5ae736483 to entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27. >2012-10-25 15:53:31,532 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (http--0.0.0.0-8700-1) [796d917a] Adding task e1e620ff-2618-492d-b324-24b5ae736483 to DataBase >2012-10-25 15:53:31,626 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (http--0.0.0.0-8700-1) [796d917a] Adding task e1e620ff-2618-492d-b324-24b5ae736483 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:53:31,705 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (http--0.0.0.0-8700-1) [4e2040fd] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: ce351396-4837-435f-b821-1c6af2506fb3 Type: Storage >2012-10-25 15:53:31,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [4e2040fd] START, CopyImageVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 8e0d5c31-0b12-4747-b1d3-857a64f4f4c6, imageId = 2928f846-e49b-4492-8d38-9f05dff5528e, dstImageGroupId = 688e942b-675c-4754-ae2b-8de04dc14f36, vmId = 4fcd9c56-4727-44f7-a9cb-2051f064baf2, dstImageId = 3c491eba-d993-4b1e-add2-91c3f6686a97, imageDescription = , dstStorageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, copyVolumeType = LeafVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false), log id: 5262b644 >2012-10-25 15:53:31,714 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [4e2040fd] -- CopyImageVDSCommand::ExecuteIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2012-10-25 15:53:31,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [4e2040fd] -- copyImage parameters: > sdUUID=ce351396-4837-435f-b821-1c6af2506fb3 > spUUID=5fc9dbd7-9595-4192-97f1-4d2b2e24c380 > vmGUID=4fcd9c56-4727-44f7-a9cb-2051f064baf2 > srcImageGUID=8e0d5c31-0b12-4747-b1d3-857a64f4f4c6 > srcVolUUID=2928f846-e49b-4492-8d38-9f05dff5528e > dstImageGUID=688e942b-675c-4754-ae2b-8de04dc14f36 > dstVolUUID=3c491eba-d993-4b1e-add2-91c3f6686a97 > descr= > >2012-10-25 15:53:32,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [4e2040fd] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 5262b644 >2012-10-25 15:53:32,545 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (http--0.0.0.0-8700-1) [4e2040fd] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 2928f846-e49b-4492-8d38-9f05dff5528e >2012-10-25 15:53:32,547 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [4e2040fd] EntityMultiAsyncTasks::AttachTask: Attaching task 9bea6520-6c62-4225-9438-6212d4d5bf13 to entity 2928f846-e49b-4492-8d38-9f05dff5528e. >2012-10-25 15:53:32,548 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (http--0.0.0.0-8700-1) [4e2040fd] Adding task 9bea6520-6c62-4225-9438-6212d4d5bf13 to DataBase >2012-10-25 15:53:32,636 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (http--0.0.0.0-8700-1) [4e2040fd] Adding task 9bea6520-6c62-4225-9438-6212d4d5bf13 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:53:32,690 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (http--0.0.0.0-8700-1) [5455f8bb] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: ce351396-4837-435f-b821-1c6af2506fb3 Type: Storage >2012-10-25 15:53:32,693 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [5455f8bb] START, CopyImageVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 1d6ba406-c73d-4e8b-87e5-e22720bdd30e, imageId = e4f244e0-42ba-45c1-bfea-b11b20387fb8, dstImageGroupId = 31ba11f8-1261-4e51-bdbd-4f8c7eefdf32, vmId = 4fcd9c56-4727-44f7-a9cb-2051f064baf2, dstImageId = c8e2b97c-4efe-4841-9f31-0262ed0b3064, imageDescription = , dstStorageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, copyVolumeType = LeafVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false), log id: 5800f98 >2012-10-25 15:53:32,695 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [5455f8bb] -- CopyImageVDSCommand::ExecuteIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2012-10-25 15:53:32,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [5455f8bb] -- copyImage parameters: > sdUUID=ce351396-4837-435f-b821-1c6af2506fb3 > spUUID=5fc9dbd7-9595-4192-97f1-4d2b2e24c380 > vmGUID=4fcd9c56-4727-44f7-a9cb-2051f064baf2 > srcImageGUID=1d6ba406-c73d-4e8b-87e5-e22720bdd30e > srcVolUUID=e4f244e0-42ba-45c1-bfea-b11b20387fb8 > dstImageGUID=31ba11f8-1261-4e51-bdbd-4f8c7eefdf32 > dstVolUUID=c8e2b97c-4efe-4841-9f31-0262ed0b3064 > descr= > >2012-10-25 15:53:33,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [5455f8bb] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 5800f98 >2012-10-25 15:53:33,530 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (http--0.0.0.0-8700-1) [5455f8bb] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity e4f244e0-42ba-45c1-bfea-b11b20387fb8 >2012-10-25 15:53:33,532 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [5455f8bb] EntityMultiAsyncTasks::AttachTask: Attaching task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 to entity e4f244e0-42ba-45c1-bfea-b11b20387fb8. >2012-10-25 15:53:33,535 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (http--0.0.0.0-8700-1) [5455f8bb] Adding task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 to DataBase >2012-10-25 15:53:33,638 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (http--0.0.0.0-8700-1) [5455f8bb] Adding task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:53:33,702 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (http--0.0.0.0-8700-1) [3904e21b] Running command: MoveOrCopyImageGroupCommand internal: true. Entities affected : ID: ce351396-4837-435f-b821-1c6af2506fb3 Type: Storage >2012-10-25 15:53:33,708 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [3904e21b] START, CopyImageVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 20206906-b47a-4b85-9c6d-c37d39fd75cd, imageId = 25b00ac9-c6c8-4701-be2e-282967f2404a, dstImageGroupId = 88d80a6f-c048-4c7f-a3c6-2859073eb6fd, vmId = 4fcd9c56-4727-44f7-a9cb-2051f064baf2, dstImageId = 4f5aabf3-df91-4cf1-809c-13a521dbd89f, imageDescription = , dstStorageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, copyVolumeType = LeafVol, volumeFormat = RAW, preallocate = Sparse, postZero = false, force = false), log id: 1bfe7d71 >2012-10-25 15:53:33,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [3904e21b] -- CopyImageVDSCommand::ExecuteIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID >2012-10-25 15:53:33,716 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [3904e21b] -- copyImage parameters: > sdUUID=ce351396-4837-435f-b821-1c6af2506fb3 > spUUID=5fc9dbd7-9595-4192-97f1-4d2b2e24c380 > vmGUID=4fcd9c56-4727-44f7-a9cb-2051f064baf2 > srcImageGUID=20206906-b47a-4b85-9c6d-c37d39fd75cd > srcVolUUID=25b00ac9-c6c8-4701-be2e-282967f2404a > dstImageGUID=88d80a6f-c048-4c7f-a3c6-2859073eb6fd > dstVolUUID=4f5aabf3-df91-4cf1-809c-13a521dbd89f > descr= > >2012-10-25 15:53:34,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (http--0.0.0.0-8700-1) [3904e21b] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 1bfe7d71 >2012-10-25 15:53:34,516 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (http--0.0.0.0-8700-1) [3904e21b] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 25b00ac9-c6c8-4701-be2e-282967f2404a >2012-10-25 15:53:34,517 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [3904e21b] EntityMultiAsyncTasks::AttachTask: Attaching task 5af46520-de8b-4eaa-a054-4e26334cc420 to entity 25b00ac9-c6c8-4701-be2e-282967f2404a. >2012-10-25 15:53:34,519 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (http--0.0.0.0-8700-1) [3904e21b] Adding task 5af46520-de8b-4eaa-a054-4e26334cc420 to DataBase >2012-10-25 15:53:34,590 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (http--0.0.0.0-8700-1) [3904e21b] Adding task 5af46520-de8b-4eaa-a054-4e26334cc420 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:53:35,204 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (http--0.0.0.0-8700-1) [3904e21b] BaseAsyncTask::StartPollingTask: Starting to poll task e1e620ff-2618-492d-b324-24b5ae736483. >2012-10-25 15:53:35,206 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [3904e21b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 is AddVmFromSnapshot (determined by task e1e620ff-2618-492d-b324-24b5ae736483) >2012-10-25 15:53:35,208 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (http--0.0.0.0-8700-1) [3904e21b] BaseAsyncTask::StartPollingTask: Starting to poll task 9bea6520-6c62-4225-9438-6212d4d5bf13. >2012-10-25 15:53:35,210 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [3904e21b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 2928f846-e49b-4492-8d38-9f05dff5528e is AddVmFromSnapshot (determined by task 9bea6520-6c62-4225-9438-6212d4d5bf13) >2012-10-25 15:53:35,212 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (http--0.0.0.0-8700-1) [3904e21b] BaseAsyncTask::StartPollingTask: Starting to poll task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3. >2012-10-25 15:53:35,213 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [3904e21b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity e4f244e0-42ba-45c1-bfea-b11b20387fb8 is AddVmFromSnapshot (determined by task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3) >2012-10-25 15:53:35,216 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (http--0.0.0.0-8700-1) [3904e21b] BaseAsyncTask::StartPollingTask: Starting to poll task 5af46520-de8b-4eaa-a054-4e26334cc420. >2012-10-25 15:53:35,217 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (http--0.0.0.0-8700-1) [3904e21b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 25b00ac9-c6c8-4701-be2e-282967f2404a is AddVmFromSnapshot (determined by task 5af46520-de8b-4eaa-a054-4e26334cc420) >2012-10-25 15:53:35,965 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-98) Polling and updating Async Tasks: 4 tasks, 4 tasks to poll now >2012-10-25 15:53:36,001 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 9bea6520-6c62-4225-9438-6212d4d5bf13 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-10-25 15:53:36,005 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 5af46520-de8b-4eaa-a054-4e26334cc420 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-10-25 15:53:36,008 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2012-10-25 15:53:36,010 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) SPMAsyncTask::PollTask: Polling task e1e620ff-2618-492d-b324-24b5ae736483 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-10-25 15:53:36,073 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-98) BaseAsyncTask::OnTaskEndSuccess: Task e1e620ff-2618-492d-b324-24b5ae736483 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-10-25 15:53:36,075 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 has ended -> executing EndAction >2012-10-25 15:53:36,076 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-98) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27): calling EndAction for action type AddVmFromSnapshot. >2012-10-25 15:53:36,077 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-98) Finished polling Tasks, will poll again in 10 seconds. >2012-10-25 15:53:36,077 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddVmFromSnapshot, executionIndex: 0 >2012-10-25 15:53:36,114 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (pool-10-thread-50) [3eb14ecb] Ending command successfully: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >2012-10-25 15:53:36,118 INFO [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-50) [796d917a] Ending command successfully: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:53:36,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-10-thread-50) [796d917a] START, GetImageInfoVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, imageId = 0052e2d0-4e7e-4896-908f-168358b34696), log id: 4cee5f5a >2012-10-25 15:54:00,518 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) domain 1ab5610b-a63f-4c98-8775-cb6ea0213217:s2 in problem. vds: h2 >2012-10-25 15:54:10,690 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) Domain 1ab5610b-a63f-4c98-8775-cb6ea0213217:s2 recovered from problem. vds: h2 >2012-10-25 15:54:10,691 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) Domain 1ab5610b-a63f-4c98-8775-cb6ea0213217:s2 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-10-25 15:54:20,806 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) domain 04557288-05a4-419e-8a28-910a7c8a4660:s4 in problem. vds: h2 >2012-10-25 15:54:20,809 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) domain ce351396-4837-435f-b821-1c6af2506fb3:s1 in problem. vds: h2 >2012-10-25 15:54:20,813 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) domain c61ec9b9-54e0-43fe-948c-6abcd5b87256:s3 in problem. vds: h2 >2012-10-25 15:54:41,101 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) domain 1ab5610b-a63f-4c98-8775-cb6ea0213217:s2 in problem. vds: h2 >2012-10-25 15:55:00,016 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering hosts is disabled, skipping >2012-10-25 15:55:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) Autorecovering storage domains is disabled, skipping >2012-10-25 15:55:13,632 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-22) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:15,656 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-25) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:17,681 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-29) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:19,703 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-31) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:21,724 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-33) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:23,745 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-35) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:25,766 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-37) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:27,810 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-42) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:29,861 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-44) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:31,895 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-46) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:33,939 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-48) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:35,985 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-50) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:38,033 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-54) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:40,075 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-56) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:41,220 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-10-thread-50) [796d917a] IrsBroker::Failed::GetImageInfoVDS due to: ConnectException: Connection refused >2012-10-25 15:55:41,224 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-10-thread-50) [796d917a] FINISH, GetImageInfoVDSCommand, log id: 4cee5f5a >2012-10-25 15:55:41,287 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-10-thread-50) transaction rolled back >2012-10-25 15:55:41,313 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-3) [11e5c3ce] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 5fc9dbd7-9595-4192-97f1-4d2b2e24c380 Type: StoragePool >2012-10-25 15:55:41,354 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::EndCommandAction [within thread]: EndAction for action type AddVmFromSnapshot threw an exception: org.springframework.jdbc.CannotGetJdbcConnectionException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction > at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:80) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:573) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:637) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:666) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:706) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall.executeCallInternal(PostgresDbEngineDialect.java:155) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall.doExecute(PostgresDbEngineDialect.java:121) [engine-dal.jar:] > at org.springframework.jdbc.core.simple.SimpleJdbcCall.execute(SimpleJdbcCall.java:181) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeImpl(SimpleJdbcCallsHandler.java:124) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeReadAndReturnMap(SimpleJdbcCallsHandler.java:75) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeReadList(SimpleJdbcCallsHandler.java:66) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeRead(SimpleJdbcCallsHandler.java:58) [engine-dal.jar:] > at org.ovirt.engine.core.dao.SnapshotDaoDbFacadeImpl.get(SnapshotDaoDbFacadeImpl.java:188) [engine-dal.jar:] > at org.ovirt.engine.core.dao.SnapshotDaoDbFacadeImpl.get(SnapshotDaoDbFacadeImpl.java:180) [engine-dal.jar:] > at org.ovirt.engine.core.dao.SnapshotDaoDbFacadeImpl.get(SnapshotDaoDbFacadeImpl.java:16) [engine-dal.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.getSnapshot(AddVmFromSnapshotCommand.java:249) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.getVmIdFromSnapshot(AddVmFromSnapshotCommand.java:106) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.getSourceVmFromDb(AddVmFromSnapshotCommand.java:350) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.getStoragePoolId(AddVmFromSnapshotCommand.java:61) [engine-bll.jar:] > at org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogableBase.getStoragePool(AuditLogableBase.java:254) [engine-dal.jar:] > at org.ovirt.engine.core.bll.AddVmCommand.rollbackQuota(AddVmCommand.java:805) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalCompensate(CommandBase.java:336) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.compensate(CommandBase.java:328) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:481) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1347) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:141) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:110) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:405) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:368) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:] > at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source) [:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.endAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:137) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:25) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:106) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] >Caused by: java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a transaction > at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:137) > at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:111) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:77) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > ... 81 more >Caused by: javax.resource.ResourceException: IJ000460: Error checking for a transaction > at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:362) > at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:464) > at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:129) > ... 83 more >Caused by: javax.resource.ResourceException: IJ000459: Transaction is not active: tx=TransactionImple < ac, BasicAction: 0:ffff0a2301e2:-5f9b5e16:50894417:77 status: ActionStatus.ABORT_ONLY > > at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:352) > ... 85 more > >2012-10-25 15:55:41,380 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) [11e5c3ce] IrsBroker::Failed::GetStoragePoolInfoVDS due to: ConnectException: Connection refused >2012-10-25 15:55:41,409 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot completed, handling the result. >2012-10-25 15:55:41,410 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot hasnt succeeded, not clearing tasks, will attempt again next polling. >2012-10-25 15:55:42,118 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-58) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 5d4237fe-0abe-11e2-bd6b-3c970e182f75 : h2, VDS Network Error, continuing. >VDSNetworkException: >2012-10-25 15:55:44,642 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-60) [7714e0bf] Running command: InitVdsOnUpCommand internal: true. >2012-10-25 15:55:44,814 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-60) [4b15eb2c] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 5fc9dbd7-9595-4192-97f1-4d2b2e24c380 Type: StoragePool >2012-10-25 15:55:44,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-60) [4b15eb2c] START, ConnectStorageServerVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, storageType = NFS, connectionList = [{ id: 70f8befb-a166-4e0a-a13a-46bd07267834, connection: multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/export1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: b030a622-782a-4ae9-8812-5a2f263a09d2, connection: multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/iso1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: ee89b60a-7ee5-44ec-a0c7-d0a39bbb5fd8, connection: multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/data1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d60909c0-bc33-4abc-812d-396204174ee9, connection: multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/export2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 39653a0c >2012-10-25 15:55:44,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-60) [4b15eb2c] FINISH, ConnectStorageServerVDSCommand, return: {70f8befb-a166-4e0a-a13a-46bd07267834=0, b030a622-782a-4ae9-8812-5a2f263a09d2=0, ee89b60a-7ee5-44ec-a0c7-d0a39bbb5fd8=0, d60909c0-bc33-4abc-812d-396204174ee9=0}, log id: 39653a0c >2012-10-25 15:55:44,872 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-60) [4b15eb2c] Host h2 storage connection was succeeded >2012-10-25 15:55:44,914 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-60) [4b15eb2c] START, ConnectStoragePoolVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, vds_spm_id = 1, masterDomainId = 1ab5610b-a63f-4c98-8775-cb6ea0213217, masterVersion = 24), log id: 287c86c6 >2012-10-25 15:55:51,296 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) SPMAsyncTask::PollTask: Task 9bea6520-6c62-4225-9438-6212d4d5bf13 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) was not found in VDSM, will change its status to unknown. >2012-10-25 15:55:51,298 WARN [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) SPMAsyncTask::PollTask: Polling task 9bea6520-6c62-4225-9438-6212d4d5bf13 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status unknown. >2012-10-25 15:55:51,329 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) BaseAsyncTask::LogEndTaskFailure: Task 9bea6520-6c62-4225-9438-6212d4d5bf13 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: >-- Result: success >-- Message: Asynchronous Task unknown error, >-- Exception: [null] >2012-10-25 15:55:51,333 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 2928f846-e49b-4492-8d38-9f05dff5528e has ended -> executing EndAction >2012-10-25 15:55:51,334 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 2928f846-e49b-4492-8d38-9f05dff5528e): calling EndAction for action type AddVmFromSnapshot. >2012-10-25 15:55:51,336 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) SPMAsyncTask::PollTask: Task 5af46520-de8b-4eaa-a054-4e26334cc420 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) was not found in VDSM, will change its status to unknown. >2012-10-25 15:55:51,336 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-49) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddVmFromSnapshot, executionIndex: 0 >2012-10-25 15:55:51,337 WARN [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) SPMAsyncTask::PollTask: Polling task 5af46520-de8b-4eaa-a054-4e26334cc420 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status unknown. >2012-10-25 15:55:51,345 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) BaseAsyncTask::LogEndTaskFailure: Task 5af46520-de8b-4eaa-a054-4e26334cc420 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: >-- Result: success >-- Message: Asynchronous Task unknown error, >-- Exception: [null] >2012-10-25 15:55:51,347 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 25b00ac9-c6c8-4701-be2e-282967f2404a has ended -> executing EndAction >2012-10-25 15:55:51,348 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 25b00ac9-c6c8-4701-be2e-282967f2404a): calling EndAction for action type AddVmFromSnapshot. >2012-10-25 15:55:51,349 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) SPMAsyncTask::PollTask: Task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) was not found in VDSM, will change its status to unknown. >2012-10-25 15:55:51,349 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddVmFromSnapshot, executionIndex: 0 >2012-10-25 15:55:51,350 WARN [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) SPMAsyncTask::PollTask: Polling task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status unknown. >2012-10-25 15:55:51,378 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) BaseAsyncTask::LogEndTaskFailure: Task 5fc63f23-46f5-4ae2-92f6-2c9ab8f9a7b3 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: >-- Result: success >-- Message: Asynchronous Task unknown error, >-- Exception: [null] >2012-10-25 15:55:51,381 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndActionIfNecessary: All tasks of entity e4f244e0-42ba-45c1-bfea-b11b20387fb8 has ended -> executing EndAction >2012-10-25 15:55:51,382 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: e4f244e0-42ba-45c1-bfea-b11b20387fb8): calling EndAction for action type AddVmFromSnapshot. >2012-10-25 15:55:51,383 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddVmFromSnapshot, executionIndex: 0 >2012-10-25 15:55:51,387 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (pool-10-thread-49) [3eb14ecb] Ending command with failure: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >2012-10-25 15:55:51,398 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-67) BaseAsyncTask::OnTaskEndSuccess: Task e1e620ff-2618-492d-b324-24b5ae736483 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-10-25 15:55:51,401 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 has ended -> executing EndAction >2012-10-25 15:55:51,403 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-67) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27): calling EndAction for action type AddVmFromSnapshot. >2012-10-25 15:55:51,401 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-49) [796d917a] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,404 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddVmFromSnapshot, executionIndex: 0 >2012-10-25 15:55:51,414 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [57021232] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,415 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (pool-10-thread-48) [3eb14ecb] Ending command with failure: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >2012-10-25 15:55:51,432 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (pool-10-thread-47) [3eb14ecb] Ending command with failure: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >2012-10-25 15:55:51,439 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-48) [796d917a] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,448 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [57021232] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, postZeros = false, forceDelete = false), log id: 36161596 >2012-10-25 15:55:51,451 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-47) [796d917a] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,470 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (pool-10-thread-45) [3eb14ecb] Ending command with failure: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >2012-10-25 15:55:51,477 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-45) [796d917a] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [57021232] FINISH, DeleteImageGroupVDSCommand, log id: 36161596 >2012-10-25 15:55:51,504 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [57021232] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,509 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-49) [4e2040fd] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,515 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [9e8b687] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,528 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [9e8b687] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 688e942b-675c-4754-ae2b-8de04dc14f36, postZeros = false, forceDelete = false), log id: c06d2b7 >2012-10-25 15:55:51,533 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [9e8b687] FINISH, DeleteImageGroupVDSCommand, log id: c06d2b7 >2012-10-25 15:55:51,544 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [9e8b687] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,551 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-49) [5455f8bb] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,557 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [7c2f03f9] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [7c2f03f9] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 31ba11f8-1261-4e51-bdbd-4f8c7eefdf32, postZeros = false, forceDelete = false), log id: 2aa3e99e >2012-10-25 15:55:51,578 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [7c2f03f9] FINISH, DeleteImageGroupVDSCommand, log id: 2aa3e99e >2012-10-25 15:55:51,585 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [7c2f03f9] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,592 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-49) [3904e21b] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,598 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [a4553e4] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [a4553e4] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 88d80a6f-c048-4c7f-a3c6-2859073eb6fd, postZeros = false, forceDelete = false), log id: 682cca04 >2012-10-25 15:55:51,617 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-49) [a4553e4] FINISH, DeleteImageGroupVDSCommand, log id: 682cca04 >2012-10-25 15:55:51,627 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-49) [a4553e4] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,678 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-49) START, RemoveVMVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4fcd9c56-4727-44f7-a9cb-2051f064baf2), log id: 535c070f >2012-10-25 15:55:51,687 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-49) FINISH, RemoveVMVDSCommand, log id: 535c070f >2012-10-25 15:55:51,692 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-10-thread-49) transaction rolled back >2012-10-25 15:55:51,702 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [2f7d6810] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [2f7d6810] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, postZeros = false, forceDelete = false), log id: 6edd9018 >2012-10-25 15:55:51,725 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [2f7d6810] FINISH, DeleteImageGroupVDSCommand, log id: 6edd9018 >2012-10-25 15:55:51,735 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [2f7d6810] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,748 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-48) [4e2040fd] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,765 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-49) EntityAsyncTask::EndCommandAction [within thread]: EndAction for action type AddVmFromSnapshot threw an exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: Cannot allocate IRS server > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:212) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:1422) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:205) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:201) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmCommand.endWithFailure(AddVmCommand.java:694) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.endWithFailure(AddVmFromSnapshotCommand.java:243) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalEndWithFailure(CommandBase.java:526) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:461) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1347) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:141) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:110) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:405) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:368) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:] > at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source) [:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.endAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:137) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:25) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:106) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] > >2012-10-25 15:55:51,767 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [1fae4c8e] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [1fae4c8e] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 688e942b-675c-4754-ae2b-8de04dc14f36, postZeros = false, forceDelete = false), log id: 185d733d >2012-10-25 15:55:51,794 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot completed, handling the result. >2012-10-25 15:55:51,794 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [1fae4c8e] FINISH, DeleteImageGroupVDSCommand, log id: 185d733d >2012-10-25 15:55:51,794 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot hasnt succeeded, not clearing tasks, will attempt again next polling. >2012-10-25 15:55:51,801 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [1fae4c8e] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,805 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-48) [5455f8bb] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,810 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [68c350e1] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,819 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [68c350e1] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 31ba11f8-1261-4e51-bdbd-4f8c7eefdf32, postZeros = false, forceDelete = false), log id: 694af91d >2012-10-25 15:55:51,825 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [68c350e1] FINISH, DeleteImageGroupVDSCommand, log id: 694af91d >2012-10-25 15:55:51,834 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [68c350e1] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,840 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-48) [3904e21b] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,845 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [62e83560] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,852 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [62e83560] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 88d80a6f-c048-4c7f-a3c6-2859073eb6fd, postZeros = false, forceDelete = false), log id: 60ce27bf >2012-10-25 15:55:51,856 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-48) [62e83560] FINISH, DeleteImageGroupVDSCommand, log id: 60ce27bf >2012-10-25 15:55:51,867 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-48) [62e83560] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,881 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-48) START, RemoveVMVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4fcd9c56-4727-44f7-a9cb-2051f064baf2), log id: 2b3b11e >2012-10-25 15:55:51,884 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-48) FINISH, RemoveVMVDSCommand, log id: 2b3b11e >2012-10-25 15:55:51,888 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-10-thread-48) transaction rolled back >2012-10-25 15:55:51,890 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [13b9d5fa] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,901 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [13b9d5fa] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, postZeros = false, forceDelete = false), log id: 20ea8f7e >2012-10-25 15:55:51,905 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [13b9d5fa] FINISH, DeleteImageGroupVDSCommand, log id: 20ea8f7e >2012-10-25 15:55:51,917 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [13b9d5fa] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:51,924 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-47) [4e2040fd] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:51,943 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::EndCommandAction [within thread]: EndAction for action type AddVmFromSnapshot threw an exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: Cannot allocate IRS server > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:212) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:1422) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:205) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:201) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmCommand.endWithFailure(AddVmCommand.java:694) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.endWithFailure(AddVmFromSnapshotCommand.java:243) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalEndWithFailure(CommandBase.java:526) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:461) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1347) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:141) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:110) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:405) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:368) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:] > at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source) [:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.endAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:137) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:25) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:106) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] > >2012-10-25 15:55:51,945 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [25576c84] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:51,968 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot completed, handling the result. >2012-10-25 15:55:51,969 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot hasnt succeeded, not clearing tasks, will attempt again next polling. >2012-10-25 15:55:51,993 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [25576c84] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 688e942b-675c-4754-ae2b-8de04dc14f36, postZeros = false, forceDelete = false), log id: 19fd35d5 >2012-10-25 15:55:52,001 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [25576c84] FINISH, DeleteImageGroupVDSCommand, log id: 19fd35d5 >2012-10-25 15:55:52,008 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [25576c84] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,014 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-47) [5455f8bb] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:52,019 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [4984e907] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:52,034 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [4984e907] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 31ba11f8-1261-4e51-bdbd-4f8c7eefdf32, postZeros = false, forceDelete = false), log id: 57b47406 >2012-10-25 15:55:52,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [4984e907] FINISH, DeleteImageGroupVDSCommand, log id: 57b47406 >2012-10-25 15:55:52,049 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [4984e907] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,057 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-47) [3904e21b] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:52,064 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [38143362] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:52,076 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [38143362] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 88d80a6f-c048-4c7f-a3c6-2859073eb6fd, postZeros = false, forceDelete = false), log id: 1128580 >2012-10-25 15:55:52,084 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-47) [38143362] FINISH, DeleteImageGroupVDSCommand, log id: 1128580 >2012-10-25 15:55:52,091 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-47) [38143362] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,107 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-47) START, RemoveVMVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4fcd9c56-4727-44f7-a9cb-2051f064baf2), log id: 63e464c1 >2012-10-25 15:55:52,110 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-47) FINISH, RemoveVMVDSCommand, log id: 63e464c1 >2012-10-25 15:55:52,117 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [142d4b0a] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:52,117 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-10-thread-47) transaction rolled back >2012-10-25 15:55:52,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [142d4b0a] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, postZeros = false, forceDelete = false), log id: 3dbbc87c >2012-10-25 15:55:52,130 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [142d4b0a] FINISH, DeleteImageGroupVDSCommand, log id: 3dbbc87c >2012-10-25 15:55:52,140 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [142d4b0a] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,146 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-45) [4e2040fd] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:52,157 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [432047d] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:52,164 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::EndCommandAction [within thread]: EndAction for action type AddVmFromSnapshot threw an exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: Cannot allocate IRS server > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:212) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:1422) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:205) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:201) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmCommand.endWithFailure(AddVmCommand.java:694) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.endWithFailure(AddVmFromSnapshotCommand.java:243) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalEndWithFailure(CommandBase.java:526) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:461) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1347) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:141) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:110) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:405) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:368) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:] > at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source) [:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.endAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:137) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:25) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:106) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] > >2012-10-25 15:55:52,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [432047d] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 688e942b-675c-4754-ae2b-8de04dc14f36, postZeros = false, forceDelete = false), log id: 3690b706 >2012-10-25 15:55:52,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [432047d] FINISH, DeleteImageGroupVDSCommand, log id: 3690b706 >2012-10-25 15:55:52,193 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot completed, handling the result. >2012-10-25 15:55:52,194 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot hasnt succeeded, not clearing tasks, will attempt again next polling. >2012-10-25 15:55:52,198 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [432047d] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,203 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-45) [5455f8bb] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:52,207 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [4c44ba69] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:52,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [4c44ba69] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 31ba11f8-1261-4e51-bdbd-4f8c7eefdf32, postZeros = false, forceDelete = false), log id: 7c36b2c7 >2012-10-25 15:55:52,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [4c44ba69] FINISH, DeleteImageGroupVDSCommand, log id: 7c36b2c7 >2012-10-25 15:55:52,231 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [4c44ba69] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,244 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-45) [3904e21b] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:55:52,249 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [3d54e44e] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:55:52,258 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [3d54e44e] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 88d80a6f-c048-4c7f-a3c6-2859073eb6fd, postZeros = false, forceDelete = false), log id: b9cf008 >2012-10-25 15:55:52,260 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-45) [3d54e44e] FINISH, DeleteImageGroupVDSCommand, log id: b9cf008 >2012-10-25 15:55:52,273 ERROR [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-45) [3d54e44e] Command org.ovirt.engine.core.bll.RemoveImageCommand throw Vdc Bll exception. With error message VdcBLLException: Cannot allocate IRS server >2012-10-25 15:55:52,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-45) START, RemoveVMVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4fcd9c56-4727-44f7-a9cb-2051f064baf2), log id: 291c2833 >2012-10-25 15:55:52,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-45) FINISH, RemoveVMVDSCommand, log id: 291c2833 >2012-10-25 15:55:52,308 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (pool-10-thread-45) transaction rolled back >2012-10-25 15:55:52,363 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::EndCommandAction [within thread]: EndAction for action type AddVmFromSnapshot threw an exception: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: Cannot allocate IRS server > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:212) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:1422) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:205) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VmCommand.removeVmInSpm(VmCommand.java:201) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmCommand.endWithFailure(AddVmCommand.java:694) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AddVmFromSnapshotCommand.endWithFailure(AddVmFromSnapshotCommand.java:243) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.internalEndWithFailure(CommandBase.java:526) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:461) [engine-bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1347) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInRequired(TransactionSupport.java:141) [engine-utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:110) [engine-utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.endAction(CommandBase.java:405) [engine-bll.jar:] > at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:368) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11) [engine-utils.jar:] > at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source) [:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.endAction(Unknown Source) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:137) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:25) [engine-bll.jar:] > at org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:106) [engine-bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64) [engine-utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] > at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] > >2012-10-25 15:55:52,389 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot completed, handling the result. >2012-10-25 15:55:52,390 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot hasnt succeeded, not clearing tasks, will attempt again next polling. >2012-10-25 15:56:34,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-60) [4b15eb2c] FINISH, ConnectStoragePoolVDSCommand, log id: 287c86c6 >2012-10-25 15:56:34,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-60) [4b15eb2c] No string for UNASSIGNED type. Use default Log >2012-10-25 15:56:35,008 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-10-thread-50) [4b15eb2c] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-10-25 15:56:35,044 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-60) [6e991529] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 5d4237fe-0abe-11e2-bd6b-3c970e182f75 Type: VDS >2012-10-25 15:56:35,049 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-60) [16100766] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 5d4237fe-0abe-11e2-bd6b-3c970e182f75 Type: VDS >2012-10-25 15:56:41,446 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) hostFromVds::selectedVds - h2, spmStatus Free, storage pool dc1 >2012-10-25 15:56:41,464 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SpmStatus on vds 5d4237fe-0abe-11e2-bd6b-3c970e182f75: Free >2012-10-25 15:56:41,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) starting spm on vds h2, storage pool dc1, prevId 1, LVER 1 >2012-10-25 15:56:41,524 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) START, SpmStartVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, prevId=1, prevLVER=1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6dab7b73 >2012-10-25 15:56:41,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) spmStart polling started: taskId = a7b2fbd1-4957-4a7f-aeef-6093bba86014 >2012-10-25 15:56:58,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) spmStart polling ended: taskId = a7b2fbd1-4957-4a7f-aeef-6093bba86014 task status = finished >2012-10-25 15:56:58,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) spmStart polling ended, spm status: SPM >2012-10-25 15:56:58,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) START, HSMClearTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=a7b2fbd1-4957-4a7f-aeef-6093bba86014), log id: 5771346a >2012-10-25 15:56:58,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) FINISH, HSMClearTaskVDSCommand, log id: 5771346a >2012-10-25 15:56:58,745 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@62148b87, log id: 6dab7b73 >2012-10-25 15:56:58,798 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) Initialize Irs proxy from vds: mars-vdsi.tlv.redhat.com >2012-10-25 15:56:58,872 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-20) BaseAsyncTask::OnTaskEndSuccess: Task e1e620ff-2618-492d-b324-24b5ae736483 (Parent Command AddVmFromSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-10-25 15:56:58,875 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-20) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 has ended -> executing EndAction >2012-10-25 15:56:58,877 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-20) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27): calling EndAction for action type AddVmFromSnapshot. >2012-10-25 15:56:58,880 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-44) Attempting to get and stop tasks on storage pool dc1 >2012-10-25 15:56:58,880 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddVmFromSnapshot, executionIndex: 0 >2012-10-25 15:56:58,883 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2507d017 >2012-10-25 15:56:58,922 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (pool-10-thread-50) [3eb14ecb] Ending command with failure: org.ovirt.engine.core.bll.AddVmFromSnapshotCommand >2012-10-25 15:56:58,925 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-50) [796d917a] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:56:58,932 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-50) [5e7fa97b] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:56:58,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [5e7fa97b] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 937aff09-1549-409a-af9b-316892e40ef2, postZeros = false, forceDelete = false), log id: 1d41c843 >2012-10-25 15:57:00,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [5e7fa97b] FINISH, DeleteImageGroupVDSCommand, log id: 1d41c843 >2012-10-25 15:57:00,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 5fc9dbd7-9595-4192-97f1-4d2b2e24c380 >2012-10-25 15:57:00,181 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) [5e7fa97b] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 0052e2d0-4e7e-4896-908f-168358b34696 >2012-10-25 15:57:00,183 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [5e7fa97b] EntityMultiAsyncTasks::AttachTask: Attaching task edd37a34-a643-4e47-8e56-591a9902e9d3 to entity 0052e2d0-4e7e-4896-908f-168358b34696. >2012-10-25 15:57:00,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) START, HSMGetAllTasksInfoVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75), log id: d478038 >2012-10-25 15:57:00,189 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-10-thread-50) [5e7fa97b] Adding task edd37a34-a643-4e47-8e56-591a9902e9d3 to DataBase >2012-10-25 15:57:00,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) FINISH, HSMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@2f2b2cdf, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@3b8efcaa, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@286e1b72, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@54cbee1a, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@187d1874], log id: d478038 >2012-10-25 15:57:00,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) FINISH, SPMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@2f2b2cdf, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@3b8efcaa, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@286e1b72, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@54cbee1a, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@187d1874], log id: 2507d017 >2012-10-25 15:57:00,210 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-44) Adding task edd37a34-a643-4e47-8e56-591a9902e9d3 (Parent Command Unknown, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:57:00,213 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (QuartzScheduler_Worker-44) Adding task edd37a34-a643-4e47-8e56-591a9902e9d3 to DataBase >2012-10-25 15:57:00,261 ERROR [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (QuartzScheduler_Worker-44) Adding/Updating task edd37a34-a643-4e47-8e56-591a9902e9d3 to DataBase threw an exception.: org.springframework.dao.DuplicateKeyException: CallableStatementCallback; SQL [{call insertasync_tasks(?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}]; ERROR: duplicate key value violates unique constraint "pk_async_tasks" > Detail: Key (task_id)=(edd37a34-a643-4e47-8e56-591a9902e9d3) already exists. > Where: SQL statement "INSERT INTO async_tasks(action_type, result, status, task_id, action_parameters,action_params_class, step_id, command_id) > VALUES(v_action_type, v_result, v_status, v_task_id, v_action_parameters,v_action_params_class, v_step_id, v_command_id)" >PL/pgSQL function "insertasync_tasks" line 3 at SQL statement; nested exception is org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "pk_async_tasks" > Detail: Key (task_id)=(edd37a34-a643-4e47-8e56-591a9902e9d3) already exists. > Where: SQL statement "INSERT INTO async_tasks(action_type, result, status, task_id, action_parameters,action_params_class, step_id, command_id) > VALUES(v_action_type, v_result, v_status, v_task_id, v_action_parameters,v_action_params_class, v_step_id, v_command_id)" >PL/pgSQL function "insertasync_tasks" line 3 at SQL statement > at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.doTranslate(SQLErrorCodeSQLExceptionTranslator.java:241) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:1030) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.call(JdbcTemplate.java:1064) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.simple.AbstractJdbcCall.executeCallInternal(AbstractJdbcCall.java:388) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.simple.AbstractJdbcCall.doExecute(AbstractJdbcCall.java:351) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.simple.SimpleJdbcCall.execute(SimpleJdbcCall.java:181) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeImpl(SimpleJdbcCallsHandler.java:124) [engine-dal.jar:] > at org.ovirt.engine.core.dal.dbbroker.SimpleJdbcCallsHandler.executeModification(SimpleJdbcCallsHandler.java:37) [engine-dal.jar:] > at org.ovirt.engine.core.dao.AsyncTaskDAODbFacadeImpl.save(AsyncTaskDAODbFacadeImpl.java:126) [engine-dal.jar:] > at org.ovirt.engine.core.bll.tasks.AsyncTaskUtils.saveAsyncTaskInDB(AsyncTaskUtils.java:42) [engine-bll.jar:] > at org.ovirt.engine.core.bll.tasks.AsyncTaskUtils.addOrUpdateTaskInDB(AsyncTaskUtils.java:24) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AsyncTaskManager$1.runInTransaction(AsyncTaskManager.java:548) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AsyncTaskManager$1.runInTransaction(AsyncTaskManager.java:543) [engine-bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202) [engine-utils.jar:] > at org.ovirt.engine.core.bll.AsyncTaskManager.AddStoragePoolExistingTasks(AsyncTaskManager.java:543) [engine-bll.jar:] > at org.ovirt.engine.core.bll.AsyncTaskManager.StopStoragePoolTasks(AsyncTaskManager.java:581) [engine-bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener.storagePoolUpEvent(VdsEventListener.java:272) [engine-bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] > at org.ovirt.engine.core.common.businessentities.IVdsEventListener$$$view5.storagePoolUpEvent(Unknown Source) [engine-common.jar:] > at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand$IrsProxyData.StorageEventOnTimer(IrsBrokerCommand.java:576) [engine-vdsbroker.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_09-icedtea] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_09-icedtea] > at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_09-icedtea] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [engine-scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz-2.1.2.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz-2.1.2.jar:] >Caused by: org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "pk_async_tasks" > Detail: Key (task_id)=(edd37a34-a643-4e47-8e56-591a9902e9d3) already exists. > Where: SQL statement "INSERT INTO async_tasks(action_type, result, status, task_id, action_parameters,action_params_class, step_id, command_id) > VALUES(v_action_type, v_result, v_status, v_task_id, v_action_parameters,v_action_params_class, v_step_id, v_command_id)" >PL/pgSQL function "insertasync_tasks" line 3 at SQL statement > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2077) > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1810) > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257) > at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:498) > at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:386) > at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:379) > at org.jboss.jca.adapters.jdbc.CachedPreparedStatement.execute(CachedPreparedStatement.java:297) > at org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.execute(WrappedPreparedStatement.java:404) > at org.springframework.jdbc.core.JdbcTemplate$6.doInCallableStatement(JdbcTemplate.java:1066) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate$6.doInCallableStatement(JdbcTemplate.java:1) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:1014) [spring-jdbc-3.1.1.RELEASE.jar:3.1.1.RELEASE] > ... 60 more > >2012-10-25 15:57:00,294 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-44) BaseAsyncTask::StartPollingTask: Starting to poll task edd37a34-a643-4e47-8e56-591a9902e9d3. >2012-10-25 15:57:00,294 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-44) Discovered 5 tasks on Storage Pool dc1, 1 added to manager. >2012-10-25 15:57:00,295 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-44) SPMAsyncTask::StopTask: Attempting to stop task edd37a34-a643-4e47-8e56-591a9902e9d3 (Parent Command Unknown, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters). >2012-10-25 15:57:00,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMStopTaskVDSCommand] (QuartzScheduler_Worker-44) START, SPMStopTaskVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = edd37a34-a643-4e47-8e56-591a9902e9d3), log id: 50f6880e >2012-10-25 15:57:00,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMStopTaskVDSCommand] (QuartzScheduler_Worker-44) START, HSMStopTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=edd37a34-a643-4e47-8e56-591a9902e9d3), log id: 7169c349 >2012-10-25 15:57:00,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMStopTaskVDSCommand] (QuartzScheduler_Worker-44) FINISH, HSMStopTaskVDSCommand, log id: 7169c349 >2012-10-25 15:57:00,310 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMStopTaskVDSCommand] (QuartzScheduler_Worker-44) FINISH, SPMStopTaskVDSCommand, log id: 50f6880e >2012-10-25 15:57:00,311 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-10-thread-50) [5e7fa97b] Task edd37a34-a643-4e47-8e56-591a9902e9d3 already exists with action type Unknown, now overriding it with action type MoveOrCopyImageGroup >2012-10-25 15:57:00,311 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 569427ca >2012-10-25 15:57:00,312 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 5fc9dbd7-9595-4192-97f1-4d2b2e24c380 >2012-10-25 15:57:00,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) START, HSMGetAllTasksInfoVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75), log id: 210b314e >2012-10-25 15:57:00,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) FINISH, HSMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@65d208d4, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@4041ca85, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@1f5702b8, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@9738e1b, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@1769376], log id: 210b314e >2012-10-25 15:57:00,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-44) FINISH, SPMGetAllTasksInfoVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@65d208d4, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@4041ca85, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@1f5702b8, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@9738e1b, org.ovirt.engine.core.common.asynctasks.AsyncTaskCreationInfo@1769376], log id: 569427ca >2012-10-25 15:57:00,328 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-44) Discovered 5 tasks on Storage Pool dc1, 0 added to manager. >2012-10-25 15:57:00,367 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) [5e7fa97b] BaseAsyncTask::StartPollingTask: Starting to poll task edd37a34-a643-4e47-8e56-591a9902e9d3. >2012-10-25 15:57:00,369 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [5e7fa97b] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 0052e2d0-4e7e-4896-908f-168358b34696 is MoveOrCopyImageGroup (determined by task edd37a34-a643-4e47-8e56-591a9902e9d3) >2012-10-25 15:57:00,375 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-50) [4e2040fd] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:00,382 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-50) [2fde41f3] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:57:00,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [2fde41f3] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 688e942b-675c-4754-ae2b-8de04dc14f36, postZeros = false, forceDelete = false), log id: 93d03ed >2012-10-25 15:57:01,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [2fde41f3] FINISH, DeleteImageGroupVDSCommand, log id: 93d03ed >2012-10-25 15:57:01,091 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) [2fde41f3] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 3c491eba-d993-4b1e-add2-91c3f6686a97 >2012-10-25 15:57:01,092 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [2fde41f3] EntityMultiAsyncTasks::AttachTask: Attaching task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 to entity 3c491eba-d993-4b1e-add2-91c3f6686a97. >2012-10-25 15:57:01,095 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-10-thread-50) [2fde41f3] Adding task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 to DataBase >2012-10-25 15:57:01,161 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-10-thread-50) [2fde41f3] Adding task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:57:01,178 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) [2fde41f3] BaseAsyncTask::StartPollingTask: Starting to poll task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5. >2012-10-25 15:57:01,179 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [2fde41f3] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 3c491eba-d993-4b1e-add2-91c3f6686a97 is MoveOrCopyImageGroup (determined by task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5) >2012-10-25 15:57:01,185 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-50) [5455f8bb] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:01,192 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-50) [67b0292f] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:57:01,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [67b0292f] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 31ba11f8-1261-4e51-bdbd-4f8c7eefdf32, postZeros = false, forceDelete = false), log id: 59781ad3 >2012-10-25 15:57:01,872 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [67b0292f] FINISH, DeleteImageGroupVDSCommand, log id: 59781ad3 >2012-10-25 15:57:01,874 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) [67b0292f] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity c8e2b97c-4efe-4841-9f31-0262ed0b3064 >2012-10-25 15:57:01,876 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [67b0292f] EntityMultiAsyncTasks::AttachTask: Attaching task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 to entity c8e2b97c-4efe-4841-9f31-0262ed0b3064. >2012-10-25 15:57:01,878 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-10-thread-50) [67b0292f] Adding task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 to DataBase >2012-10-25 15:57:01,923 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-10-thread-50) [67b0292f] Adding task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:57:01,940 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) [67b0292f] BaseAsyncTask::StartPollingTask: Starting to poll task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1. >2012-10-25 15:57:01,943 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [67b0292f] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity c8e2b97c-4efe-4841-9f31-0262ed0b3064 is MoveOrCopyImageGroup (determined by task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1) >2012-10-25 15:57:01,950 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-50) [3904e21b] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:01,957 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (pool-10-thread-50) [20087a91] Running command: RemoveImageCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2012-10-25 15:57:01,966 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [20087a91] START, DeleteImageGroupVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = ce351396-4837-435f-b821-1c6af2506fb3, imageGroupId = 88d80a6f-c048-4c7f-a3c6-2859073eb6fd, postZeros = false, forceDelete = false), log id: 488c8999 >2012-10-25 15:57:02,549 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (pool-10-thread-50) [20087a91] FINISH, DeleteImageGroupVDSCommand, log id: 488c8999 >2012-10-25 15:57:02,551 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) [20087a91] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 4f5aabf3-df91-4cf1-809c-13a521dbd89f >2012-10-25 15:57:02,553 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [20087a91] EntityMultiAsyncTasks::AttachTask: Attaching task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf to entity 4f5aabf3-df91-4cf1-809c-13a521dbd89f. >2012-10-25 15:57:02,556 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-10-thread-50) [20087a91] Adding task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf to DataBase >2012-10-25 15:57:02,610 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-10-thread-50) [20087a91] Adding task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-10-25 15:57:02,636 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) [20087a91] BaseAsyncTask::StartPollingTask: Starting to poll task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf. >2012-10-25 15:57:02,638 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-10-thread-50) [20087a91] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 4f5aabf3-df91-4cf1-809c-13a521dbd89f is MoveOrCopyImageGroup (determined by task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf) >2012-10-25 15:57:02,650 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-50) START, RemoveVMVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, vmGuid = 4fcd9c56-4727-44f7-a9cb-2051f064baf2), log id: 5765223a >2012-10-25 15:57:02,662 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.RemoveVMVDSCommand] (pool-10-thread-50) FINISH, RemoveVMVDSCommand, log id: 5765223a >2012-10-25 15:57:02,678 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-10-thread-50) MacPoolManager::freeMac(mac = 00:1a:4a:16:01:b7) - entered >2012-10-25 15:57:02,727 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot completed, handling the result. >2012-10-25 15:57:02,729 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddVmFromSnapshot succeeded, clearing tasks. >2012-10-25 15:57:02,743 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e1e620ff-2618-492d-b324-24b5ae736483 >2012-10-25 15:57:02,744 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = e1e620ff-2618-492d-b324-24b5ae736483), log id: 19068afa >2012-10-25 15:57:02,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-50) START, HSMClearTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=e1e620ff-2618-492d-b324-24b5ae736483), log id: 5bd2e19e >2012-10-25 15:57:02,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 5bd2e19e >2012-10-25 15:57:02,873 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 19068afa >2012-10-25 15:57:02,892 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task e1e620ff-2618-492d-b324-24b5ae736483 from DataBase >2012-10-25 15:57:02,894 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 6ec11e4d-5b4d-46bd-9db1-1c1716a99e27 >2012-10-25 15:57:03,384 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain 1ab5610b-a63f-4c98-8775-cb6ea0213217:s2 recovered from problem. vds: h2 >2012-10-25 15:57:03,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain 1ab5610b-a63f-4c98-8775-cb6ea0213217:s2 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-10-25 15:57:03,389 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain 04557288-05a4-419e-8a28-910a7c8a4660:s4 recovered from problem. vds: h2 >2012-10-25 15:57:03,391 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain 04557288-05a4-419e-8a28-910a7c8a4660:s4 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-10-25 15:57:03,394 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain ce351396-4837-435f-b821-1c6af2506fb3:s1 recovered from problem. vds: h2 >2012-10-25 15:57:03,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain ce351396-4837-435f-b821-1c6af2506fb3:s1 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-10-25 15:57:03,399 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain c61ec9b9-54e0-43fe-948c-6abcd5b87256:s3 recovered from problem. vds: h2 >2012-10-25 15:57:03,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) Domain c61ec9b9-54e0-43fe-948c-6abcd5b87256:s3 has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2012-10-25 15:57:08,882 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-57) Polling and updating Async Tasks: 8 tasks, 4 tasks to poll now >2012-10-25 15:57:08,895 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) SPMAsyncTask::PollTask: Polling task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-10-25 15:57:08,898 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) BaseAsyncTask::OnTaskEndSuccess: Task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-10-25 15:57:08,901 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 3c491eba-d993-4b1e-add2-91c3f6686a97 has ended -> executing EndAction >2012-10-25 15:57:08,903 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 3c491eba-d993-4b1e-add2-91c3f6686a97): calling EndAction for action type MoveOrCopyImageGroup. >2012-10-25 15:57:08,905 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) SPMAsyncTask::PollTask: Polling task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-10-25 15:57:08,905 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction MoveOrCopyImageGroup, executionIndex: 0 >2012-10-25 15:57:08,907 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) BaseAsyncTask::OnTaskEndSuccess: Task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-10-25 15:57:08,909 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 4f5aabf3-df91-4cf1-809c-13a521dbd89f has ended -> executing EndAction >2012-10-25 15:57:08,910 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-50) [4e2040fd] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:08,910 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 4f5aabf3-df91-4cf1-809c-13a521dbd89f): calling EndAction for action type MoveOrCopyImageGroup. >2012-10-25 15:57:08,913 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) SPMAsyncTask::PollTask: Polling task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-10-25 15:57:08,913 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction MoveOrCopyImageGroup, executionIndex: 0 >2012-10-25 15:57:08,915 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) BaseAsyncTask::OnTaskEndSuccess: Task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-10-25 15:57:08,918 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndActionIfNecessary: All tasks of entity c8e2b97c-4efe-4841-9f31-0262ed0b3064 has ended -> executing EndAction >2012-10-25 15:57:08,919 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: c8e2b97c-4efe-4841-9f31-0262ed0b3064): calling EndAction for action type MoveOrCopyImageGroup. >2012-10-25 15:57:08,919 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-45) [3904e21b] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:08,920 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) SPMAsyncTask::PollTask: Polling task edd37a34-a643-4e47-8e56-591a9902e9d3 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. >2012-10-25 15:57:08,921 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction MoveOrCopyImageGroup, executionIndex: 0 >2012-10-25 15:57:08,922 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-57) BaseAsyncTask::LogEndTaskFailure: Task edd37a34-a643-4e47-8e56-591a9902e9d3 (Parent Command MoveOrCopyImageGroup, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: >-- Result: cleanSuccess >-- Message: VDSGenericException: VDSErrorException: Failed in vdscommand to HSMGetAllTasksStatusesVDS, error = shutting down, >-- Exception: VDSGenericException: VDSErrorException: Failed in vdscommand to HSMGetAllTasksStatusesVDS, error = shutting down >2012-10-25 15:57:08,924 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-47) [5455f8bb] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:08,924 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 0052e2d0-4e7e-4896-908f-168358b34696 has ended -> executing EndAction >2012-10-25 15:57:08,926 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-57) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 0052e2d0-4e7e-4896-908f-168358b34696): calling EndAction for action type MoveOrCopyImageGroup. >2012-10-25 15:57:08,928 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction MoveOrCopyImageGroup, executionIndex: 0 >2012-10-25 15:57:08,936 ERROR [org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand] (pool-10-thread-48) [796d917a] Ending command with failure: org.ovirt.engine.core.bll.MoveOrCopyImageGroupCommand >2012-10-25 15:57:08,988 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup completed, handling the result. >2012-10-25 15:57:08,990 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup succeeded, clearing tasks. >2012-10-25 15:57:08,992 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 >2012-10-25 15:57:08,994 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5), log id: 363e65b2 >2012-10-25 15:57:08,996 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup completed, handling the result. >2012-10-25 15:57:08,996 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup completed, handling the result. >2012-10-25 15:57:08,999 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup completed, handling the result. >2012-10-25 15:57:08,999 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup succeeded, clearing tasks. >2012-10-25 15:57:08,999 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup succeeded, clearing tasks. >2012-10-25 15:57:09,000 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type MoveOrCopyImageGroup succeeded, clearing tasks. >2012-10-25 15:57:09,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-50) START, HSMClearTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=8bbcb861-2d84-4f4b-a7c1-be5d687de7a5), log id: 26bc06ac >2012-10-25 15:57:09,002 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-45) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf >2012-10-25 15:57:09,001 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 >2012-10-25 15:57:09,001 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task edd37a34-a643-4e47-8e56-591a9902e9d3 >2012-10-25 15:57:09,003 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-45) START, SPMClearTaskVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 17248868-f98f-47ab-aa6a-3ffbc1c1aebf), log id: 25a1a12 >2012-10-25 15:57:09,005 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = edd37a34-a643-4e47-8e56-591a9902e9d3), log id: 6c8924cd >2012-10-25 15:57:09,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = ffbfe83f-e562-46b3-8df3-4a149b6b2dd1), log id: c15d1ed >2012-10-25 15:57:09,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 26bc06ac >2012-10-25 15:57:09,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 363e65b2 >2012-10-25 15:57:09,087 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 8bbcb861-2d84-4f4b-a7c1-be5d687de7a5 from DataBase >2012-10-25 15:57:09,089 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 3c491eba-d993-4b1e-add2-91c3f6686a97 >2012-10-25 15:57:09,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-47) START, HSMClearTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=ffbfe83f-e562-46b3-8df3-4a149b6b2dd1), log id: 33c97e7b >2012-10-25 15:57:09,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 33c97e7b >2012-10-25 15:57:09,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-47) FINISH, SPMClearTaskVDSCommand, log id: c15d1ed >2012-10-25 15:57:09,308 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-48) START, HSMClearTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=edd37a34-a643-4e47-8e56-591a9902e9d3), log id: 5301a35f >2012-10-25 15:57:09,328 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-47) BaseAsyncTask::RemoveTaskFromDB: Removed task ffbfe83f-e562-46b3-8df3-4a149b6b2dd1 from DataBase >2012-10-25 15:57:09,330 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity c8e2b97c-4efe-4841-9f31-0262ed0b3064 >2012-10-25 15:57:09,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-48) FINISH, HSMClearTaskVDSCommand, log id: 5301a35f >2012-10-25 15:57:09,355 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-48) FINISH, SPMClearTaskVDSCommand, log id: 6c8924cd >2012-10-25 15:57:09,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-45) START, HSMClearTaskVDSCommand(HostName = h2, HostId = 5d4237fe-0abe-11e2-bd6b-3c970e182f75, taskId=17248868-f98f-47ab-aa6a-3ffbc1c1aebf), log id: 60c33882 >2012-10-25 15:57:09,394 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-48) BaseAsyncTask::RemoveTaskFromDB: Removed task edd37a34-a643-4e47-8e56-591a9902e9d3 from DataBase >2012-10-25 15:57:09,396 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-48) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 0052e2d0-4e7e-4896-908f-168358b34696 >2012-10-25 15:57:09,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-10-thread-45) FINISH, HSMClearTaskVDSCommand, log id: 60c33882 >2012-10-25 15:57:09,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-10-thread-45) FINISH, SPMClearTaskVDSCommand, log id: 25a1a12 >2012-10-25 15:57:09,436 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-45) BaseAsyncTask::RemoveTaskFromDB: Removed task 17248868-f98f-47ab-aa6a-3ffbc1c1aebf from DataBase >2012-10-25 15:57:09,437 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-10-thread-45) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 4f5aabf3-df91-4cf1-809c-13a521dbd89f >2012-10-25 15:57:25,681 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-10-thread-45) START, IsValidVDSCommand( storagePoolId = 5fc9dbd7-9595-4192-97f1-4d2b2e24c380, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 28d46456 >2012-10-25 15:57:25,683 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-10-thread-45) FINISH, IsValidVDSCommand, return: true, log id: 28d46456 >2012-10-25 15:57:25,685 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-10-thread-45) Finished automatic refresh process for Unknown file type with success, for storage domain id 04557288-05a4-419e-8a28-910a7c8a4660. >2012-10-25 15:58:11,282 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-50) Setting new tasks map. The map contains now 3 tasks >2012-10-25 16:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering hosts is disabled, skipping >2012-10-25 16:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) Autorecovering storage domains is disabled, skipping >2012-10-25 16:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering hosts is disabled, skipping >2012-10-25 16:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) Autorecovering storage domains is disabled, skipping >2012-10-25 16:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering hosts is disabled, skipping >2012-10-25 16:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) Autorecovering storage domains is disabled, skipping >2012-10-25 16:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering hosts is disabled, skipping >2012-10-25 16:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) Autorecovering storage domains is disabled, skipping
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 868887
:
631417
|
632124
|
634294
|
634295